Engineering posts about Data Governance
Curated summaries and key learnings for engineers working with Data Governance.
Building an Enterprise Agent Platform: Enforcing Identity, Data, and API Governance
The article discusses the challenges enterprises face in deploying AI agents while maintaining effective governance across identity, data, and APIs. It emphasizes the need for a unified governance...
How Databricks Genie democratizes data access in financial services
The article explores how Databricks Genie facilitates data democratization in financial services by enabling business users to query data using natural language. It highlights the challenges faced by...
How World Bank Group uses databricks to eradicate poverty through shared knowledge
The World Bank Group has developed a unified data and AI platform on Databricks to integrate structured operational data with unstructured documents, thereby eliminating manual research bottlenecks....
Observability for any agent, anywhere: Production-ready tracing with OpenTelemetry & Unity Catalog on Databricks
The article discusses the challenges of traditional observability tools in managing the massive volumes of trace data generated by AI agents. It presents a solution through Databricks' integration...
Agent Fabric Context Catalog and the Future of AI Governance
The article explores the challenges of AI governance in the context of modern autonomous agents that operate beyond traditional application boundaries. It highlights the integration of Salesforce's...
You’ve built the media products, now make them personalized
The article explores the evolution of digital media products and the necessity for real-time data analytics to enhance user experience through personalization. It highlights the challenges faced by...
Transforming industries with conversational AI: Partner solutions built on Databricks Genie
The article explores the transformative impact of conversational AI through Databricks Genie, which addresses the 'Analyst Bottleneck' by enabling users to interact with data using natural language....
How security teams can report cyber risk to boards
The article outlines the importance of translating cyber risk into financial terms to enable boards to make informed decisions regarding security investments. It emphasizes the need for coherent risk...
How Databricks Genie improves retail personalization
Databricks Genie is a sophisticated data agent that enables retail organizations to enhance personalization by allowing customer experience leaders to query their customer data using natural language...
Governing AI agents at scale with Unity Catalog
The article explores the challenges and solutions associated with governing AI agents in organizations as they scale. It emphasizes the need for a robust governance framework that balances...
Unlock seamless and cost-effective marketing campaigns with Lakebase
The article discusses the implementation and benefits of Lakebase, an architecture that combines the advantages of transactional databases with the flexibility of data lakes. It highlights the...
Why AI Security Infrastructure is Now a CMO Priority
The article emphasizes the critical role of AI security infrastructure in modern enterprises, particularly highlighting the launch of Databricks Lakewatch, an innovative security information and...
How Databricks Genie improves supply chain visibility with real-time AI analytics
The article outlines how Databricks Genie addresses the challenges of supply chain visibility by leveraging real-time AI analytics to synthesize data from various sources. Traditional supply chain...
Automate Data & KPI Monitoring with SQL Alerts
The article introduces Databricks SQL Alerts, a tool designed to automate data monitoring and KPI tracking within organizations. It highlights the challenges of manual monitoring processes and...
Scaling Airbnb’s identity graph with a unified knowledge graph infrastructure
The article outlines Airbnb's shift from a PaaS model to an internally managed knowledge graph infrastructure, focusing on the identity graph that captures user relationships. It details the...
Announcing the Databricks analytics engineer learning pathway
The Databricks Analytics Engineer Learning Pathway is designed to equip SQL practitioners with the skills necessary to transform raw data into governed, AI-ready semantic models and metrics. The...
From manual to autonomous: how AI agents are transforming electric grid operations
The electric utility industry is facing unprecedented operational challenges due to increasing demand and aging infrastructure, necessitating the adoption of AI agents to enhance grid reliability and...
Backstage with Lakebase, part 2
In this second part of the series, the article discusses the integration of Backstage with Databricks Lakebase, emphasizing the transformation of database management from a complex, multi-service...
Expanded interoperability with Unity Catalog Open APIs
The article elaborates on the advancements brought by Unity Catalog's Open APIs, which enhance interoperability in data management by allowing enterprises to maintain a single copy of data while...
ABAC row filtering and column masking policies, governed tags, and data classification are now generally available in Unity Catalog
The article introduces the general availability of three key features in Unity Catalog aimed at enhancing data governance: Attribute-Based Access Control (ABAC) for row filtering and column masking,...