Engineering articles from Databricks
AI summaries and key learnings from Databricks engineering teams.
Transforming Healthcare Referrals with Fivetran, Agentic AI, and Databricks Genie
The article outlines how healthcare organizations can address fragmented data challenges by leveraging Fivetran for seamless data extraction and Databricks for data unification and AI deployment. It...
Decoupled by Design: Billion-Scale Vector Search
The article discusses the challenges and solutions in building a billion-scale vector search system at Databricks. It highlights the limitations of traditional vector databases that couple storage...
The Professional Impact of Becoming Databricks Certified
The article highlights the significance of Databricks certifications in enhancing professional credibility and career opportunities for data and AI practitioners. It emphasizes that these...
Introducing Kasal
Kasal is a low-code platform developed by Databricks Labs for designing, deploying, and orchestrating agentic AI systems. It provides a visual interface that allows users, regardless of their...
Business Intelligence Analytics: A Complete Guide for the AI Era
The article discusses the evolution of business intelligence (BI) analytics, emphasizing the need for organizations to bridge the gap between data collection and actionable insights. It outlines the...
Building What’s Next. Together. Introducing the Brickbuilder Partner Network for the Agentic AI Era
The Brickbuilder Partner Network is a newly established global partner program aimed at fostering growth and innovation among consulting firms, independent software vendors (ISVs), and data providers...
LogSentinel: How Databricks uses Databricks for LLM-Powered PII Detection and Governance
The article presents LogSentinel, a sophisticated LLM-powered data classification system developed by Databricks for the automatic detection and classification of sensitive data, particularly...
Building a near real-time application with Zerobus Ingest and Lakebase
The article discusses the integration of Zerobus Ingest and Lakebase within the Databricks platform to facilitate the development of near real-time applications. It highlights how Zerobus Ingest...
New in Migrations: Faster and More Predictable
The article outlines the latest enhancements in Lakebridge, a tool designed to streamline the migration of legacy data warehouses to the Databricks platform. Key features include an automated...
Meet KARL: A Faster Agent for Enterprise Knowledge, powered by custom RL
The article introduces KARL, a custom reinforcement learning model developed by Databricks to enhance enterprise knowledge tasks such as document searching and reasoning. It highlights the challenges...
Turning Insight Into Impact with Databricks and Global Orphan Project
The article outlines the collaboration between the Global Orphan Project and Databricks to enhance data-driven operations through a centralized Lakehouse architecture. By consolidating various data...
Bayer Consumer Health scales global self-service analytics with Unity Catalog
Bayer Consumer Health has successfully implemented a unified data platform using Databricks and Unity Catalog to eliminate data silos and enhance self-service analytics across its global operations....
Unified data discovery with business context in Unity Catalog
The article introduces the Databricks Discover experience, which aims to streamline data discovery by embedding business context directly into Unity Catalog. As organizations grapple with the...
Tutorial: How to ship AI/BI Dashboard changes safely at scale with Databricks Asset Bundles
This article outlines a structured workflow for deploying AI/BI dashboards using Databricks Asset Bundles, emphasizing the importance of treating dashboards as production-grade data products. It...
Azure Databricks Lakebase is Generally Available
Azure Databricks Lakebase is a managed, serverless PostgreSQL service designed to enhance data architecture by integrating operational capabilities directly into the lakehouse environment on Azure....
Activate first-party data with Meta Conversions API on Databricks
The article introduces the Meta Conversions API as a solution accelerator available on the Databricks Marketplace, aimed at enhancing the activation of first-party data for marketing teams. It...
Jefferies modernizes equity research at scale with Databricks and agentic analytics
Jefferies has modernized its equity research processes by leveraging Databricks and agentic analytics, enabling over 250 analysts to efficiently address complex research questions across diverse...
Real-Time Mode: Ultra-low latency streaming on Spark APIs without a second engine
The article introduces Real-Time Mode (RTM) in Apache Spark, which unifies offline training and ultra-low-latency online feature engineering into a single engine, eliminating the need for separate...
From Tribal Knowledge to Instant Answers: Building Reffy on Databricks
The article discusses the development of Reffy, an application built on Databricks to streamline the discovery of customer references. It addresses the challenges of accessing tribal knowledge within...
Databricks at MWC 2026
The article highlights Databricks' participation at MWC 2026, emphasizing the transformative impact of unified data and AI on the telecom industry. It discusses the challenges faced by telecom...