Hey Community! Join us for a free Databricks Community sponsored BrickTalk on Thursday, July 30! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and AI, ...
Community Ask Hey Community! Your Databricks Community profile is often the first thing other members see when they come across your posts, solutions, blogs, or event participation. A complete profile helps other members understand who you are,...
Help Your Knowledge Reach More People Every Technical Blog, Community Article, MVP article, or answer you share can help someone beyond the Databricks Community. Small improvements in how you write can make your content easier to discover through C...
WEBINARTime: July 21 / 8:00 AM PT Whether you’re building an agentic AI roadmap or pressure-testing your current approach, you’ll gain a clearer view of how leading enterprises are approaching agentic AI, and where the biggest opportunities lie ahead...
Monthly Recap • June 2026 Community Fellows Community Fellows are Bricksters who show up – in the forums, for customers, and for the community. Some months, that means going beyond the forums. June was one of them – Fellows brought their energy t...
Product recommendations help guide customers through their shopping journey. The Building Common Sense Product Recommendations With LLMs Solution Accelerator shows how retailers can use LLMs to develop recommendations for new-to-market products by tu...
The Weekly Digest • July 6 – July 12 Community Pulse From hot takes to resolved threads – here's everything you need to catch up. This Week's Community Stars The members who showed up and made a difference this week: @balajij8 @Sumit_7 + To...
Hey Community! Join us for a free Databricks Community sponsored BrickTalk on Thursday, July 30! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and AI, ...
This would be a great session for anyone interested in how data and AI are being used in real-world decision-making.
If we set the REPLICA option in Postgres, we can then set CDF sync to Unity Catalog in the branch overview. #databricks more news and video https://medium.com/databrickscommunity/databricks-news-rt-lakehouse-reyden-lakebase-ttl-8416bdccf627
Hi community!Matei Zaharia and the Databricks team just announced the release of Apache Spark 4.2. As a Data Architect, seeing how this engine is evolving to bridge the gap between traditional data engineering, governance, and the AI era is incredibl...
We are reporting two groups of Snyk-identified security vulnerabilities in com.databricks:databricks-jdbc:3.4.1 caused by shaded/embedded dependencies that cannot be remediated by consumers through standard dependency management overrides.Why We Cann...
@psjava31955 , thanks for the detailed writeup, and you've got the mechanism exactly right. The uber jar (com.databricks:databricks-jdbc) is shaded, so those artifacts are relocated inside the jar. BOM overrides, resolutionStrategy, and dependencyMan...
I built an App with a chatbot which generates queries and accesses data through a Genie Space. When making questions in the chatbot now, I keep getting the following error in the Genie monitoring page: An error happened. Please try again later.We're ...
Hello @emsmarcela , good instinct flagging that you haven't touched your app code. That's the most useful detail in your whole post, and it tells us a lot. An INTERNAL_ERROR like this one means Genie tripped while it was generating or processing the ...
Medallion Architecture in Practice: The Design Decisions Nobody Puts in the DiagramEvery Lakehouse conversation eventually shows the same three boxes: Bronze, Silver, Gold. It's a great mental model — but on a real enterprise migration, the diagram i...
Great work, man! Even though I don't know much about this field, your article made me curious and motivated me to read more about it. Thanks for sharing such valuable insights.keep posting
I’m building a custom UI table (using Next.js and FastAPI) to display MLflow trace data from a Retrieval-Augmented Generation (RAG) application running on Databricks Managed MLflow 3.0. The table needs to show answer generation speed (from CHAT_MODEL...
"Rolling deletion" is not supported and was never enrolled for customer. So I would recommend using Store OpenTelemetry traces in Unity Catalog (GA'd today) for storing directly in UC which is scalabable beyond the 100K limit. The only option is t...
Hello Databricks community,I have built an application that has a lot of proprietary code and packages that I chose not to show for the public- I just want my service to be accessible for the people who install the application through a Streamlit fro...
Hey Antoine, great questions — this is a common challenge when building commercial apps on Databricks. Let me address each area directly.The fundamental tradeoffThe core tension here is architectural: when code runs in the user's workspace, it's very...
Why We Used Delta Live Tables for Exactly One Pipeline (and Not for Silver/Gold)"Why isn't DLT used everywhere?" is one of the first questions I get when reviewing this architecture with other engineers — so I figured it was worth writing up properly...
I must admit, this was a nagging question I never asked as a junior data engineer and have just taken for granted every since. Thanks for addressing an oversight I didnt even know I had!
Introduction several capabilities that seem to shift Databricks from being primarily a data platform to becoming an AI operating system—Genie One, Agent Bricks, AI Gateway, Lakebase Search, and business semantics.Do you see the future enterprise arch...
Databricks introduced several governance capabilities for the agentic era, including Unity Catalog Business Semantics, AI Gateway, and agent-ready governance.My question is:In a large enterprise with 20+ business domains, how are you governing:Agent ...
it seems Databricks is moving from traditional RAG pipelines toward agent-native architectures with Lakebase Search, Genie Agents, MCP integration, and semantic business context.For teams building enterprise GenAI applications today:Are you still bui...
What is the recommended governance strategy for Databricks Vector Search in an enterprise Unified Data Platform (UDP) where structured and unstructured data from multiple business domains (Sales, Marketing.) is ingested into a common analytics platfo...
I am building an Agentic Application on Databricks using LangGraph (Classic Compute — Serverless cant be used so Agent Brickscant be used ).I want my agent to have two types of memory:Short-term memory → Remember the current conversation and tool out...
Since you're using LangGraph on Databricks Classic Compute, you don't have Agent Bricks or Managed Agent Memory. I would build the memory layer directly on Delta Lake + Unity Catalog. This gives you full control, is scalable, auditable, and integrate...
The Weekly Digest • July 6 – July 12 Community Pulse From hot takes to resolved threads – here's everything you need to catch up. This Week's Community Stars The members who showed up and made a difference this week: @balajij8 @Sumit_7 + To...
Kudos to all the contributors and membersThanks for sharing/mention @Advika !
| User | Count |
|---|---|
| 2280 | |
| 1356 | |
| 1237 | |
| 1183 | |
| 961 |
| User | Count |
|---|---|
| 445 | |
| 286 | |
| 220 | |
| 63 | |
| 51 |
Most teams I work with don't struggle with the AI part of MLOps. They struggle with the boring parts: getting code from a notebook into production without breaking it, knowing when a model has gone st...
Build a sub-second operational dashboard on live streaming data, starting with a live Kafka stream This blog is a full end-to-end walkthrough for practitioners on how to build real-time applications u...
As organizations scale their AI initiatives on Databricks, a common pattern emerges: one team builds and maintains a vector store, while other teams across different workspaces need to query it. Perha...
Unified stack for geospatial workloads Every day, hundreds of thousands of vessels broadcast their position, speed and heading via AIS. That data stream is a goldmine: commodity traders can sharpen ET...
