Databricks buys Electric to embed local Postgres in AI agents
Databricks is acquiring the startup Electric to integrate WebAssembly-based Postgres databases directly into application environments for an undiscl…
Latest News
⚑ Report a ProblemTech news from the best sources
All topics
AI
Gear
News
Tech
agents
ai
api
architecture
automation
beginners
career
database
devchallenge
devops
javascript
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
react
security
showdev
testing
tutorial
typescript
webdev
Medallion architecture on Databricks: what actually matters
Every Databricks pitch deck has the same three-layer diagram: bronze for raw data, silver for cleaned data, gold for business-ready tables. The diag…
Using Databricks FILE type against data on NAS: what works today with FSx for ONTAP S3 Access Points
A follow-up to Part 2: Databricks and FSx for ONTAP S3 Access Points in the "FSx for ONTAP S3 Access Points x Lakehouse Deep Dive" series. Some resu…
DP-750: Databricks Asset Bundles, Git, and ALM Explained and with Real Exam Questions
When preparing for DP-750: Microsoft Certified: Azure Databricks Data Engineer Associate , you need to understand how Azure Databricks projects are…
DP-750: Slowly Changing Dimensions and Data Quality Expectations Explained and with Real Exam Questions
When preparing for DP-750: Microsoft Certified: Azure Databricks Data Engineer Associate , you need to understand two related but different topics:…
Agentic AI and big data: what your platform needs before agents are useful
The pitch for agentic AI on enterprise data is genuinely appealing: instead of a chatbot that answers one question at a time, you get something that…
DP-750: Delta Lake Table Operations Explained and with Real Exam Questions
When preparing for DP-750: Microsoft Certified: Azure Databricks Data Engineer Associate , you need to understand common Delta Lake and Spark table…
Snowflake to Databricks: what the migration actually costs you
Most Snowflake-to-Databricks migrations get sold on cost and delivered on something else. The credit line item is what gets the project funded, but…
Databricks launches AI agent for legacy SQL migration
Databricks is expanding its Lakebridge toolkit by introducing an agentic code conversion feature designed to help organizations migrate from legacy…
Databricks Workflows vs Airflow vs Dagster: Picking an Orchestrator
Every data team eventually asks the same question: what runs our pipelines, on what schedule, with what retry logic, and who gets paged when it fail…
Spark Performance Deep Dive on Databricks: Shuffle Tuning, Skew Handling, and Z-Ordering with Delta Lake + Unity Catalog
The problem with "just add more workers" Most Spark performance issues on Databricks aren't solved by scaling the cluster — they're caused by shuffl…
One Copy, Two Engines: Architecting a Governed Lakehouse Across Fabric and Azure Databricks
For most of the last decade, the honest answer to "should we standardize on Databricks or on the Microsoft data platform?" was: pick one and live wi…
🔐 Storage Credentials in Databricks Unity Catalog (AWS) — The Security Backbone You Can't Ignore
As organisations move to the Databricks Lakehouse Platform on AWS, two priorities consistently surface at the top of every architecture conversation…
How to Query Databricks from Salesforce Apex (Without Copying a Billion Rows)
The problem We had a reference dataset in Databricks with 1B+ rows . Users needed to look up a handful of those rows from a Salesforce record page.…
[Databricks on AWS #5] Fixing Databricks BOOTSTRAP_TIMEOUT with AWS PrivateLink: Control Plane Over the Backbone, Zero New Subnets
📚 Series: Databricks on AWS (Part 5) Building a Databricks AI Platform on AWS RBAC with Function-Role Groups Compute Governance: Pools, Policies, Cl…
[Databricks on AWS #4] The BOOTSTRAP_TIMEOUT Mystery: Tracing a Databricks Cluster from Data Plane to Control Plane (Transit Gateway + Firewall)
📚 Series: Databricks on AWS (Part 4) Building a Databricks AI Platform on AWS RBAC with Function-Role Groups Compute Governance: Pools, Policies, Cl…
[Databricks on AWS #3] Compute Governance on Databricks: Instance Pools, Cluster Policies, and Shared Clusters
📚 Series: Databricks on AWS (Part 3) Building a Databricks AI Platform on AWS RBAC with Function-Role Groups Compute Governance: Pools, Policies, Cl…
[Databricks on AWS #2] RBAC on Databricks: Function-Role Groups, Workspace Assignment, and Why USER/ADMIN Isn't the Whole Story
📚 Series: Databricks on AWS (Part 2) Building a Databricks AI Platform on AWS RBAC with Function-Role Groups ← you are here Compute Governance: Pool…
[Databricks on AWS #0] The Target Architecture: Isolating Prod, Dev, and Sandbox with Unity Catalog
📚 Series: Databricks on AWS (Part 0, prologue) The Target Architecture ← you are here Building a Databricks AI Platform on AWS RBAC with Function-Ro…
Azure Databricks vs Microsoft Fabric: An Honest Guide to When to Use What
If you're building a data platform on Azure in 2026, you're going to be asked this question: Azure Databricks or Microsoft Fabric? Both run on Delta…
Azure Databricks for MLOps and Feature Engineering at Scale with Apache Spark, Delta Lake, and MLflow
Raw data doesn't win model competitions. Features do. And when your raw data is tens of billions of rows sitting across multiple sources, you can't…
How I Built a Databricks AI Agent with No Custom Tables (OpenAI Agents SDK + Gradio)
Most Databricks agent tutorials start with "set up Unity Catalog and Vector Search first." This one doesn't. I built a fully working conversational…
Real-Time AI Feature Engineering with Spark Structured Streaming and Databricks Feature Store
Building point-in-time correct, production-grade feature pipelines — from raw Kafka events to online feature serving in milliseconds, using Spark St…
Apache Spark Query Optimization on Databricks: Catalyst, AQE, and Photon Engine
A deep dive into how Spark transforms your SQL into a physical execution plan — and how Databricks layers Adaptive Query Execution and the Photon ve…
How I debugged a Delta Lake DESCRIBE HISTORY timeout (and what's actually causing it)
If you have ever run DESCRIBE HISTORY on a Delta table that receives streaming data every 60 seconds and watched it either hang for hours or crash w…