Who needs rewrites? This metadata-powered architecture fuses AI and ETL so smoothly, it turns pipelines into self-evolving engines of insight. In the fast-evolving landscape of enterprise data ...

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

Today, at its annual Data + AI Summit, Databricks announced that it is open-sourcing its core declarative ETL framework as Apache Spark Declarative Pipelines, making it available to the entire Apache ...

Databricks has announced a launch that signals a shift from generative AI experimentation to production-scale deployment – anchored by two new tools, Lakeflow Designer and Agent Bricks. Both are aimed ...

Databricks new Data Intelligence for Cybersecurity, built on the same data lakehouse architecture as the company’s flagship data and AI platform, is designed to help security teams more efficiently ...