dbt resources for data engineers

To build reliable healthcare AI, data engineers pair automated ingestion via Fivetran with governed transformations and lineage using dbt Labs. Integrated with Snowflake, Tuva Health, and Omni, this architecture establishes shared data definitions and strict governance for conversational analytics.

Wire 4.x introduces a multi-agent Release Director Model for Claude Code and Gemini CLI, orchestrating warehouse migrations and analytics delivery. It adds dbt Charts, Looker-to-Omni migrations, and support for dbt Labs' Agents Schema to house agent context directly inside data warehouses.

Databricks Lakeflow complements Fivetran and dbt within a unified architecture. Fivetran automates SaaS and database ingestion into open formats like Delta Lake, Lakeflow processes Kafka event streams with Spark Declarative Pipelines, and dbt models SQL business logic with built-in testing.

dbt State avoids unnecessary warehouse rebuilds by tracking changes to compiled SQL logic and upstream data freshness. Following a cheapest valid action pattern, it reuses existing tables, clones across schemas, or rebuilds only when needed, with fine-grained controls like lag_tolerance.

Orchestra introduced .oml and rolled out anomaly detection for long-running dbt models alongside an enterprise audit trail. The platform added state machine task pausing, environment branch controls, augmented managed agents, and Google Kubernetes integration.

The Vancouver dbt Meetup covers analytics engineering workflows, data modeling, and modern data stack architecture. Featured technical sessions explore the convergence of data roles into full-stack functions and strategies for running DuckDB alongside Snowflake in production to optimize dbt project

Small teams should minimize tools by using a usage-billed warehouse, three data layers (raw, staging, marts), and unified tooling like Bruin CLI or dbt Core to manage ingestion, transforms, and orchestration.

dbt Charts 0.9.0 adds Athena and ClickHouse warehouse support alongside a new y_start YAML field. This property enables floating bars starting away from zero, unlocking waterfall, Gantt, and candlestick charts directly within code-reviewed data pipelines.

The dbt Charts team is hosting open office hours to provide technical guidance on building visualizations with dbt Charts. Data engineers can explore implementation tips, get hands-on troubleshooting support, discuss pipeline visualization ideas, and share direct product feedback with the

Databricks acquired RowZero to expand its BI and insights tooling, putting pressure on competitors. Orchestra introduced live anomaly detection for dbt models to catch long-running jobs via configuration, while adding state machine controls to pause individual tasks and integrate with GKE.

Paradime State adds state-aware orchestration to Bolt via dbt Core v2.0. Its decision engine evaluates upstream freshness and SQL logic fingerprints rather than raw text to skip, clone, or build models, avoiding full pipeline rebuilds without per-skip fees.

Modelith adds a Git-based modeling layer for dbt-core. Defined in plain YAML, it lets engineers design entity relationships, generate contract-enforced dbt models, and run drift checks against warehouse schemas via the mdl CLI to catch breaking changes before deployment.

AI data agents need context beyond raw SQL schemas to prevent errors. Provide governed metric definitions via a semantic layer, data catalog metadata, lineage, and document RAG. Expose these to agents using an MCP server with read-only credentials rather than querying raw tables directly.

The Atlanta dbt Meetup convenes data practitioners to discuss the modern data stack and engineering workflows. Attendees will review recent dbt releases, evaluate post-Summit tooling developments, and participate in a townhall exploring enterprise AI adoption across their technical architectures.

🎙️ André Noujaïm — Combining DuckDB with dbt enables a lightweight approach to analytics engineering that reduces the need for complex, traditional data pipelines. By moving compute closer to storage and leveraging live federation, teams can simplify transformations within an AI-native lakehouse architecture.

dbt v2 marks dbt's evolution from a SQL tool into a broader data platform. The release consolidates Fusion into a single Rust-based engine with free and open-source distributions, unifying transformation and metadata to support semantic metrics and AI agent context alongside Fivetran.

dbt State enables data engineers to "build what's changed and skip what hasn't" across data pipelines. Key technical capabilities include automated change detection, freshness SLAs, and table cloning across environments like dbt Core v2 and the Core plugin to optimize runtimes.

This session covers the latest quarterly updates across dbt, detailing new features and workflow changes that impact how data engineers build transformation pipelines. Attendees will explore architectural improvements, practical modeling adjustments, and the future roadmap for the tooling.

Optimize transformation costs by storing data in open Apache Iceberg tables and routing workloads across multiple engines within a single dbt DAG. By pairing Snowflake with Lake Compute, data engineers can run lightweight staging models on cheaper compute while reserving warehouses for heavy

Data engineers can leverage Omni's bidirectional dbt integration to enhance modeling workflows. The platform enables technical teams to bridge data models with analytics, allowing practitioners to push past pre-built dashboards and deploy AI to explore models across both data and business teams.

The Copenhagen dbt Meetup covers analytics engineering workflows, including extending dbt version control and testing into BI layers with downstream impact analysis.

dbt-charts provides a declarative YAML syntax around SQL to generate interactive dashboards. CLI tool dct compiles board definitions directly from warehouse queries, replacing fragmented reporting layers with auditable, code-first definitions.

Context engineering shifts data architecture from dashboards to AI agents. Modern warehouses like Snowflake and Databricks now offer native SQL functions for unstructured data and vector embeddings, allowing teams to model context in dbt without deploying separate vector databases.

AI agents querying data split on business logic without governance. Testing five dbt interfaces revealed the Semantic Layer was the only interface bringing Claude Haiku and Opus to zero wrong answers. Providing governed metric definitions reduced errors at the lowest cost per trusted answer.

The dbt Charts team is hosting open office hours focused on data visualization within the dbt ecosystem. Data engineers can explore implementation patterns, learn optimization tips, troubleshoot pipeline visualization challenges, and provide direct product feedback to the development team.

dbt lacks native real-time run state tables, requiring log parsing to stream metadata. Orchestra addresses this architectural gap by introducing node-level anomaly detection, alerting mid-run when tasks exceed baseline duration thresholds to catch pipeline creep and avoid SLA breaches.

dbt v2 ships with a built-in DuckDB adapter running on its Rust engine via ADBC drivers. The release adds DuckLake and Iceberg REST catalog support, plus an Information Schema feature that outputs project metadata as Parquet files, enabling fast SQL queries on manifests directly with DuckDB.

MotherDuck now lets you publish declarative dbt Charts as interactive MotherDuck Dives. Via an on-run-end hook, a serverless Python Flight compiles chart YAML into Vega Lite and publishes live-updating dashboards alongside data pipelines.

Evaluating semantic layers for AI agents requires analyzing real user sessions and queries. Motley tracks agent interactions and logs issues like missing data, unclear docs, or incorrect SQL joins. Admins can inspect tool calls and executed SQL to debug models and refine semantic definitions.

Orchestra announced real-time anomaly detection for dbt operations to alert when models run long. Platform updates include Google Kubernetes integration, task pausing, and pipeline environment controls, while the broader data ecosystem saw major funding for Temporal and Streamhouse adoption.