Visualization resources for data engineers

This interactive session explores data physicalization, examining how core visual encodings, chart families, and data types translate into physical space. Participants explore "the design choices, the trade-offs, and the questions that a screen tends to hide" to improve overall data communication.

Wire 4.x introduces a multi-agent Release Director Model for Claude Code and Gemini CLI, orchestrating warehouse migrations and analytics delivery. It adds dbt Charts, Looker-to-Omni migrations, and support for dbt Labs' Agents Schema to house agent context directly inside data warehouses.

Snowflake cost optimization requires granular tracking across compute pools and Cortex AI functions. Simple fixes like right-sizing warehouses and reducing job frequencies yield the highest ROI, while observability views help detect token spikes before limits are breached.

BI migrations succeed by auditing assets and centralizing upstream data. Audit dashboard usage to cut scope, then standardize business logic directly in your data layer using dbt or semantic models to eliminate rogue queries and ensure consistent metrics across dashboards.

Snowflake SQL patterns resolve common data issues in revenue pipelines. Engineers can handle gaps using date spines, deduplicate upserts via QUALIFY with ROW_NUMBER, and reconcile mismatched ledgers with FULL OUTER JOIN. Converting time zones before truncating prevents shifted period metrics.

Omni built its semantic layer as an in-memory data structure rather than raw text. Using Apache Calcite, it translates structured SQL expressions into relational algebra to generate performant queries, relying on a core extendFrom architecture to balance governance with user-defined extensions.

Using Claude with Model Context Protocol (MCP) replaces BI interfaces by querying warehouses directly, but shifts pipeline maintenance to you. Without a semantic layer, ad-hoc queries yield inconsistent metrics, and schema changes silently break data.

The nao community session highlights custom stories for building vibe-coded applications aligned with user design systems. Data engineers can leverage new migration tools to transfer Metabase and Tableau dashboards into nao, focusing on personal BI, agentic analytics, and context engineering

Awesomedataviz indexes 291 visualization and BI tools across Python, R, and JavaScript, tracking metrics via daily updates. Platforms like Grafana and Apache Superset offer SQL IDEs and metrics observability, while the catalog exposes an MCP server and JSON API for programmatic agent access.

Marimo Studio transforms reactive Python notebooks into interactive apps, dashboards, and static reports. It keeps computation, data, and controls centralized in the notebook while serving distinct frontend views. Notebook cells update dependently as input controls change.

Cloudflare unified its observability platform, adding a single SQL API to query telemetry across logs, traces, and analytics datasets. Engineers gain OpenTelemetry trace exports and Logpush access to route pipeline data directly into external architectures.

dbt Charts 0.9.0 adds Athena and ClickHouse warehouse support alongside a new y_start YAML field. This property enables floating bars starting away from zero, unlocking waterfall, Gantt, and candlestick charts directly within code-reviewed data pipelines.

Freelancers suit scoped data jobs connecting simple sources, but lack continuity. Managed services handle ongoing ETL pipeline breaks, semantic governance, source schema changes, and metric upkeep when teams lack internal data engineers to review SQL or maintain dashboards long-term.

Custom data apps replace static dashboards by pairing tailored views with row-level permissions and a governed metric layer. Unlike internal workflow tools, they focus on operational decisions.

Managed analytics services handle dashboard maintenance, pipeline upkeep, and source schema changes. A reliable service monitors daily data refreshes, prevents schema drift when source APIs change, and fixes broken pipelines so teams avoid returning to spreadsheet exports.

Strata runs locally via Docker to deliver a semantic layer over existing warehouses. Engineers connect sources like Snowflake or ClickHouse, while AI coding agents generate YAML semantic models using Git, enforcing join rules and grain-safe blending. Models are deployed via the Strata CLI.

Apache Ossie now supports Microsoft ecosystem integration via a Power BI converter translating to TMDL. This enables bidirectional conversions with Snowflake Semantic Views while adding DAX query support, preserving metric logic without duplicating underlying data across platforms.

Presentation-skill compiles structured JSON into editable PPTX decks. Treating presentations as code, scripts automate slide generation from outline.json while a validation loop runs QA to eliminate layout regressions, formatting bugs, and density issues before delivery.

The dbt Charts team is hosting open office hours to provide technical guidance on building visualizations with dbt Charts. Data engineers can explore implementation tips, get hands-on troubleshooting support, discuss pipeline visualization ideas, and share direct product feedback with the

Snowflake released the Spark Monitoring UI in preview. Data engineering updates include general availability for Snowpipe Streaming to partitioned Iceberg tables, dynamic table incremental refreshes, and zero-copy support for all table formats in interactive warehouses.

Traditional BI dashboards fail as effective interfaces due to slow feedback loops and fragmented metrics. Pointing LLMs directly at data warehouses replaces static reporting with natural language querying, but engineers must solve for trust: querying systems require consistent accuracy and

Databricks acquired Row Zero to bring live, governed spreadsheets to the lakehouse architecture. The platform supports data engineering through ETL and orchestration for batch and streaming data, unified governance across assets, and serverless data warehousing for SQL analytics workloads.

evident-charts teaches AI coding agents to produce honest data visualizations. It validates data pipelines for duplicate rows and mixed totals, lints Matplotlib code against dual axes or clipped text, and uses vision models to inspect rendered PNGs for flaws.

Observability can invert legacy workflows by modeling telemetry into a context graph over an ingested data lake. Instead of chasing infrastructure metrics, engineers model RUM, clickstream, and API logs to trace business interactions down to services, operations, traces, and root-cause logs.

Snowflake introduced a preview of the container runtime for Streamlit apps in Snowflake Native Apps. This release note highlights evolving runtime architectures for deploying containerized data apps, alongside updates like Snowpipe Streaming monitoring and dynamic table refresh support.

Snowflake introduced a preview of account posture reporting in the Trust Center. Alongside updates like incremental refresh support for dynamic tables and Snowpipe Streaming partitioned Iceberg tables, this feature helps engineers evaluate security configurations across their data platform.

A managed analytics service outsources the entire data engineering and BI lifecycle. Providers connect raw sources, implement a governed semantic layer, and enforce row-level security. They also handle ongoing pipeline maintenance, monitoring, and updates when source schemas change.

Data pipelines deriving metrics from single raster sources introduce predictable errors. Processing chains that bin modeled values must expose provenance and methodology alongside estimates so downstream users do not treat synthetic outputs as verified facts.

Hiring an analyst often burdens one person with data modeling, broken pipelines, governance, and BI tooling. Managed analytics services offer an alternative by handling data app infrastructure, pipeline maintenance, and metric definitions without requiring an in-house data engineering team.

BambooHR scaled its embedded reporting offering, Elite Analytics, to over 100,000 users using Omni. By leveraging an external analytics platform for customer reporting architectures, their data engineering and product teams avoided diverting resources from their core engineering roadmap.