Snowflake resources for data engineers

Snowflake released general availability for on-demand table creation in catalog-linked databases. Recent updates also expand Apache Iceberg integration, adding backups, cross-account read/write via Horizon Catalog without secrets, and structured type evolution for Delta Direct.

Snowflake Horizon Catalog now supports reading and writing Apache Iceberg tables across different Snowflake accounts without requiring manual secret management. This update streamlines cross-account data architecture, governance, and pipeline integration for multi-account Iceberg lakehouses.

Snowflake released updates for Data Clean Rooms alongside new data engineering features. Key platform enhancements include backups for Apache Iceberg tables, structured type evolution in Delta Direct, open data sharing, and task graph deployments.

Snowflake previewed Organization users and user groups in Organization Command Center, streamlining centralized cross-account identity governance. Concurrent updates added backups and Time Travel for Apache Iceberg tables, along with native database cloning support for hybrid tables.

Snowflake released major updates for Apache Iceberg, adding table backups, Time Travel, Horizon Catalog access, and v3 upgrades. Engineers also gained hybrid table cloning, secondary indexes, declarative feature stores, and task graph enhancements like atomic deployments and centralized

A Snowflake Cortex agent automates dltHub pipeline recovery. Triggered by job failures, it retries transient issues or fixes code and config errors by editing files in git and redeploying. Actions run via stored procedures on a warehouse, backed by audit tables and automated rollbacks on failure.

Snowflake release notes detail platform updates, including Apache Iceberg table backups, Delta Direct structured type evolution, and external OAuth for Snowflake Postgres. Data engineering capabilities feature task graph deployments, secondary indexes, and hybrid table database cloning.

Snowflake introduced support for SECRET object tagging, enhancing metadata management and governance for sensitive pipeline credentials. Engineers can now apply object tags directly to secrets to track and audit authentication assets across database environments.

Snowflake cost optimization alternatives to Yuki target warehouse rightsizing. While Yuki and Espresso proxy connections to route individual queries across warehouses, native Snowflake Adaptive Warehouses or Keebo dynamically adjust cluster capacity, autoscaling, and auto-suspend settings directly.

Snowflake CoCo integrates directly into Excel and Google Sheets to stream live query results into workbooks without consuming the model context window. It preserves Snowflake governance, using RBAC and policies to enforce security while offloading complex data modeling to virtual warehouses.

Snowflake released HTML reports in preview alongside general availability for Apache Iceberg table backups. Other data engineering updates include schema variables, declarative feature stores, and automated task graph deployments.

Snowflake added background runs and supplementary tools for agents in its managed MCP server. Recent releases also introduced backup and Time Travel support for Apache Iceberg tables, along with atomic deployments, centralized configuration, and advanced branching for task graphs.

Snowflake deprecated Openflow legacy runtime metrics in its October 28, 2026 update. Data engineers tracking Openflow pipelines must transition observability and monitoring workloads away from legacy telemetry. Concurrently, Snowflake added Time Travel for Apache Iceberg tables in Preview.

Snowflake announced the general availability of Delta Direct structured type evolution. This update enhances Delta Lake integration by supporting schema evolution on complex types, streamlining external table pipelines without manual schema interventions.

Snowflake introduced a preview of Level of Detail (LOD) expressions in semantic views. This feature allows data engineers to define complex metric aggregations across different dimensional granularities directly within semantic views, simplifying analytical modeling and SQL query construction.

Snowflake released general availability for cloning databases that contain hybrid tables, simplifying environment replication across mixed transactional and analytical architectures. Secondary indexes for hybrid tables also reached general availability.

Snowflake has made backups for Snowflake Storage for Apache Iceberg tables generally available, improving disaster recovery and data protection. Data engineers can safeguard lakehouse architectures while maintaining open table format interoperability.

This dbt package analyzes compute, storage, and query patterns across Snowflake, Databricks, BigQuery, and Redshift to generate prioritized cost-saving recommendations. It offers run-operation macros and builds gold-layer marts when enabled via environment variables.

Snowflake announced general availability for the Streamlit in Snowflake container runtime across AWS government regions. This update allows data engineers to deploy secure, containerized data applications and interactive dashboards directly within regulated public sector cloud environments.

To optimize Snowflake costs, alternatives address distinct bottlenecks: Keebo automates warehouse sizing, Yuki routes queries across warehouses, and SELECT pairs cost attribution with configuration tuning. Teams can also offload reads to engines like DuckDB or tune native auto-suspend limits.

Snowflake released CoCo Desktop v1.24.0 alongside major data engineering updates. Key platform additions include continuous and bulk file loading with CoCo, Tri-Secret Secure and Time Travel support for Apache Iceberg tables, secondary indexes, and atomic deployments for DCM task graphs.

Snowflake added an agentic mode to AIPARSEDOCUMENT that extracts structured summaries of charts and diagrams. It costs 8.18 credits per 1,000 pages versus 0.68 for OCR. Slide decks benefit most, while visual summaries live in separate page arrays and require literal mode inputs.

Snowflake previewed Snowflake CoCo integrations for Microsoft Excel and Google Sheets, alongside general availability for Cortex AI Gateway and Open Data Sharing. Key platform updates for data pipelines include task graph branching, Parquet Direct, and continuous file loading via CoCo.

Snowflake tag-based masking scales governance by decoupling dynamic masking policies from individual tables. Organizations achieve separation of duties by letting governance councils establish taxonomies, stewards map sensitive columns, and platform teams attach masking policies to tags.

Snowflake announced Business Ontology in Horizon Context to govern business concepts and map them to Semantic Views and tables. It supports open formats like Apache Ossie and RDF for cross-tool portability, while Cortex Sense infers metadata context from query history and dbt models.

USA Cycling is centralizing its fragmented performance, race, and telemetry data into Snowflake to build an Athlete 360 foundation for the LA28 Games. The architecture unifies metrics from disparate tools and uses Snowflake Cortex AI for analytics, enabling low-latency trackside insights.

Snowflake CoCo introduces autonomous Cloud Agents to execute long-running pipelines and scheduled data engineering tasks within governed sandboxes. Using Cortex AI Gateway and Model Context Protocol connectors, agents automate root-cause analysis on failed tasks and commit fixes via Git.

Snowflake CoWork adds Profiles, Dashboards, and Automations. Automations execute scheduled recurring jobs via native Snowflake tasks. CoWork queries governed data while strictly enforcing row access and masking policies, using Cortex Search and AI Gateway to manage permissions, models, and costs.

Snowflake introduced agentic tools grounded in governed data. Snowflake CoCo executes tasks, pipeline builds, and scheduled automations with preset quotas. Cortex Sense autobuilds context from schemas, while Cortex Training and App Runtime allow teams to build and deploy models and apps in-account.

Snowflake expands lakehouse governance and observability for AI agents using Apache Iceberg, Polaris, and Snowpipe Streaming. Cortex AI Gateway standardizes access policies across engines, while OpenTelemetry logs telemetry directly into Iceberg tables for SQL-based trace and cost analysis.