Sharing resources for data engineers

Snowflake published its October 8, 2026 feature update for Snowflake Data Clean Rooms alongside broader releases, including Snowpipe Streaming for partitioned Apache Iceberg tables and incremental refresh support for dynamic tables using the VALUES clause.

Snowflake released zero-copy integration for Workday Data Cloud into general availability. This feature allows direct data access without manual ETL or data duplication pipelines. Snowflake also added lineage preservation across temporary tables and views.

DuckDB database files can store only view definitions pointing to remote Parquet files on object storage instead of raw data. Acting as a lightweight catalog under a few hundred kilobytes, it creates a shareable semantic layer that abstracts file layouts while querying via the httpfs extension.

Snowflake announced the public preview of Agentic Marketplace Discovery in its feature updates. Recent data engineering updates also include Iceberg partition evolution, Elastic Channels for Snowpipe Streaming, and dynamic table incremental refresh support for non-deterministic functions.

Public sector operations rely on underlying data infrastructure to collect, validate, transform, and exchange records across legacy ERP systems, GIS, and databases. Reliable government services require robust pipelines that maintain data quality across integrated administrative workflows.

Snowflake released updates for Data Clean Rooms alongside key pipeline features. Data engineers gain Snowpipe Streaming for partitioned Apache Iceberg tables and incremental refresh support for dynamic tables using non-deterministic aggregates and the VALUES clause.

Snowflake released general availability for skill and plugin sharing in CoCo. Recent platform additions also highlight data engineering capabilities, including partitioned Apache Iceberg table support in Snowpipe Streaming and dynamic table incremental refreshes using the VALUES clause.

Modern data platforms accelerate M&A due diligence and integration by unifying structured and unstructured data across enterprises. Using clean rooms and AI-driven classification, engineering teams streamline data migration, enforce governance, and reduce legacy reliance during post-deal execution.

Snowflake released updates for Data Clean Rooms alongside dynamic table enhancements, including general availability for non

Data governance needs concrete ROI to survive budget reviews. Measure engineering baselines immediately: track time spent preparing data, rebuilding reports, and waiting for access. Replace vague quality goals with hard cost reductions, such as deprecating redundant dashboards and files.

The open source version of nao introduces group permissions to control access to specific data and context. The platform also added an integration with MetricFlow to support the semantic layer, targeting data teams and engineers working with context engineering and agentic analytics.

The City of Toronto Open Data team is collaborating with Toronto Police Services to showcase public data operations. The session covers data pipeline management and catalog architecture across more than 45 public datasets hosted on the police data portal, emphasizing data accessibility and civic

The Budapest Snowflake Meetup focuses on multi-modal data architectures and enterprise governance. Technical sessions cover building customer 360 models in financial services alongside scaling access control from RBAC, masking, and row access policies to Secure Data Sharing and Organizational

This technical session covers modern data sharing architectures and AI-driven data access. Engineers will explore cross-platform integration patterns, fine-grained access governance, and how to deploy Genie with Slack to securely query enterprise data while maintaining strict workspace security.

Data and AI leaders gather for technical brainstorming sessions to address core engineering and operational challenges in small groups. Participants share architecture strategies and exchange practical solutions for scaling data infrastructure and machine learning systems within high-growth tech

Snowflake expanded data architecture integrations with hyperscalers and SaaS platforms, driving AI cloud consumption. Key technical growth stems from zero-copy data sharing with Salesforce, SAP, and ServiceNow, alongside Anthropic LLM integrations powering its agentic data engineering workflows.

Delta Lake UniForm writes Iceberg metadata alongside Delta logs over identical Parquet files, letting Snowflake read Databricks tables directly. Linking Snowflake to Unity Catalog endpoints eliminates duplicate storage pipelines, though cross-platform reads depend on catalog metadata refresh cycles.

Focus on data distribution over storage or collection. Effective data architecture builds around primitives that preserve optionality rather than fixed answers, ensuring systems adapt as business needs shift. Treat data strategy as continuous work rather than a static roadmap.

JupyterGIS 0.16 adds support for GeoZarr, GeoPackage, and openEO layers. Data engineers can visualize remote processing pipelines as lazy, tile-based map layers directly from openEO backends without local materialization, and stream Xarray datasets via jupyter-tiler.

Snowflake published updates for Snowflake Data Clean Rooms alongside several data engineering features. Key platform enhancements include general availability for online modification of hybrid table constraints, external lineage tracking, and second generation Openflow runtimes and deployments.

Snowflake deployed Data Clean Rooms updates alongside external lineage support and data lineage for Cortex Agents. Releases also delivered an increased file limit for deployed dbt project objects, new Iceberg REST integrations, and CDC via Openflow Connector for SQL Server.

Data contracts prevent silent schema breakage by formalizing agreements as code. Enforced via tools like Bruin, dbt, or Soda, they validate schemas in CI policies and halt pipelines with blocking runtime checks before consumers ingest bad data.

Snowflake released a preview of remote app operations for Snowflake Native Apps. Additional updates include remote development in VS Code, stable egress IP addresses on Azure, and Apache Iceberg catalog integrations to enhance data engineering workflows across platforms.

Traditional APIs limit data engineering by restricting queries, throughput, and cross-service joins. True interoperation requires streaming the entire dataset to build custom indexes, models, and shared databases rather than querying closed, rate-limited REST endpoints.

Snowflake released feature updates for Data Clean Rooms alongside improvements to the data platform. Recent additions include Cortex agent capabilities, multi-value tags, and enhanced data freshness for ORGANIZATION_USAGE views.

Snowflake introduced Request Access in Workspaces in preview, alongside Amazon S3 Tables Iceberg REST catalog integration. Recent data engineering updates also include CREATE OR ALTER support for dynamic Iceberg tables and new usage monitoring views.

Snowflake deployed updates for Snowflake Data Clean Rooms alongside general availability for AIEXTRACT and AIPARSE_DOCUMENT with client-side encrypted stages. Data engineers also gained new data movement policies and Horizon Catalog access to externally managed Apache Iceberg tables.

Snowflake enables life sciences M&A data integration without physical migration using Secure Data Sharing and federated architectures. For divestitures, Zero-Copy Cloning and row-level security isolate commingled datasets without breaking GxP compliance or duplicating storage costs.

Enterprises are adopting zero-copy data architectures using open table formats like Apache Iceberg to query source data directly, eliminating redundant ETL pipelines and cutting storage costs. Embedded AI models process unstructured files and run conversational queries directly where data resides.

Snowflake released updates for Data Clean Rooms, the Python API (v1.13.1), and ML Python (v1.51.0). Key data engineering features include Amazon S3 Tables Iceberg REST catalog integration, Openflow CDC for SQL Server, and adaptive or incremental refresh modes for dynamic tables.