dataaaaa!

Snowflake announced the general availability of zero-copy support for all table formats in interactive warehouses. Data engineers can leverage metadata-driven cloning across formats, while additional platform updates include the Iceberg Scan Plan API and online constraint management for hybrid

Snowflake rolled out CoCo Desktop v1.21.4 alongside GCP support for second-generation Openflow deployments and runtimes. Recent data engineering updates also include an Iceberg Scan Plan API in Horizon Catalog and dbt artifacts for Slim CI in Snowflake dbt projects.

Snowflake introduced data lineage for streams, enhancing visibility into CDC pipelines. This update helps data engineers track pipeline dependencies and schema transformations across change tracking objects directly in the data platform.

Snowflake has expanded second generation Openflow deployments and runtimes to GCP following general availability. This architectural update modernizes pipeline execution after Openflow gen 1 deployment creation was retired.

Snowflake released the Iceberg Scan Plan API in Horizon Catalog in public preview. This enhances data lakehouse integration by exposing Iceberg table scan planning directly through the catalog.

Google BigQuery now integrates its Data Engineering Agent with BigQuery Graph, which is generally available. The integration adds context between source and destination schemas, improving automated schema mapping accuracy across data pipelines.

Snowflake introduced external secret providers in preview for managing credentials. Additionally, dbt Projects on Snowflake now supports Slim CI and defer to production using dbt artifacts. Data engineers can also manage hybrid table constraints online and leverage external lineage features.

Kestra 2.0 decouples its control and data planes, allowing workers to run anywhere via outbound-only gRPC streams without direct database access. The engine also decouples the queue from the repository, unifying the architecture while supporting backends like Postgres, Kafka, Redis, or AMQP.

JupyterGIS 0.16 adds support for GeoZarr, GeoPackage, and openEO layers. Data engineers can visualize remote processing pipelines as lazy, tile-based map layers directly from openEO backends without local materialization, and stream Xarray datasets via jupyter-tiler.

Snowflake announced general availability for using dbt artifacts for Slim CI and defer to production workflows within native dbt Projects. This enables pipeline optimization by testing modified models against production state, alongside expanded file limits for deployed dbt project objects.

Snowflake published updates for Snowflake Data Clean Rooms alongside several data engineering features. Key platform enhancements include general availability for online modification of hybrid table constraints, external lineage tracking, and second generation Openflow runtimes and deployments.

ClickHouse 26.8 LTS introduces background queries that execute independently of client connections, benefiting long-running ingest and export pipelines. The release also adds pipelined SQL, expanded data lake integrations, and query optimizations for Parquet, joins, and GROUP BY operations.

Snowflake updated its platform tooling with the release of CoCo Desktop v1.21.3 alongside broader data engineering features, including online constraint management for hybrid tables and second-generation Openflow runtime deployments.

Snowflake introduced a secure by default approach for scanner package enablement in Trust Center. This release enhances security automation for data engineers and platform administrators managing Snowflake accounts. Related updates include online constraint modifications for hybrid tables.

Snowflake retired Openflow gen 1 deployment creation following the general availability of second generation Openflow deployments and runtimes. Data engineers must migrate orchestration pipelines to the Gen 2 runtime architecture for future deployments.

Snowflake introduced shadow traffic for gateways in preview. Alongside this release, Snowflake added online constraint modifications for hybrid tables and launched second-generation Openflow deployments, expanding data pipeline routing and table administration options.

Snowflake announced general availability for adding and dropping hybrid table constraints online. This update allows data engineers to modify constraints without downtime. The release also includes general availability for second-generation Openflow deployments and external data lineage tracking.

BigQuery generative AI functions now support new Gemini models: gemini-3.5-flash-lite, gemini-3.6-flash, and gemini-3.7-flash. This update expands built-in SQL AI capabilities for analytical workflows.

Snowflake announced the general availability of second generation Openflow deployments and runtimes. This release follows recent data engineering updates, including external lineage tracking and an increased file limit for deployed dbt project objects.

BigQuery conversational analytics now supports predictive modeling questions using the AI.PREDICT function. Currently in Preview, this allows data engineers to integrate BigQuery ML predictions directly through conversational queries.

Kestra 2.0 rebuilds orchestration with separated control and data planes. Workflows register as tools on MCP servers, while a revised Loop task executes iterations as isolated sub-executions to prevent executor memory exhaustion. Teams manage pipeline drafts safely without impacting production runs.

Sail 0.7 introduces blocking shuffle and checkpointing by delegating intermediate job state to object storage. An auxiliary stage merges mapper outputs into compressed Arrow data in storage, isolating task regions to prevent cascading retries and allow execution on smaller clusters.

Snowflake released a preview for SAS to Snowflake migration, targeting pipeline conversions. Recent data engineering updates also include external lineage support, dbt project file limit increases, and Apache Iceberg integrations with Snowflake Horizon Catalog and Amazon S3 Tables.

Snowflake expanded its LLM security architecture by launching prompt injection guardrails across the AWSEU, AWSJP, and AWS_APJ regions. This update allows data engineers to deploy secure Cortex LLM pipelines and agent workflows with localized protection against adversarial prompt attacks.

Snowflake has reached general availability for the Openflow Connector for Jira Cloud: Core flow, expanding its data ingestion pipeline options. This release enables managed data flows from Jira directly into Snowflake alongside new governance tools like external lineage and agent-level data lineage.