dataaaaa!

Snowflake released a preview of remote app operations for Snowflake Native Apps. Additional updates include remote development in VS Code, stable egress IP addresses on Azure, and Apache Iceberg catalog integrations to enhance data engineering workflows across platforms.

Snowflake announced preview support for second-generation Openflow alongside key data engineering updates, including CREATE OR ALTER support for dynamic Apache Iceberg tables and the Openflow Connector for SQL Server CDC ingestion.

BigQuery now allows data engineers to create, store, and manage pipelines directly in Git folders, currently available in Preview. Additionally, organizing and managing pipelines using code asset folders has reached General Availability.

Apache Spark 4.1.0 introduces Spark Declarative Pipelines to manage execution graphs, dependencies, and retries. Structured Streaming adds Real-Time Mode for sub-second latency. PySpark adds Arrow-native UDFs, SQL Scripting is GA by default, and VARIANT type GA brings Parquet shredding support.

Apache DataFusion 55.0.0 delivers runtime row-group pruning, range partitioning, and MERGE INTO planner support. It optimizes multi-column GROUP BY memory and speed with complete type coverage, merges physical optimizer passes, and adds bitmap-filtered IN lists for small integer types.

Orchestra added integrations for MongoDB, Dremio, MySQL, and AWS Step Functions. Power BI now supports partition-specific dataset refreshes, while anomaly detection identifies runs finishing faster than baseline. New Databricks Cost Agents help mitigate spend. Glue jobs can now fetch logs.

Snowflake announced preview support for stable egress IP addresses on Azure, simplifying network security rules for external integrations. Other recent data platform updates include dynamic Apache Iceberg tables with CREATE OR ALTER support and S3 Tables REST catalog integration.

Snowflake announced the general availability of CoCo in its Visual Studio Code extension alongside an increased file limit for deployed dbt project objects. Related updates introduce remote development support in VS Code and new automated agent features for pipeline workflows.

Google BigQuery has updated its Data Engineering Agent to be HIPAA compliant, allowing data engineers to build and manage automated pipelines handling sensitive healthcare data within standard regulatory requirements.

Snowflake increased the file limit for deployed dbt project objects, expanding capacity for large data transformation pipelines. Recent platform updates also added CREATE OR ALTER support for dynamic Iceberg tables and adaptive refresh modes.

Snowflake released feature updates for Data Clean Rooms alongside improvements to the data platform. Recent additions include Cortex agent capabilities, multi-value tags, and enhanced data freshness for ORGANIZATION_USAGE views.

Snowflake released general availability for Organization user types, Cortex Agents Coding Agent, and Cortex Extension references in agent skills. Other updates include improved data freshness for ORGANIZATION_USAGE views, multi-value tags, and Iceberg catalog integrations.

Snowflake announced the general availability of Cortex Agents Coding Agent, expanding automated development workflows. Recent platform updates also add Apache Iceberg catalog integrations, custom incremental dynamic tables, and CDC connectors to optimize data engineering pipelines.

Snowflake announced the general availability of Cortex Extension references in agent skills. This release expands agentic data engineering workflows alongside GA support for Cortex Agents Coding Agent and relative paths for Cortex Agent skills in Native Apps.

Snowflake released preview support for Remote Development with the Snowflake Extension for Visual Studio Code. Recent updates also introduced multi-value tags in general availability, improved data freshness for ORGANIZATION_USAGE views, and Snowflake CLI v3.25.0 to streamline data pipelines.

An improper input validation flaw in older BigQuery Data Transfer Service JDBC drivers let attackers run remote code and escalate privileges via crafted connection strings.

BigQuery now supports data governance tags in Terraform in Preview, enabling data engineers to automate governance policies via infrastructure as code.

Snowflake announced the general availability of multi-value tags for enhanced metadata management and governance. Recent updates also introduced custom incremental dynamic tables and Apache Iceberg REST catalog integration with Amazon S3 Tables.

Snowflake introduced Request Access in Workspaces in preview, alongside Amazon S3 Tables Iceberg REST catalog integration. Recent data engineering updates also include CREATE OR ALTER support for dynamic Iceberg tables and new usage monitoring views.

Snowflake released CoCo Desktop v1.21.1 alongside improved data freshness for ORGANIZATION_USAGE premium views. Recent updates also added Apache Iceberg table management via Snowflake Horizon Catalog and custom incremental dynamic tables.

Snowflake announced improved data freshness for ORGANIZATIONUSAGE premium views. Recent updates also include support for external Apache Iceberg tables in Snowflake Horizon Catalog and the addition of the SNOWFLAKECOCOUSAGEHISTORY view.

Snowflake previewed Organization Features and third-party access configuration in Organization Command Center. Recent data engineering updates also include GA for data movement policies and preview support for accessing externally managed Apache Iceberg tables via Horizon Catalog.

Snowflake announced the general availability of version targeting for Cortex Agent evaluations. This release expands data engineering and agent observability workflows alongside recent updates like Apache Iceberg REST catalog integrations and dynamic table enhancements.

BigQuery now integrates with Google Cloud Observability in Preview to monitor data agents. Data engineers can track agent performance, adoption metrics, latency, and operational costs across conversations.

Snowflake released CoCo automations in CLI and Snowsight in preview. Recent platform updates also include CREATE OR ALTER support for dynamic Apache Iceberg tables, custom incremental dynamic tables, and new usage telemetry views for tracking account-level AI operations and compute history.