Data Engineering

9 entries

Pipelines, warehouses, lakehouses, orchestration and the platforms data runs on.

Latest

Hitachi Vantara Lets Object Storage Do the Analytics, Up to 5x Faster

VSP One Object now queries Iceberg, Parquet, JSON and CSV in place, with up to 5x faster analytics, 80% fewer CPUs and a new four-node entry configuration for AI teams.

  1. Java4Shell CVE-2026-114938: Databricks Restarts Clusters to Block Exploit Path

    Databricks says it mitigated Java4Shell (CVE-2026-114938) across all supported Runtimes before public disclosure, proactively res…

    Data Engineering

  2. Google Cloud runs BigQuery, Spark and Trino on one Iceberg table

    A hands-on Google Cloud Lakehouse test runs BigQuery, Spark and Trino on one Iceberg table with zero sync jobs. Trino beat Spark…

    Data Engineering

  3. Makro consolidates 10+ data platforms onto two Tencent Cloud services

    Makro moved more than 10 data products onto Tencent Cloud's DLC and WeData, reporting zero discrepancies, a 25% efficiency gain a…

    Data Engineering

  4. Databricks Lifts Cluster Rate Limits 7.5× by Switching to Adaptive Concurrency

    Databricks raised default cluster-creation rate limits 7.5× by replacing fixed request caps with adaptive concurrency limits, cut…

    Data Engineering

  5. Lakebase routes 99.99999% of Postgres reads around object storage

    Lakebase says tiered caches keep more than 99.99999% of Postgres page reads off object storage, with about 1.1 billion local acce…

    Data Engineering

  6. Makro consolidates 10+ data tools onto Tencent Cloud, claims 25% efficiency gain

    Makro and Tencent Cloud report completing Southeast Asia's first data platform consolidation at this scale: 10+ tools onto two pl…

    Data Engineering

  7. Waldo promises weeks-to-days spatial pipeline builds

    Wherobots’ Waldo public preview turns natural-language requests into recurring spatial pipelines, linking existing cloud data wit…

    Data Engineering