Open Source — Tech News

Все темы AI agents ai api architecture automation backend beginners career database devchallenge devops discuss javascript linux llm machinelearning mcp opensource performance productivity programming python react security showdev testing tutorial typescript webdev

EN

All About Iceberg's File Format API: simplifying the engine/format interface and Parquet's multimodal future

What is the file format API? Apache Iceberg traditionally exposed its data files through three libraries, one each for Parquet, Avro and ORC, and un…

iceberg parquet multimodal lakehouse

EN

How AI can investigate a 12 GB export without reading it into a prompt

Imagine asking an AI assistant for the average order value in a 12 GB sales export. It finds an amount column and suggests AVG(line_amount) . The qu…

dataengineering sql ai parquet

EN

When does Iceberg beat Parquet+projection on AWS Glue, and when doesn't ?

Why this project I built this repo because I didn't have one of this kind yet and, having worked on data ingestion with Glue for a while, I wanted t…

aws glue iceberg parquet