How to Convert XML to PARQUET?
To Convert XML to PARQUET format can be achieved either through automated enterprise tools or customized ETL scripts: Automated Enterprise Software:…
Testing & QA
⚑ Сообщить о проблемеПоследние новости Testing & QA от Tech News
Все темы
agents
ai
api
architecture
automation
backend
beginners
career
claude
cybersecurity
devchallenge
devops
discuss
javascript
llm
machinelearning
mcp
node
opensource
performance
productivity
programming
python
security
showdev
softwareengineering
testing
tutorial
typescript
webdev
Stream 50 million rows without OOM: Lazy chunked Query Streaming.
Stream 50 million rows without OOM: Lazy chunked Query Streaming. Day 09 of the WClickHouse Open-Source Engineering Series. You don't need 64GB of R…
From Pandas DataFrame to ClickHouse in milliseconds without SQL loops.
Day 05 of the WClickHouse Open-Source Engineering Series. Never use df.iterrows() to insert data into an analytical database. WClickHouse insert_dat…
Zero-copy columnar transfer: Apache Arrow meets ClickHouse in Python.
Day 04 of the WClickHouse Open-Source Engineering Series. Row serialization is the biggest bottleneck in Python analytics. WClickHouse insert_arrow(…
Never create 1-row ClickHouse parts again: The built-in Buffer Manager.
Day 03 of the WClickHouse Open-Source Engineering Series. You don't need a Redis cluster just to protect ClickHouse from single-event streaming writ…
Modern Data Lakehouses: How Apache Iceberg Solved the Pitfalls of Hive Metastore
Introduction When a data platform grows from a few gigabytes to terabytes or petabytes, storing the data is only one part of the problem. A typical…
PyArrow, Explained: How Zero-Copy Actually Works, and Why It's Everywhere
Every time data moves between two tools in a modern Python data stack — a DuckDB query result becoming a pandas DataFrame, a Polars frame getting ha…
[EN] Data Driven/Big Data Series #1: Apache Kafka and Elastic Stack Roles
This is the first in a series exploring the roles of Search and Streaming technologies within the Data Driven (Big Data) environment. In this post,…
Apache Data Lakehouse Weekly: August 5 - August 12, 2026
This Week at a Glance The Iceberg community opened a formal scoping discussion for the v4 table spec, with Daniel Weeks laying out three workstream…
От ANN к честному KNN на GPU: как мы пересобрали отбор кандидатов в рекомендациях Ozon
Привет! Мы команда рекомендательной системы Ozon, и сегодня мы хотим рассказать о нашем пути от приближённого поиска соседей (ANN) к точному KNN на…
TPC-DS в 07.2026. Lakehouse: Spark, Trino, StarRocks, Impala и Doris. GreenPlum & Cloudberry vs StarRocks как MPP
Привет, Хабр! На связи команда Data Sapience. С последней публикации результатов тестирования MPP-движков прошло уже несколько месяцев. За этот пери…
The Future of Query Optimization: AI-Driven Insights in Big Data
Query optimization has never been a solved problem. The moment you think your database is running efficiently, data volumes triple, access patterns…
The Next Decade of Data Engineering: From Modern Data Stack to Data Engineering Harness
Over the past decade, the core evolution of data engineering has been the deconstruction and reconstruction of traditional data warehouse architectu…
Нагрузочное тестирование динамического маскирования в Apache Ranger: что происходит с производительностью запросов
Привет, Хабр! На связи Илья Амосов из команды поддержки Lakehouse-платформы данных Data Ocean Nova вендора Data Sapience. В сегодняшней публикации я…