Integrating Spring Batch with Parquet
How to integrate Apache Parquet with Spring Batch to create efficient batch processes that generate or consume Parquet files, optimizing storage and interoperability with modern data ecosystems.
Spartan Blog - Jerónimo
Jerolba's blog. Tech, JVM and random stuff.
Latest posts
The Carpet feature that nobody will use
This week I released a new version of Carpet, the Java library for working with Parquet files. In this version, I added a feature that I believe nobody will ever use: the ability to read and write BSON-type columns.
The two versions of Parquet
The adoption of Parquet version 2 is limited due to the lack of support in the ecosystem, which affects its evolution despite its improvements in compression and performance.
Compression algorithms in Parquet
Parquet supports multiple compression algorithms. In the article we analyze and measure GZIP, LZ4, Snappy, ZSTD and LZO.
Working with Parquet files in Java using Parquet Carpet
Parquet Carpet is a Java library that serializes and deserializes Parquet files to Java 17 Records, abstracting you from the details of Parquet and Hadoop, and minimizing the number of dependencies.
Working with Parquet files in Java using Protocol Buffers
Explanation and sample code for how to serialize and deserialize Parquet files in Java using Protocol Buffers
Working with Parquet files in Java using Avro
Explanation and sample code for how to serialize and deserialize Parquet files in Java using Avro
Working with Parquet files in Java
Parquet is a widely used format in the Data Engineering realm and holds significant potential for traditional Backend applications. This article serves as an introduction to the format, including some of the unique challenges I've faced while using it, to spare you from similar experiences.
Java Serialization with Apache Avro
How much does it cost to serialize and deserialize lots of data in Java using different tools? In the third post, I'm going to analyze Apche Avro.
Java Serialization with Flatbuffers
How much does it cost to serialize and deserialize lots of data in Java using different tools? In the second post, I'm going to analyze Flatbuffers.