IIslam Elbanna·May 24, 2025Selecting the Best File Formats for Apache Spark: Parquet, ORC, CSV and moreLearn how to choose the ideal file format for Apache Spark to optimize performance, storage costs, and query speed, including Parquet, ORC, and more4 min read·practical-software.com1H
JJoão Esperancinha·Jan 8, 2025Coroutines, Distributed Cache, Resilience, and Replication in Kotlin — Making a VMA’s applicationWe talk a lot about reactive, but reactive is also meant to make our applications resilient as possible, but what does that mean?27 min read·jesperancinha.hashnode.dev
MMai Đức Nam Anh·Oct 7, 2024Lỗ hổng cho phép tin tặc tấn công thực thi mã từ xa trong Apache Avro SDKĐược đánh giá với mức độ nghiêm trọng High, vừa qua CVE-2024-47561 được phát hiện đang tồn tại trên sản phẩm Apache Avro Java Software Development Kit (SDK), cho phép kẻ tấn công thực thi mã tùy ý trên hệ thống nếu khai thác thành công. Thông tin ch...3 min read·blog.fiscybersec.com
OOmprakash Sridharan·Jun 24, 2023Rust multi module microservices Part 1 - IntroductionHey folks, welcome to a mini-series of articles in which I continue my Rust learning journey, aiming to share knowledge and enjoyment throughout the process. In this series, I will focus on visualizing a multi-crate workspace project that allows for ...3 min read·omprakashsridharan.hashnode.dev
OOmprakash Sridharan·Jun 24, 2023Rust multi module microservices Part 3 - DatabaseLet's start with our first common module which will be fairly basic and provide a good base to start dealing with our database. Open the Cargo.toml inside the database crate(folder) and add the dependencies like the one below. [package] name = "datab...4 min read·omprakashsridharan.hashnode.dev
OOmprakash Sridharan·Jun 24, 2023Rust multi module microservices Part 4 - Kafka with AvroIn this article, we will set up the Kafka crate with a generic producer and consumer capable of producing and consuming data in the Avro format. We will also integrate it with the Confluent Schema Registry to ensure that the messages adhere to a spec...14 min read·omprakashsridharan.hashnode.dev
OOmprakash Sridharan·Jun 24, 2023Rust multi module microservices Part 8 - The conclusionThe entire code that we wrote until now is available for reference here. Let's run our code ! Terminal 1 docker compose up Please wait for the containers to start ( ~20 seconds ) and then run the below commands. Terminal 2 cargo run --bin books_api ...2 min read·omprakashsridharan.hashnode.dev
OOmprakash Sridharan·Jun 24, 2023Rust multi module microservices Part 7 - Books AnalyticsWe are so close to the end and just one more step to configure a service that consumes the created book. Update the Cargo.toml of books_analytics crate to have the below contents. [package] name = "books_analytics" version = "0.0.0" edition = "2021" ...3 min read·omprakashsridharan.hashnode.dev
TTony Kipkemboi·May 30, 2023The 4 Common Data Formats in Data EngineeringDiscover the ins and outs of CSV, JSON, Parquet, and Avro. Explore their strengths, limitations, and practical use cases in data engineering.5 min read·thedataengineerblog.com
LLukasz D·Apr 4, 2023Introduction to Apache AvroI know that I already mentioned Apache Avro, but I believe that some basic explanation is needed. Apache Avro is a data serialization system that allows you to define complex data structures and store them in a compact binary format. It was originall...3 min read·lookinjava.hashnode.dev