Tag feed

#avro

15 posts0 followers

Explore Hashnode

Alternatives

Trending tags this week

Ssouradeep2205platform-engg-log.hashnode.devJun 7 · 5 min read

Why is Avro considered a first-class citizen for Kafka?

Have you ever wondered, why Apache Avro is the preferred serialization format for kafka, even though JSON being the most popular format used everywhere? I was recently going through the AVRO internals

0

DGDevTools Guidedevtoolsguide.hashnode.devMar 3 · 8 min read

Data Serialization Formats: JSON vs MessagePack vs Protocol Buffers vs Avro vs Parquet

Data Serialization Formats: JSON vs MessagePack vs Protocol Buffers vs Avro vs Parquet Every application serializes data. APIs encode responses, services pass messages, databases store records, and pipelines transform datasets. JSON is the default ch...

0

HKHamed Karbasihamedkarbasi.comFeb 15 · 8 min read

Visualizing Avro Kafka Data in Grafana: Streaming Real-Time Schemas

Hey everyone, if you've been following along from my last post on streaming JSON into Grafana with the Kafka Datasource plugin, you know how awesome it is to watch real-time data light up your dashboards. Today, we're leveling up to Avro; that compac...

0

SRSriram Rsriramr.hashnode.devJan 13 · 12 min read

Deep Dive into Avro Integer Encoding

Introduction In the world of data serialization and network protocols, efficiently encoding integers is crucial for minimizing storage space and transmission bandwidth. Variable-length integer encoding (often called varint ) is a technique that uses ...

0

SRSriram Rsriramr.hashnode.devJan 12 · 6 min read

Apache Avro vs. JSON: An Intro into Data Serialization

Apache Avro is a data serialization system that balances performance with flexibility. To understand why Avro is useful, we must first look at the inefficiencies of standard text-based formats like JSON. The Problem: Why JSON Wastes Space JSON is sel...

0

FRFelipe Rodriguesblog.felipefr.devDec 23, 2025 · 13 min read

Message Serialization: Avro vs Protobuf vs JSON

The selection of a message serialization format is rarely a neutral technical decision. It is a fundamental architectural choice that dictates the long-term scalability, maintainability, and operational cost of a distributed system. In the early days...

0

VPViet Phanblog-vi.dogy.ioDec 7, 2025 · 18 min read

Protobuf, Thrift, Avro là gì?

Phần 1: Vấn đề của định dạng dữ liệu truyền thống Trong quá trình phát triển phần mềm, cách dữ liệu được lưu trữ xuống file hoặc được truyền sang service khác dưới định dạng gì là vô cùng quan trọng. Thông thường, đối với những dữ liệu trên file, ta ...

0

FRFelipe Rodriguesblog.felipefr.devAug 8, 2025 · 10 min read

Integrando AWS Glue com Apache Kafka: Pipeline de Inventário em Tempo Real com Spark e Avro

Neste artigo, vou compartilhar uma implementação real de integração entre AWS Glue e Apache Kafka para processamento de dados de inventário empresarial. Esta solução aborda desde a extração de movimentações de estoque de um PostgreSQL (RDS) até a pub...

1

A

VSVaishnave Subbramanianvaishnave.pageApr 4, 2024 · 18 min read

Sparks Fly

File Formats In the realm of data storage and processing, file formats play a pivotal role in defining how information is organized, stored, and accessed. These formats, ranging from simple text files to complex structured formats, serve as the blue...

1

S

ADAkash Desardaimportidea.devDec 19, 2022 · 2 min read

Working with Avro file format in Python the right way

Here are some quick helpful tips for using Avro file format correctly in python. Note: I am asumming you familair with Apache Avro file format, its advantages, its shortcomings, etc. Tip no 1: Use the correct package Instead of using the official p...

0

#avro

Search Hashnode

#avro

Explore Hashnode

Trending tags this week

Why is Avro considered a first-class citizen for Kafka?

Data Serialization Formats: JSON vs MessagePack vs Protocol Buffers vs Avro vs Parquet

Visualizing Avro Kafka Data in Grafana: Streaming Real-Time Schemas

Deep Dive into Avro Integer Encoding

Apache Avro vs. JSON: An Intro into Data Serialization

Message Serialization: Avro vs Protobuf vs JSON

Protobuf, Thrift, Avro là gì?

Integrando AWS Glue com Apache Kafka: Pipeline de Inventário em Tempo Real com Spark e Avro

Sparks Fly

Working with Avro file format in Python the right way