muniao

@qtmuniao

Website

Distributed system, Database, Storage

Joined March 2023

About

A software engineer focus on large-scale data system, including data processing, storage and databases.

Available for

Nothing here yet.

muniao's blogs

muniao's blogqtmuniao.hashnode.dev5 posts

Articles Threads Comments

Recently published

qtmuniao.hashnode.dev

Scaling Big Data Processing in the Cloud: Proven Practices with Spark & Ray

Tags:cloud-data-processing, large-scale-data, spark, ray, cloud-architecture, data-engineering, python-dataprocessing, devops-cloud, kubernetes, distributed-systems Table of Contents Introduction Sharing 2.1 Environment Sharing Across Machines 2...

Nov 19, 20258 min read

qtmuniao.hashnode.dev

3 basic sorting algorithm

Bubble sorting, selection sorting and insertion sorting are the three most basic sorting algorithms. They seem very different at first look, but essentially they share the same principle underneath. The process could be split into two steps: Partiti...

Nov 16, 20231 min read

qtmuniao.hashnode.dev

Large-Scale Data Systems (1): DataSet

To explore large-scale data systems, from storage to processing, from the interface to implementation, I'll be writing a variety of articles. This is the first one -- Dataset. Logically, we treat all the data to be processed as a dataset. Representa...

Sep 28, 20231 min read

qtmuniao.hashnode.dev

Step by step, dissecting the most challenging parts of the database transaction — Isolation

When it comes to database transactions, most people's first reaction is often ACID. However, the importance and complexity of the four attributes are not equivalent. The most challenging aspect to comprehend is Isolation (I). One primary reason for t...

Sep 23, 20237 min read

qtmuniao.hashnode.dev

LevelDB Data Structures Serials I: Skip List

I’ve heard a lot about LevelDB, now I had a chance to skim through the code on a whim, and it deserves its reputation. If you’re interested in Storage Engine, if you want to use C++ gracefully, or if you want to learn how to organize codes, I recomme...

Sep 23, 202312 min read

muniao

About

Available for

muniao's blogs

Recently published

Scaling Big Data Processing in the Cloud: Proven Practices with Spark & Ray

3 basic sorting algorithm

Large-Scale Data Systems (1): DataSet

Step by step, dissecting the most challenging parts of the database transaction — Isolation

LevelDB Data Structures Serials I: Skip List

Search Hashnode

muniao

About

Available for

muniao's blogs

Recently published

Scaling Big Data Processing in the Cloud: Proven Practices with Spark & Ray

3 basic sorting algorithm

Large-Scale Data Systems (1): DataSet

Step by step, dissecting the most challenging parts of the database transaction — Isolation

LevelDB Data Structures Serials I: Skip List