Scaling Big Data Processing in the Cloud: Proven Practices with Spark & RayHow to build shared, elastic and isolated data pipelines on the cloud using Python, Spark and Ray8 min read·qtmuniao.hashnode.devNov 19, 2025
3 basic sorting algorithmBubble sorting, selection sorting and insertion sorting are the three most basic sorting algorithms. They seem very different at first look, but essentially1 min read·qtmuniao.hashnode.devNov 16, 2023
Large-Scale Data Systems (1): DataSetTo explore large-scale data systems, from storage to processing, from the interface to implementation, I'll be writing a variety of articles. This is the first one -- Dataset. Logically, we treat all the data to be processed as a dataset. Representa...1 min read·qtmuniao.hashnode.devSep 28, 2023
Step by step, dissecting the most challenging parts of the database transaction — IsolationWhen it comes to database transactions, most people's first reaction is often ACID. However, the importance and complexity of the four attributes are not equivalent. The most challenging aspect to comprehend is Isolation (I). One primary reason for t...7 min read·qtmuniao.hashnode.devSep 23, 2023
LevelDB Data Structures Serials I: Skip ListI’ve heard a lot about LevelDB, now I had a chance to skim through the code on a whim, and it deserves its reputation. If you’re interested in Storage Engine, if you want to use C++ gracefully, or if you want to learn how to organize codes, I recomme...12 min read·qtmuniao.hashnode.devSep 23, 2023