@giangblackk

Giang Ngo

@giangblackkJoined June 2022

Compiler, Database, Distributed System, Accelerated Hardware Computing

About

Nothing here yet.

Available for

Nothing here yet.

Giang Ngo's blogs

Tiny Bitesgiangblackk.hashnode.dev3 posts

Spark Connect - Streamline Apache Spark Data Pipeline Development in Dagster

Introduction In many years, the conventional way to develop data pipelines in Dagster with Apache Spark is submitting applications, which pose unique challenges to developers: Require a separate infrastructure (cluster of machines with a cluster man...

Jun 29, 2024 · 3 min readgiangblackk.hashnode.dev

Dangling pointers problem in C vs Rust

I encounter this original blog about Stack Memory and Dangling Pointer problem in Zig language, then I asked myself, how about other system programming languages, like C language and Rust, do they have the same problem? This blog is a very short arti...

Feb 25, 2024 · 5 min readgiangblackk.hashnode.dev

Consecutive grouping in Apache Spark

Introduction Assume that you have collected your daily data of active workout minutes from your smart watches/health monitoring devices, and you want to find the longest streak of consecutive days that you work out more than 30 minutes, so you can wi...

Nov 1, 2023 · 5 min readgiangblackk.hashnode.dev

Giang Ngo

About

Available for

Giang Ngo's blogs

Spark Connect - Streamline Apache Spark Data Pipeline Development in Dagster

Dangling pointers problem in C vs Rust

Consecutive grouping in Apache Spark

Search Hashnode

Giang Ngo

About

Available for

Giang Ngo's blogs

Spark Connect - Streamline Apache Spark Data Pipeline Development in Dagster

Dangling pointers problem in C vs Rust

Consecutive grouping in Apache Spark