KRKumar Rohitinkrohit-de.hashnode.dev·Apr 15, 2025 · 9 min readDocker based Modern Data PlatformA containerized data platform stack featuring distributed processing, SQL analytics, and data visualization. The project setup is also available on my Github. Happy reading! ✨ Overall Architecture 🌟 Key Features ComponentDescription S3 Bucke...00
KRKumar Rohitinkrohit-de.hashnode.dev·Aug 15, 2024 · 13 min readHello Spark on MinikubeMinikube is a beginner-friendly tool that lets you run a Kubernetes cluster on your local machine, making it easy to start learning and experimenting with Kubernetes without needing a complex setup. It creates a single-node cluster inside a virtual m...00
KRKumar Rohitinkrohit-de.hashnode.dev·Feb 8, 2024 · 9 min readTry MinIO with PySparkIn our previous article, we discussed using Python with boto3 library to perform read-write ops in MinIO buckets. In this final installment of Hello MinIO series, we are going to talk about running Spark jobs in docker and performing reading-writing ...00
KRKumar Rohitinkrohit-de.hashnode.dev·Feb 6, 2024 · 11 min readTry MinIO with PythonThis blog is the continuation of our previous blog from Hello MinIO series where we created docker-compose.yml file and our first MinIO buckets in our localhost using docker. Please refer to the article to refer to docker-compose.yml file which we wi...00
KRKumar Rohitinkrohit-de.hashnode.dev·Feb 6, 2024 · 4 min readHello MinIO 🦩Introduction Did you ever wish about having your own s3 bucket to play with? In data engineering space, having an access to s3 bucket could be very rewarding. You could not only learn a great deal about s3 buckets (protocols & access management), but...00