I'm a Data Engineer with strong background on Cloud & DevOps technologies.
In my work, I help enterprises in building robust data migration/transformation solutions. We are constantly doing a lot of effort on optimizing data architectures and data pipelines for clients.
I'm also a great blockchain / web development and data science enthousiast :)
Always open to share and connect with people.
Nothing here yet.
Feb 10, 2022 · 3 min read · This project is a simple rabbitMQ messaging queue architecture with one publisher and one subscriber communicating through a queue named "diaf-queue" using Docker. Workflow Everything is automatic in this project. For now, all you have to do is run ...
Join discussion
Feb 10, 2022 · 6 min read · A cheat sheet on spark RDD operations with scala The main abstraction Spark provides is a resilient distributed dataset (RDD), which is a collection of elements partitioned across the nodes of the cluster that can be operated on in parallel. RDDs a...
OOwen commented
Feb 10, 2022 · 3 min read · This project is a simple kafka and spark streaming architecture. A docker-compose file initialize a kafka cluster and a spark cluster with all their dependencies. Producers send text messages to kafka a topic named "test-topic". You can either consum...
OBOwen and 1 more commented