How LocalStack Works: Under the HoodIntroduction Imagine building cloud applications without needing to touch the cloud itself. That’s where LocalStack steps in. It’s an open-source tool that emulates AWS services on your local machine, giving you a sandbox for development and testing ...Nov 10, 2024 · 5 min readabeltavares.hashnode.dev
Python Data Validation: Dataclasses vs. PydanticIntroduction After spending some time coding, you come to appreciate the real value of your data being right before you send it off to do important work. This validation can really save you a lot of headaches with bugs and out-of-nowhere errors in pr...Jul 4, 2024 · 5 min readabeltavares.hashnode.dev
pytest: Testing Data JobsIntroduction If you're working with data, you know how important it becomes to keep your pipelines running smoothly. Bugs in your data jobs can lead to incorrect analysis and decisions, and that's just ⚠️. Comes pytest—a super cool tool to help you c...Jun 17, 2024 · 4 min readabeltavares.hashnode.dev
Parallel Transformation Pipelines in PythonIntroduction Functional Programming (FP) is a powerful approach to software development, especially when it comes to data transformation pipelines. Let's dive into the core concepts, practical examples, and tips to help you embrace FP. Functional Pro...Jun 12, 2024 · 10 min readabeltavares.hashnode.dev
From Data Engineer to Full Stack Web DeveloperThe Making of Brainstormer The Leap into Full Stack Development I'm a DevOps Data Engineer by day, and recently, a full stack web developer by night. Embarking on the journey to create Brainstormer was both thrilling and challenging. Imagine diving i...Jun 9, 2024 · 4 min readabeltavares.hashnode.dev