Feed
Pro
Search

Sign in
Darkshift - a dark factory for software Bug0 - The AI-native e2e QA regression testing The foreword by Hashnode - official blog from the Hashnode team Passmark - The open-source AI framework for regression testing Hashnode gql skill - let your AI agent publish to your Hashnode blog Hackathons Changelog Brand @hashnode on X Hashnode on LinkedIn Support - hello+support@hashnode.com Code of Conduct Terms Privacy Sitemap

Search Hashnode

Search posts, tags, users, and pages

@MartijnSturm

Martijn Sturm

@MartijnSturm·Utrecht, The Netherlands·Joined December 2022

Cloud Consultant (AWS), Data Engineer, Data Scientist, Software Developer

About

I am a software and data engineer focusing serverless data-intensive applications that are hosted on AWS.

Available for

Nothing here yet.

Martijn Sturm's blogs

Martijn Sturm's blogmartijn-sturm.hashnode.dev6 posts

About

I am a software and data engineer focusing serverless data-intensive applications that are hosted on AWS.

Available for

Nothing here yet.

Martijn Sturm's blogs

Martijn Sturm's blogmartijn-sturm.hashnode.dev6 posts

Articles Comments

Recently published

MSMartijn Sturminmartijn-sturm.hashnode.dev·Dec 15, 2023 · 7 min read

Integration Testing on AWS with CDK

TL;DR: Implement integration testing on AWS by copying my CDK setup and ParameterClient implementation, available in this demo repository on GitHub. "In this blog post, integration tests are defined as those verifying the correct interaction of vario...

MSMartijn Sturminmartijn-sturm.hashnode.dev·Dec 10, 2023 · 7 min read

Efficiently Obtaining Large Amounts of Data from External APIs with Python

For some analytics or machine learning use cases, you could be dependent on data from external systems. Sometimes, these external systems offer a REST API to query those data. These APIs are usually not designed for large data transfers, which poses ...

MSMartijn Sturminmartijn-sturm.hashnode.dev·Apr 23, 2023 · 4 min read

Data Engineering on AWS: Best Practices Overview

This blog post contains a listing of best-practices for data engineering on AWS. I will try to update this post regularly with new insights and best practices. Please note that this is not an exhaustive list. Am I missing an important one? Please let...

MSMartijn Sturminmartijn-sturm.hashnode.dev·Apr 23, 2023 · 4 min read

Use your own Python packages in Glue jobs

Many data engineering use cases require you to repeat some ETL logic on different (database) tables or event streams. It is advised to separate the ETL workflows for those tables in separate Glue jobs for multiple reasons: Keeping your ETL runs per ...

MSMartijn Sturminmartijn-sturm.hashnode.dev·Apr 23, 2023 · 4 min read

Defining AWS glue jobs as Infrastructure-as-Code

Using Infrastructure-as-Code (IaC) for deployment of resources to the cloud is a no-brainer nowadays. The learning-curve at the start is a bit steeper than applying click-ops, but will pay off in te long-term. In this post I try to assist in getting ...