@MartijnSturm

Martijn Sturm

@MartijnSturmUtrecht, The NetherlandsJoined December 2022

Cloud Consultant (AWS), Data Engineer, Data Scientist, Software Developer

Website

About

I am a software and data engineer focusing serverless data-intensive applications that are hosted on AWS.

Available for

Nothing here yet.

Martijn Sturm's blogs

Martijn Sturm's blogmartijn-sturm.hashnode.dev6 posts

Integration Testing on AWS with CDK

TL;DR: Implement integration testing on AWS by copying my CDK setup and ParameterClient implementation, available in this demo repository on GitHub. "In this blog post, integration tests are defined as those verifying the correct interaction of vario...

Dec 15, 2023 · 7 min readmartijn-sturm.hashnode.dev

Efficiently Obtaining Large Amounts of Data from External APIs with Python

For some analytics or machine learning use cases, you could be dependent on data from external systems. Sometimes, these external systems offer a REST API to query those data. These APIs are usually not designed for large data transfers, which poses ...

Dec 10, 2023 · 7 min readmartijn-sturm.hashnode.dev

Data Engineering on AWS: Best Practices Overview

This blog post contains a listing of best-practices for data engineering on AWS. I will try to update this post regularly with new insights and best practices. Please note that this is not an exhaustive list. Am I missing an important one? Please let...

Apr 23, 2023 · 4 min readmartijn-sturm.hashnode.dev

Use your own Python packages in Glue jobs

Many data engineering use cases require you to repeat some ETL logic on different (database) tables or event streams. It is advised to separate the ETL workflows for those tables in separate Glue jobs for multiple reasons: Keeping your ETL runs per ...

Apr 23, 2023 · 4 min readmartijn-sturm.hashnode.dev

Defining AWS glue jobs as Infrastructure-as-Code

Using Infrastructure-as-Code (IaC) for deployment of resources to the cloud is a no-brainer nowadays. The learning-curve at the start is a bit steeper than applying click-ops, but will pay off in te long-term. In this post I try to assist in getting ...

Apr 23, 2023 · 4 min readmartijn-sturm.hashnode.dev

Martijn Sturm

About

Available for

Martijn Sturm's blogs

Integration Testing on AWS with CDK

Efficiently Obtaining Large Amounts of Data from External APIs with Python

Data Engineering on AWS: Best Practices Overview

Use your own Python packages in Glue jobs

Defining AWS glue jobs as Infrastructure-as-Code

Search Hashnode

Martijn Sturm

About

Available for

Martijn Sturm's blogs

Integration Testing on AWS with CDK

Efficiently Obtaining Large Amounts of Data from External APIs with Python

Data Engineering on AWS: Best Practices Overview

Use your own Python packages in Glue jobs

Defining AWS glue jobs as Infrastructure-as-Code