DCDamon Cortesiindacort.hashnode.dev·Sep 29, 2021 · 3 min readSSH to EC2 Instances with Session ManagerI’m kind of an old-school sys admin (aka, managed NT4 in the 90’s) so I’m really used to SSH’ing into hosts. More often than not, however, I’m working with AWS EC2 instances in a private subnet. If you’re not familiar with it AWS Systems Manager Sess...00
DCDamon Cortesiindacort.hashnode.dev·Sep 23, 2021 · 3 min readUpdating Partition Values With Apache HudiIf you're not familiar with Apache Hudi, it's a pretty awesome piece of software that brings transactions and record-level updates/deletes to data lakes. More specifically, if you're doing Analytics with S3, Hudi provides a way for you to consistentl...00
DCDamon Cortesiindacort.hashnode.dev·Jul 14, 2021 · 4 min readContinuous Deployment of Jupyter NotebooksThis is a guide on how to use AWS CodePipeline to continuously deploy Jupyter notebooks to an S3-backed static website. Overview Since I started using EMR Studio, I've been making more use of Jupyter notebooks as scratch pads and often want to be abl...00
DCDamon Cortesiindacort.hashnode.dev·Jul 9, 2021 · 11 min readBuild your own Air Quality Map with OpenAQ and EMR on EKSFire season is closely approaching and as somebody that spent two weeks last year hunkered down inside with my browser glued to various air quality sites, I wanted to show how to use data from OpenAQ to build your own air quality analysis. With Amaz...00