JCJason Chaninjasonfchan.com·Apr 12, 2022 · 5 min readSetup AWS MWAA in 7 Easy StepsIf you have ever used Airflow, you know that it should exist in a cluster environment. Sure you can run it on one machine with a sequential scheduler, but you are not really taking advantage performance of multiple workers handling multiple if not hu...00
JCJason Chaninjasonfchan.com·Dec 9, 2021 · 1 min readAlley-oopDE tosses up the data to DS for the Business Value Alley-oop!00
JCJason Chaninjasonfchan.com·Sep 1, 2021 · 3 min readApache Airflow, Not Just for Data PipelinesIf you come from the world of data engineering or if your company ingests and processes large quantities of data on a regular interval basis, you are probably familiar with the Apache Airflow. But did you know there are more things you can do with A...00
JCJason Chaninjasonfchan.com·Jul 27, 2021 · 4 min readData Versioning Your Processed DataDoes your team or company track the versions of your processed data? If not, maybe one should consider the added value of data versioning. When I use the term "data versioning", what I mean is tracking how your data such as an entity has changed ove...00
JCJason Chaninjasonfchan.com·Jul 1, 2021 · 1 min readBrickit: Computer Vision App that Shows You Lego Ideas.Like many of us "nerds" out there, we probably have a bucket or three of Legos sitting somewhere. Most of my collectable "Adult" Legos get built once based on the set instructions. However, if you're looking to build something new and interesting wit...00