Setup AWS MWAA in 7 Easy StepsIf you have ever used Airflow, you know that it should exist in a cluster environment. Sure you can run it on one machine with a sequential scheduler, but you are not really taking advantage performance of multiple workers handling multiple if not hu...Apr 12, 2022 · 5 min readjasonfchan.com
Alley-oopDE tosses up the data to DS for the Business Value Alley-oop!Dec 9, 2021 · 1 min readjasonfchan.com
Apache Airflow, Not Just for Data PipelinesIf you come from the world of data engineering or if your company ingests and processes large quantities of data on a regular interval basis, you are probably familiar with the Apache Airflow. But did you know there are more things you can do with A...Sep 1, 2021 · 3 min readjasonfchan.com
Data Versioning Your Processed DataDoes your team or company track the versions of your processed data? If not, maybe one should consider the added value of data versioning. When I use the term "data versioning", what I mean is tracking how your data such as an entity has changed ove...Jul 27, 2021 · 4 min readjasonfchan.com
Brickit: Computer Vision App that Shows You Lego Ideas.Like many of us "nerds" out there, we probably have a bucket or three of Legos sitting somewhere. Most of my collectable "Adult" Legos get built once based on the set instructions. However, if you're looking to build something new and interesting wit...Jul 1, 2021 · 1 min readjasonfchan.com