From DynamoDB to TimestreamAdvantages of persisting our sensor data in Timestream5 min read·techwood.hashnode.devOct 19, 2022
How to collect and visualize data lineage in an AWS-based data lakeShowcasing the automated collection of data lineage and visualization as Graph in a React Frontend for Spark-based data pipelines.6 min read·techwood.hashnode.devJan 13, 2022
Why metadata is key in data lakesDirecting your data pipelines to a data lake is great - but how can you keep up with the dataset context and their interdependencies?7 min read·techwood.hashnode.devJan 11, 2022