@danielotuo
Cloud Engineer / Data Engineering / Data Architecture
Molecular biologist turned Cloud / Data engineer. I love using technology and also share that spirit of using technology to solve complex problems.
Interests are Data, AI, ML, Platforms, Cloud, Solutions
I am available to network and also discuss interesting topics.
Mar 1, 2024 路 3 min read 路 In this phase, we will focus on sending data from Kinesis to storage (S3 and DynamoDB) and querying transaction data in DynamoDB using an API. Stream to s3 raw storage Configure IAM for S3 Create lambda function to insert data into S3 Test the pi...
Join discussion
Feb 17, 2024 路 3 min read 路 In today's Data Engineering exploration, lets dive into creating data pipelines on AWS. Our focus will be on the ingestion to buffer (Kinesis) phase. The data used for this project is from UCI machine learning repository. Overview Key Steps Lambda ...
Join discussionFeb 14, 2024 路 1 min read 路 Embarking on a data-driven journey doesn't always mean crunching numbers or plumbing pipelines. No flashy visuals or complex coding鈥攋ust a straightforward dive into the intersection of Pandas and APIs. The Setup We'll leverage the Open Notify API to ...
Join discussion
Jan 29, 2024 路 1 min read 路 Exception handling ensures programs handle unexpected situations gracefully. It is essential to ensure the integrity and reliability of the data processing pipelines. The basic structure of exception handling in python looks like: try: # Code tha...
Join discussion
Dec 22, 2022 路 3 min read 路 Are you tired of dealing with slow and unreliable systems in high transaction environments? If so, you're not alone. Many businesses and organizations struggle to keep up with the demands of high transaction environments, which require fast and effic...
Join discussion