String Similarity Algorithms and Record LinkageI've been diving into data cleaning, and exploring the connection between clean textual data in DataFrames and the effective use of string-based algorithms for this task. There are many string similarity algorithms in existence today, such as Hamming...Dec 28, 2023 路 5 min readritaokonkwo.hashnode.dev
Dimensional Modelling: Facts & DimensionsLately, I've been diving deep into topics like Data Warehouses, Data Lakes, Data Modeling, Wide Tables, and the list goes on and on. I've been curious about the history of dimensional modeling and why it still finds relevance in certain contexts. Whi...Oct 30, 2023 路 3 min readritaokonkwo.hashnode.dev
Streamline Your Jupyter Notebooks: Simplify and Organise with the %run Magic CommandIn a previous article, I wrote about using the timeit magic command to measure the time efficiency of different operations. In this article, I will write about the run magic command and explain how it has helped me to organise my notebooks. While w...Oct 8, 2023 路 2 min readritaokonkwo.hashnode.dev
DataVerse Organisation: Where Lakes and Warehouses Team Up鈥擝ecause Even Data Needs a Buddy System!馃挕 To get the most out of this article, you should have a basic understanding of OLTP (Online Transaction Processing) and OLAP (Online Analytical Processing) systems. While conducting a data engineering task, I loaded data from a columnar database,...Sep 27, 2023 路 3 min readritaokonkwo.hashnode.dev
Mastering Efficient Iteration Techniques for Pandas DataFrames馃挕 To fully benefit from this article, it's important to have a basic understanding of Python, Numpy arrays, and Pandas DataFrames. Recently, I undertook a data manipulation task that involved using DataFrames for Data Engineering purposes. Whether...Sep 17, 2023 路 4 min readritaokonkwo.hashnode.dev