Data Ecosystem, Repositories, Pipelines and Integration - Part 2Relational Databases Collection of data organized into a table structure where the tables can be linked, or related, based on data common to each. Build on the organizational principles of flat files such as spreadsheets, with data organized into r...Aug 12, 2022 · 4 min readpooj124.hashnode.dev
Data Engineering - Career PathThese questions have been curated based on the interviews of various data Professionals in the industry as stated in the IBM Data engineering specialization. They will be helpful to anyone attending interviews for DE roles, it also gives a glance to ...Aug 12, 2022 · 3 min readpooj124.hashnode.dev
Data Ecosystem, Repositories, Pipelines and Integration - Part 1The ecosystem exists for: Extracting data from disparate sources Architecting and managing data pipelines for transformation, integration, and storage Architecting and managing data repositories Automating and optimizing workflows and flow of data ...Aug 11, 2022 · 5 min readpooj124.hashnode.dev
Data Warehouses, Data Marts, and Data LakesData Warehouses A data warehouse is a central repository of data integrated from multiple sources. It serves as a single source of truth that has data that is cleansed, conformed, and categorized. Data loaded in the warehouse is already modeled and ...Aug 10, 2022 · 3 min readpooj124.hashnode.dev
Points to be considered before choosing a Data RepositoryWhat is the type of data - Structured, Unstructured, semi- Structured? The schema of the data What are its performance requirements Whether you're working with data at rest or streaming data. Data Encryption needs Volume of data and whether you nee...Aug 10, 2022 · 2 min readpooj124.hashnode.dev