Hi there, I'm Samyak Jain , a seasoned data & analytics professional with problem solving mindset, passionate to solve challenging real world problems using data and technology.
Nothing here yet.
Oct 11, 2023 · 4 min read · Hadoop is an open-source software framework used for storing and processing Big Data in a distributed manner on large clusters of commodity hardware. Hadoop is licensed under the Apache v2 license. Hadoop was developed, based on the paper written by...
Join discussionJan 7, 2022 · 2 min read · What is Apache Airflow? Apache Airflow is an open-source project that was created in 2014 in Airbnb by Maxime Beauchemin, and published in June 2015. Apache Airflow is an open-source platform designed to programmatically author, schedule, and monitor...
Join discussionJun 4, 2021 · 3 min read · It started with an interesting thought of making the whole internet searchable. Mike Cafarella and Doug Cutting who started working on development of an open source web search engine. A search engine that can index billions of pages, back then projec...
Join discussionJan 25, 2021 · 3 min read · Apache Airflow provides a variety of built-in operators that you can use to create tasks within your Directed Acyclic Graphs (DAGs). Commonly Used Operators - DummyOperator - It doesn't execute any task, but it can be useful to mark certain points ...
Join discussionJan 22, 2021 · 2 min read · These steps are for linux/ubuntu distribution - Step 1: Install Python and Pip Ensure that Python and Pip are installed on your system. sudo apt-get update sudo apt-get install python3 python3-pip Step 2: Set Up the Airflow Home Directory Set the AI...
Join discussion