Sudha Yadavsudhayadav.hashnode.dev·Jul 10, 2024AWS GlueIn the world of data ETL (Extract, Transform, Load) is a fundamental process that involves extracting data from various sources, transforming it into a suitable format and loading it into a data warehouse or other storage systems. AWS Glue is a fully...Discuss·2 likesAWS
Andrea CallarelliforDataChef's Blogblog.datachef.co·May 15, 2024Our learnings on AWS Glue Jobs BillingOn the surface, the billing of AWS Glue Spark Jobs seems quite straightforward.O.44$ per DPU (Data Processing Unit) per Hour. The amount of DPUs is defined by the selected Job type and amount of workers. Clear, right? It seemed so, but after running ...Discuss·131 readsAWS Glue
Farbod AhmadianforDataChef's Blogblog.datachef.co·May 3, 2024Glue configuration for optimal logging and cost efficiencyIntroduction In today's cloud-centric computing environment, managing costs while ensuring optimal performance can be quite the balancing act, especially when dealing with large-scale data processing tasks. AWS Glue is frequently employed to prepare ...Discuss·10 likes·76 readsAWS Glue
Prabodh AgarwalforCMD-LYNEtoplyne.hashnode.dev·Apr 3, 2024Skiing with SnowflakeIn this article, I will demonstrate how to formulate a lakehouse strategy that pairs well with Snowflake. A few months ago, I began exploring opportunities to develop ETL pipelines in Ray. I had to perform my PoC on SnowflakeDB. Unfortunately, Ray C...Discuss#apache-spark
Divya MahajanforPartner Penspartnerpens.hashnode.dev·Mar 24, 2024AWS Database LayerLink to exam: https://aws.amazon.com/certification/certified-cloud-practitioner/ Introduction Databases Overview Databases provide structured storage with indexing and relationships. Relational Databases: OLTP: RDS & Aurora (SQL) NoSQL Databases:...DiscussAWS Certified Cloud Practitioner | CLF-C02 preparation KitDynamoDB Accelerator
Sumit Mondalsumit007.hashnode.dev·Feb 9, 2024A Beginner's Guide to Using AWS Glue DataBrew: Simplifying Data PreparationIntroduction: Data preparation is a crucial step in any data-driven project, and AWS Glue DataBrew is a powerful tool designed to make this process easier and more accessible. In this blog post, we will explore the basics of AWS Glue DataBrew and how...DiscussAWS - HandsOn#AWSDataBrewGuide
Sumit Mondalsumit007.hashnode.dev·Feb 9, 2024A Beginner's Guide to Using AWS Glue: Simplifying Data ETL in AWSIntroduction: AWS Glue is a powerful service offered by Amazon Web Services (AWS) that simplifies the process of Extract, Transform, and Load (ETL) for your data. Whether you're a data engineer, analyst, or just getting started with AWS, this blog wi...DiscussAWS - HandsOn#DataInsights
Nirav Raychuracloudjourney.in·Feb 3, 2024🚀 Exciting Day 10 of My AWS DevOps Professional Journey! 🚀Greetings, fellow learners! Today marks another significant milestone in my AWS DevOps certification journey, and I'm eager to share the knowledge gained on Day 10 through Stéphane Maarek's Udemy course. 💡 Course Progress - Day 10: Unraveling AWS Co...DiscussAWS DevOps Engineer Professional Certification Journeyaws scp
ADITYA PAWARaditya-pawar.hashnode.dev·Jan 3, 2024Transforming Data Landscapes: A Deep Dive into AWS Glue ETLWhat is ETL? ETL stands for Extract, Transform, Load, and it refers to a process in data integration where data is extracted from source systems, transformed into a desired format, and then loaded into a target system, typically a data warehouse or a...Discuss·10 likesAWS
Chandrasekar(Chan) Rajaramcr88.hashnode.dev·Dec 18, 2023Streamlining Data Integration: Loading Netflix Dataset of movies and shows into a Snowflake table using AWS Glue Studio , s3 and AWS Secrets ManagerIntroduction In the world of data warehousing and analytics, efficiently managing and integrating data is paramount. My recent experience with Snowflake and AWS Glue Studio stands as a testament to this, where I successfully loaded data from s3 using...Discuss·1 like·59 readsAWS
