Siddhesh PrabhugaonkarforCloud Authoritycloud-authority.com·Nov 3, 2024Azure Synapse Analytics: Partition vs DistributionWhile using Azure Synapse Analytics dedicated SQL pools, sometimes it is confusing the purpose of partitioning and distribution. They are both used to manage data for performance optimization, but serve different purposes. Distribution Distribution r...partition vs distribution
Mehul Kansalmehulkansal.hashnode.dev·Sep 30, 2024Week 18: Azure Synapse Key Concepts 🔑Hey data folks! 👋 This week’s blog explores how to provision and use key features like Serverless SQL Pools, Dedicated SQL Pools, and Apache Spark Pools within an Azure Synapse workspace. We’ll dive into creating external tables, loading data from A...Azure
SAI GOUTHAMgouthamcodes.hashnode.dev·Sep 25, 2024Olympics Data Analytics using Azure Databricks and PowerBISo I have followed the video of Darshil Parmer and have made this project and heres the link for that video click here. This project is divided into 2 parts Part-1 consists of whole data ingestion and transformation. Part-2 concists of the dashboar...30 readsProjectsAzure
Emma C.emmacdata.hashnode.dev·Mar 3, 2024Building an Azure Synapse Studio Data Pipeline for Profit Calcuation AnalysisIn this project, I'll walk through the process of creating a Azure Synapse Studio data pipeline focused on calculating total profits from the classic Superstore dataset, sourced from Tableau. Our goal is to obtain region-wise profit insights, specifi...Azure
KUNAL DASkunaldas.hashnode.dev·Jan 26, 2024Streamlining Synapse CI/CD & Dedicated SQL pool with Azure DevOpsReach at : https://heylink.me/kunaldas Streamlining Synapse CI/CD & Dedicated SQL pool with Azure DevOps: Best Practices and Implementation Tips What is Synapse Analytics? what is the need for CI-CD for synapse analytics? What are the different c...synapse
Akshay Kumar Rakshaykumarr.hashnode.dev·Jan 26, 2024Azure Synapse Analytics: Keyvault AccessPre-requisite: You already have an Azure Keyvault set up, with the secrets defined. Access Secrets in Synapse Notebook Provide GET, List permissions for the new Synapse Workspace/ its UAMI under Access Policies in the Key Vault Create a new lin...azure-synapse-analytics
Akshay Kumar Rakshaykumarr.hashnode.dev·Jan 26, 2024Azure Synapse Analytics: Continuous DeploymentSome steps you need to cover in the Azure Synapse Workspace: In your Synapse notebook, create a new cell and toggle parameter cell, this is for variables that would be picked from pipeline parameters, if needed. Once done, it would look like this C...azure-synapse-analytics
Anshul Mathuranshulmathur.hashnode.dev·Sep 30, 2023Azure Synapse Analytics cost optimizationsimage generated using Bing Image Creator Recently I undertook a task for cost optimization on Azure Synapse Analytics that was incurring a running cost of $200K per month (notice the K at the end). A glance at the resources and you could easily find ...41 readsAzure
Suraj Somanisurajsomani.hashnode.dev·Jun 7, 2023Access Azure Database using Azure Active Directory authenticationTo enable Active Directory users/apps for accessing SQL Database, SQL Managed Instance, or Azure Synapse, we can follow the steps given below to create AD users in the database and give required permissions to tables, views, external tables, etc. In ...Azure
Ahmed Sayedamsayed.hashnode.dev·Apr 5, 2023ETL from SQL Server to Azure Synapse Analytics with Slowly Changing Dimensions (SCD) Type 2 using PythonInstall the required libraries: You’ll need the pyodbc, pandas, and azure-synapse libraries. Install them using pip: pip install pyodbc pandas azure-synapse 2. Connect to SQL Server and extract data: import pyodbc import pandas as pd # Set up your...Data Integrationazure-synapse-analytics
