Abhishek JaiswalforAbhishek Jaiswal's team blogdataplumbing.hashnode.dev·Jul 15, 2024Comprehensive Guide to DBT (Data Build Tool)What is dbt? dbt (Data Build Tool) is an open-source command-line tool that helps analysts and engineers transform data in their data warehouse. It allows you to manage your data transformations with SQL in a version-controlled and collaborative envi...Discuss·10 likesdata-engineering
Jesper Baggefullouterjoin.dev·Jul 3, 2024Peek(ing) through windowsSetting the stage When analysing data you'll sooner or later end up with the task to calculate capacity utilization rates based on some raw, murky machine log. Well, at least I have. On multiple occasions. The data usually comes in the form of an eve...Discuss·33 readsdbt
ogunniran sijiogsiji.hashnode.dev·Jul 2, 2024Building and Hosting a DBT Project with GitHub Actions CI/CD for FreeIntroduction In this guide, we'll set up a robust CI/CD pipeline for a dbt (data build tool) project using GitHub Actions. With GitHub Actions, we can automate testing and deployment of our dbt models, ensuring our data transformations are always up-...Discuss·1 like·52 readsdbt
Vipinvipinmp.hashnode.dev·Jun 17, 2024A Comprehensive Guide to Data Transformation with dbt and SnowflakeIntroduction In today's data-driven world, effective data management and transformation are crucial for any organization aiming to harness the full potential of its data. Enter dbt (Data Build Tool), a powerful tool designed to streamline and enhance...Discusssnowflake
Mayra Peñadbtdataqueen.hashnode.dev·May 24, 202410 Best Data Transformation Tools for a Smoother ETL/ELTData teams deciding on data transformation tools need to consider various aspects before deciding on how they will develop and orchestrate data pipelines. They also need to accelerate infrastructure deployment to deliver at the pace the business requ...Discussdbt
Data Senseisihan.hashnode.dev·May 4, 2024DBT for SQL Server? Yes possible.Installing DBT using SQL server is extremely simple. I had many clients coming to me and asking if they could use DBT with SQL Server on-prem or managed instances. They look surprised when I answered them, "Yes, why not". Now you might ask me, what i...Discuss·28 readsdbt
Kliment Merzlyakovklimmy.hashnode.dev·May 2, 2024Enhancing your dbt project with Large Language ModelsTL;DR You can automatically solve typical Natural Language Processing tasks (classification, sentiment analysis, etc.) for your text data using LLM for as cheap as $10 per 1M rows (it depends on the task and the model), staying in your dbt environme...Discuss·224 readstidy-tuesday
Anand KumarforAltimate Team Blogblog.altimate.ai·Apr 14, 2024How I Cut dbt Development Time by 20% with the Power User Vscode ExtensionWorking with data in any capacity—be it as a data/analytics engineer, data scientist, or data analyst—inevitably dealing with the need for documentation. Whether it's clarifying unclear fields, understanding dataset structures, or seeking explanation...Discuss·3 likes·147 readsdbt
Constantin Lungudatawise.dev·Apr 5, 2024A portable Data Analytics stack using Docker, Mage, dbt-core, DuckDB and SupersetJust wanted to share a small learning-by-doing project of mine. It's a containerized Data Analytics suite, covering end-to-end analytics process for a small (imaginary) company. We're talking about:- generating example data in parquet files using Pyt...Discuss·265 readsLearning JourneyDocker
Jesper Baggefullouterjoin.dev·Mar 19, 2024Automagic schema inference killed the data engineerTodays lesson in working with legacy output is: data contracts, data contracts and data contracts. The great thing about shipping structured data as text files is it is so darn easy! Just store it as a CSV and boom: minimum overhead and just the righ...Discuss·42 readsClickHouse
