---
title: "#data-engineering articles | Hashnode"
description: "Explore 2,052 articles tagged #data-engineering on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/data-engineering"
---

Tag

# #data-engineering

2,052 posts · 527 followers

[Yenosh V](https://hashnode.com/@yenoshv) · [2h ago](https://hashnode.com/posts/from-data-to-decisions-how-ai-consulting-is-reshaping-commercial-analytics/6afd56a3d9bb31969f4c1f83)

### [From Data to Decisions: How AI Consulting Is Reshaping Commercial Analytics](https://yenosh.hashnode.dev/from-data-to-decisions-how-ai-consulting-is-reshaping-commercial-analytics?utm_source=hashnode&utm_medium=feed)

Commercial analytics is entering a new phase. Businesses are no longer satisfied with dashboards that explain what happened yesterday. They want intelligent systems that anticipate market changes, ide

11 min read · [yenosh.hashnode.dev](https://yenosh.hashnode.dev/from-data-to-decisions-how-ai-consulting-is-reshaping-commercial-analytics?utm_source=hashnode&utm_medium=feed)

[Shifter](https://hashnode.com/@shifter) · [10h ago](https://hashnode.com/posts/a-200-is-not-a-success-how-to-tell-whether-a-proxy-request-worked/6afcdc02c9999eb625a18c0d)

### [A 200 Is Not a Success: How to Tell Whether a Proxy Request Worked](https://shifter.hashnode.dev/a-200-is-not-a-success-how-to-tell-whether-a-proxy-request-worked?utm_source=hashnode&utm_medium=feed)

Status codes inflate your success rate. Write a pass condition per target instead.

3 min read · [shifter.hashnode.dev](https://shifter.hashnode.dev/a-200-is-not-a-success-how-to-tell-whether-a-proxy-request-worked?utm_source=hashnode&utm_medium=feed)

[Michael Guy](https://hashnode.com/@unlimitedresidential) · [11h ago](https://hashnode.com/posts/how-to-estimate-proxy-bandwidth-for-large-scale-data-collection/6afcd105c4cd809b57517572)

### [How to Estimate Proxy Bandwidth for Large-Scale Data Collection](https://unlimitedresidentialproxy.hashnode.dev/how-to-estimate-proxy-bandwidth-for-large-scale-data-collection?utm_source=hashnode&utm_medium=feed)

Calculate proxy bandwidth from target TB, duty cycle and efficiency, with practical formulas, tables and a 100 TB sizing example.

7 min read · [unlimitedresidentialproxy.hashnode.dev](https://unlimitedresidentialproxy.hashnode.dev/how-to-estimate-proxy-bandwidth-for-large-scale-data-collection?utm_source=hashnode&utm_medium=feed)

[Shubham Baldava](https://hashnode.com/@shubham-olake) · [12h ago](https://hashnode.com/posts/postgres-to-duckdb-cdc-the-address-duckdb-cannot-resolve-and-four-more-fixes/6afcc9f35368403e8bb8a524)

### [Postgres to DuckDB CDC: The Address DuckDB Cannot Resolve and Four More Fixes](https://olake-blog.hashnode.dev/postgres-to-duckdb-cdc-the-address-duckdb-cannot-resolve-and-four-more-fixes?utm_source=hashnode&utm_medium=feed)

Slot, catalog, token, job and first query in setup order, with the exact error text where one is printed and the fix.

11 min read · [olake-blog.hashnode.dev](https://olake-blog.hashnode.dev/postgres-to-duckdb-cdc-the-address-duckdb-cannot-resolve-and-four-more-fixes?utm_source=hashnode&utm_medium=feed)

[BtoB-GoGo](https://hashnode.com/@btob-gogo) · [1d ago](https://hashnode.com/posts/freight-rates-with-error-bars/6afbe3f9f97d05ec44bac624)

### [Freight rates with error bars: what 100 corridor records look like when uncertainty is a column](https://btob-gogo.hashnode.dev/freight-rates-with-error-bars?utm_source=hashnode&utm_medium=feed)

Every figure carries an evidence grade and an error band, so a quote can be compared with a benchmark without pretending either one is exact.

11 min read · [btob-gogo.hashnode.dev](https://btob-gogo.hashnode.dev/freight-rates-with-error-bars?utm_source=hashnode&utm_medium=feed)

[2](https://hashnode.com/posts/freight-rates-with-error-bars/6afbe3f9f97d05ec44bac624)

[Yenosh V](https://hashnode.com/@yenoshv) · [1d ago](https://hashnode.com/posts/beyond-digital-support-how-ai-chatbots-are-redefining-patient-engagement-in-the-pharmaceutical-industry/6afbf7de3711b8f3d884c8ff)

### [Beyond Digital Support: How AI Chatbots Are Redefining Patient Engagement in the Pharmaceutical Industry](https://yenosh.hashnode.dev/beyond-digital-support-how-ai-chatbots-are-redefining-patient-engagement-in-the-pharmaceutical-industry?utm_source=hashnode&utm_medium=feed)

The pharmaceutical industry is entering a new era of patient engagement, where timely communication, personalized assistance, and continuous support are becoming essential to the patient experience. P

11 min read · [yenosh.hashnode.dev](https://yenosh.hashnode.dev/beyond-digital-support-how-ai-chatbots-are-redefining-patient-engagement-in-the-pharmaceutical-industry?utm_source=hashnode&utm_medium=feed)

[Tech pratham](https://hashnode.com/@techprath) · [1d ago](https://hashnode.com/posts/designing-modern-data-pipelines-the-technical-skills-every-aspiring-data-engineer-should-learn/6afbf47c03b64bce566af18d)

### [Designing Modern Data Pipelines: The Technical Skills Every Aspiring Data Engineer Should Learn](https://techskills.hashnode.dev/designing-modern-data-pipelines-the-technical-skills-every-aspiring-data-engineer-should-learn?utm_source=hashnode&utm_medium=feed)

Build an understanding of how data engineers handle raw, incomplete, duplicated, and scattered information and turn it into organized data ready.

6 min read · [techskills.hashnode.dev](https://techskills.hashnode.dev/designing-modern-data-pipelines-the-technical-skills-every-aspiring-data-engineer-should-learn?utm_source=hashnode&utm_medium=feed)

[Biz tech pulse hub](https://hashnode.com/@biztechpulsehub) · [1d ago](https://hashnode.com/posts/bigquery-cross-cloud-caching-how-to-improve-query-performance-and-reduce-data-transfers/6afb4ea8274706781d88ec3a)

### [BigQuery Cross-Cloud Caching: How to Improve Query Performance and Reduce Data Transfers](https://biztechpulsehub.hashnode.dev/bigquery-cross-cloud-caching-how-to-improve-query-performance-and-reduce-data-transfers?utm_source=hashnode&utm_medium=feed)

Explore how Google Cloud's Lakehouse caching helps data teams reuse remote file data, optimize cross-cloud analytics, and monitor query performance.

4 min read · [biztechpulsehub.hashnode.dev](https://biztechpulsehub.hashnode.dev/bigquery-cross-cloud-caching-how-to-improve-query-performance-and-reduce-data-transfers?utm_source=hashnode&utm_medium=feed)

[tanya](https://hashnode.com/@stack-era) · [1d ago](https://hashnode.com/posts/how-capfolio-turns-exchange-and-wallet-data-into-portfolio-rebalancing/6afb2be00cc5b4feaf70d65d)

### [How Capfolio turns exchange and wallet data into portfolio rebalancing](https://stackera.hashnode.dev/how-capfolio-turns-exchange-and-wallet-data-into-portfolio-rebalancing?utm_source=hashnode&utm_medium=feed)

A portfolio spread across several exchanges and wallets has no single place to show how much of each asset it holds. Exchanges expose different APIs, rate limits, and credential models. Price changes

2 min read · [stackera.hashnode.dev](https://stackera.hashnode.dev/how-capfolio-turns-exchange-and-wallet-data-into-portfolio-rebalancing?utm_source=hashnode&utm_medium=feed)

[Elina William](https://hashnode.com/@elina-william) · [1d ago](https://hashnode.com/posts/c-bdcda-exam-a-repeatable-study-system-for-sap-s-data-architect-certification/6afb0e1bf0ef85590c13926b)

### [C\_BDCDA Exam: A Repeatable Study System for SAP's Data Architect Certification](https://elina-william.hashnode.dev/c-bdcda-exam-a-repeatable-study-system-for-sap-s-data-architect-certification?utm_source=hashnode&utm_medium=feed)

Measure, map, study, test, correct: a structured way to prepare for the scenario-based SAP Business Data Cloud architect exam.

12 min read · [elina-william.hashnode.dev](https://elina-william.hashnode.dev/c-bdcda-exam-a-repeatable-study-system-for-sap-s-data-architect-certification?utm_source=hashnode&utm_medium=feed)
