Shubham Baldava (@shubham-olake)

Postgres to BigQuery CDC on BigLake: Where the Setup Stops, and the Exact Messages

Slot, service account, catalog, first query and change sync, with the message each stop returns and what clears it.

9 min readolake-blog.hashnode.dev

30m ago

MySQL to Snowflake: A Binlog Pipeline in Order, With the Exact Error at Each Step

Binlog, token, first sync, first query and change sync, each with the error text it can produce and the fix.

9 min readolake-blog.hashnode.dev

15h ago

Postgres to Snowflake CDC: Setup Notes and the Errors You Will Hit

Set up Postgres to Snowflake CDC with OLake and fix the errors you will hit: walsender, network policy, token exchange, stale rows, quoting.

7 min readolake-blog.hashnode.dev

1d ago

How Deduplication in Clickhouse works? (Avoiding FINAL keyword for better performance)

ClickHouse is optimised for its ingestion and reading speed to make your data near-real time latency, some trade-offs are made. De-duplication is something that ClickHouse doesn't guarantee in normal table. There are several strategies in Clickhouse ...

4 min readolake.hashnode.dev

Jul 30, 2024

Why Datazip chose Clickhouse to provide a managed data warehouse?

Datazip is on a mission to make data engineering obsolete. Data engineering space is going through massive transformation as need for data engineers is ever growing. But the amount of data engineers available is not growing with the same space. So we...

4 min readolake.hashnode.dev

May 26, 2024

Shubham Baldava

About

Available for

Shubham Baldava's blogs

Postgres to BigQuery CDC on BigLake: Where the Setup Stops, and the Exact Messages

MySQL to Snowflake: A Binlog Pipeline in Order, With the Exact Error at Each Step

Postgres to Snowflake CDC: Setup Notes and the Errors You Will Hit

How Deduplication in Clickhouse works? (Avoiding FINAL keyword for better performance)

Why Datazip chose Clickhouse to provide a managed data warehouse?

Shubham Baldava

About

Available for

Shubham Baldava's blogs

Postgres to BigQuery CDC on BigLake: Where the Setup Stops, and the Exact Messages

MySQL to Snowflake: A Binlog Pipeline in Order, With the Exact Error at Each Step

Postgres to Snowflake CDC: Setup Notes and the Errors You Will Hit

How Deduplication in Clickhouse works? (Avoiding FINAL keyword for better performance)

Why Datazip chose Clickhouse to provide a managed data warehouse?

Shubham Baldava

About

Available for

Shubham Baldava's blogs

Postgres to BigQuery CDC on BigLake: Where the Setup Stops, and the Exact Messages

MySQL to Snowflake: A Binlog Pipeline in Order, With the Exact Error at Each Step

Postgres to Snowflake CDC: Setup Notes and the Errors You Will Hit

How Deduplication in Clickhouse works? (Avoiding FINAL keyword for better performance)

Why Datazip chose Clickhouse to provide a managed data warehouse?

Search Hashnode

Shubham Baldava

About

Available for

Shubham Baldava's blogs

Postgres to BigQuery CDC on BigLake: Where the Setup Stops, and the Exact Messages

MySQL to Snowflake: A Binlog Pipeline in Order, With the Exact Error at Each Step

Postgres to Snowflake CDC: Setup Notes and the Errors You Will Hit

How Deduplication in Clickhouse works? (Avoiding FINAL keyword for better performance)

Why Datazip chose Clickhouse to provide a managed data warehouse?