Tobias MüllerProtobilg.com·Apr 16, 2024Chat with a DuckA while ago I published sql-workbench.com and the accompanying blog post called "Using DuckDB-WASM for in-browser Data Engineering". The SQL Workbench enables its users to analyze local or remote data directly in the browser. This lowers the bar rega...Discuss·165 readsduckDB
Fritz LarcoforSling Data Blogblog.slingdata.io·Apr 12, 2024Export Data From StarRocks into DuckDBIntroduction Let's look at how we can easily export data from StarRocks into a local DuckDB database with Sling, a flexible command-line interface (CLI) data integration tool that enables rapid extraction and loading of data directly from the termina...DiscussduckDB
Constantin Lungudatawise.dev·Apr 5, 2024A portable Data Analytics stack using Docker, Mage, dbt-core, DuckDB and SupersetJust wanted to share a small learning-by-doing project of mine. It's a containerized Data Analytics suite, covering end-to-end analytics process for a small (imaginary) company. We're talking about:- generating example data in parquet files using Pyt...Discuss·68 readsLearning JourneyDocker
Tobias MüllerProtobilg.com·Jan 27, 2024Using DuckDB-WASM for in-browser Data EngineeringIntroduction DuckDB, the in-process DBMS specialized in OLAP workloads, had a very rapid growth during the last year, both in functionality, but also popularity amongst its users, but also with developers that contribute many projects to the Open Sou...Harry Stafford and 3 others are discussing this4 people are discussing thisDiscuss·3 likes·11.4K readsdata-engineering
Manas Singhcode.manas.me·Dec 2, 2023Compare Forex Rates using PythonCurrency Exchange Rates When we transfer foreign currency, we look for the best exchange rates. Now, this rate changes daily and varies across banks. It is hard to predict the currency exchange rate but you can select the bank based on that day's rat...Discuss·34 readsPython
Constantin Lungudatawise.dev·Sep 25, 2023Hands-on with DuckDBThe right tool for the right job, right? When developing a basic application or testing a concept, an option could be SQLite. It's a self-contained database system that offers a SQL interface and conveniently stores data in a file on your device. Per...Discuss·247 readsLearning JourneyduckDB
Tobias MüllerProtobilg.com·Apr 26, 2023Gathering and analyzing public cloud provider IP address data with DuckDB & ObserverableAs organizations increasingly adopt the public cloud, managing the networking and security aspects of cloud computing becomes more complex. One of the challenges that cloud administrators face is, especially in a hybrid cloud environment, keeping tra...Discuss·1 like·1.3K readsduckDB
Tobias MüllerProtobilg.com·Apr 24, 2023Casual data engineering, or: A poor man's Data Lake in the cloud - Part IIn the age of big data, organizations of all sizes are collecting vast amounts of information about their operations, customers, and markets. To make sense of this data, many are turning to data lakes - centralized repositories that store and manage ...Discuss·11 likes·4.3K readsA poor man's Data Lake in the cloudAWS
Tobias MüllerProtobilg.com·Feb 26, 2023Using DuckDB to repartition parquet data in S3Since release v0.7.1, DuckDB has the ability to repartition data stored in S3 as parquet files by a simple SQL query, which enables some interesting use cases. Why not use existing AWS services? If your data lake lives in AWS, a natural choice for ET...Discuss·3.4K readsduckDB
Tobias MüllerProtobilg.com·Feb 12, 2023Using DuckDB in AWS LambdaPrelude DuckDB is an open-source in-process SQL OLAP database management system that has recently gained significant public interest due to its unique architecture and impressive performance benchmarks. Unlike traditional databases that are designed ...Discuss·1 like·5.4K readsAWS