Deblucidstreaming.hashnode.dev·a day ago8 Rusty open source data projects to watch in 2024Context The open source ecosystem is my favourite aspect of tech. It has been since the early days of BIG data in late 2000's. As software, infra, and data engineers, open source projects are a source of great inspiration for all of us. Open source p...Discuss·35 readsRust
Python Davidpythondavid.hashnode.dev·Nov 26, 2023Streaming Simplified: Unpacking HTTP-DASH Through a Child's Picture BookI haven't had the time to write about anything in a while. But I've been playing around with system design for a new streaming application, so I decided to tackle the core concept of HTTP-DASH in a simplistic way that can be understood easily. To mak...Discussstreaming
Raju MandalforTechMandalblog.rajumandal.com.np·Nov 24, 2023Streams and pipelines Architecture Design Pattern on AWSAn important feature we see often is processing streams of data, as fast as the data is being generated and scaling quickly to meet the demand of large volumes of events. Downstream services receive the stream and apply business logic to transform, a...DiscussAWS
Aneesh Sethaneeshseth.hashnode.dev·Nov 16, 2023What the hell are the architectures of scalable streaming applications?Here's some common WebRTC jargon to know: TURN server - A TURN server acts as an intermediary that relays packets of media data from one device to another. By using these relays, the TURN server can work around firewalls and other security measures t...Discuss·1 likestreaming
Sai SrirampurforPeerDB Blogblog.peerdb.io·Nov 9, 2023Native Replication of Postgres Geospatial DataPostGIS extension enables you to efficiently store and query geospatial data in Postgres. It introduces spatial data types such as GEOMETRY and GEOGRAPHY, which lets you store points, polygons, lines and so on. PostGIS also supports a large set of SQ...Discuss·2 likes·297 readsPostgreSQL
Shikhar BhushanProblog.schmizz.net·Nov 8, 2023The disaggregated write-ahead logThe traditional way replicated systems are architected is to physically co-locate the write-ahead log (WAL) on the nodes where the state is being maintained. Then a consensus protocol like Paxos or Raft is used to make sure the log on each replica ag...Discuss·2.5K readsdistributed system
Aafreen AliforAafreen's Journalaafreen-fs.hashnode.dev·Nov 5, 2023Uploading 4K and BeyondIn a world where technology keeps getting better, video quality has reached new heights. High-definition (HD) videos are everywhere, but now, we're going even higher with 4K and even more pixels. These ultra-sharp videos look fantastic, but sharing t...Discuss4K
Kaushik IskaforPeerDB Blogblog.peerdb.io·Nov 3, 2023Building a Streaming Platform in Go for PostgresAt PeerDB, our mission is to create a Postgres-first data-movement platform that makes it fast and simple to stream data from Postgres to Data Warehouses, Queues and Storage. Our engineering focus revolves around 10x faster data movement, cost-effici...Discuss·11 likes·16.4K readsPostgreSQL
Sai SrirampurforPeerDB Blogblog.peerdb.io·Oct 30, 2023Real-time Change Data Capture for Postgres Partitioned TablesWhy use Partitioned Tables in Postgres? Table partitioning in PostgreSQL is used to improve query performance and manage large datasets efficiently by dividing a table into smaller, more manageable segments, or partitions. It allows for faster data a...Discuss·2.0K readsPostgreSQL
Ritwik Mathritwikmath.hashnode.dev·Oct 23, 2023Streamlining Node.js: Mastering the Art of StreamsStreams, at their core, are simply a flow of sequences of binary digits (0s and 1s) that encode instructions or data, facilitating communication within and between devices. Whether you're downloading a PDF from the internet or pressing a key on your ...DiscussNode.js
