Timothy Spanntimwithpulsar.hashnode.dev·Feb 17, 2025All Data and AI Weekly #177 - 17-Feb-2025( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, Unstructured Data ) https://bsky.app/profile/paasdev.bsky.social Cool Stuff of the week ⚡️ PyIceberg for upsert without the burden of Spark https://github.com/soumilshah1...apache nifi
RisingWave LabsforRisingWave Labs Blogrisingwave.com·Feb 17, 2025The Shift to Real-Time: Comparing RisingWave, BigQuery, Snowflake, and Databricks Features for Real-Time AnalyticsThe world of data is rapidly evolving, and the shift from batch processing to real-time analytics is at the forefront of this transformation. This demand is driving the development of new technologies and the evolution of existing platforms. RisingWa...Blogsnowflake
Naman Jainnaman-jain.hashnode.dev·Feb 15, 2025Using Snowflake ID Generator for Unique IDs in Spring BootIntroduction The Snowflake ID Server is a Spring Boot-based microservice designed to generate distributed, unique, and time-ordered identifiers using Twitter's Snowflake algorithm. The project supports two implementations of Snowflake ID generation: ...Spring Portalsnowflake-spring-boot
Timothy Spanntimwithpulsar.hashnode.dev·Feb 10, 2025All Data and AI Weekly ( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, Unstructured Data ) 176 - 10Feb2025All Data and AI Weekly ( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, Unstructured Data ) #176 - 10-Feb-2025 https://bsky.app/profile/paasdev.bsky.social Cool Stuff of the week ❄️ Apache NiFi 2.2! https://cwiki.apach...apache nifi
Umairumair-blogs.hashnode.dev·Feb 8, 2025Snowflake-Loading-DataBusiness Overview Snowflake's Data Cloud is based on a cutting-edge data platform delivered as a service(SaaS). Snowflake provides data storage, processing, and analytic solutions that arequicker, easier to use, and more versatile than traditional op...data engineering projects
Umairumair-blogs.hashnode.dev·Feb 8, 2025Real-Time-Data-Pipeline-with-AWS-NiFi-and-SnowflakeProject: Slowly Changing Dimensions in Snowflake Using Streams and Tasks Introduction This project implements a real-time data pipeline for continuous data ingestion and transformation into a Snowflake data warehouse. It leverages various cloud techn...data engineering projects
Timothy Spanntimwithpulsar.hashnode.dev·Jan 22, 2025All Data and AI Weekly ( AI, Data, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, NiFi ) #173 - 20 Jan 2025#173 - 20-Jan-2025 https://bsky.app/profile/paasdev.bsky.social Dedicated to my friend, Nano, loyal cat who passed away recently. Cool Stuff of the week ❄️ https://www.youtube.com/watch?v=zH5umveQW_c ❄️ https://docs.snowflake.com/en/user-guide/strea...Open Source
Renjitha Krenjithak.hashnode.dev·Jan 18, 2025Mastering Slowly Changing Dimensions (SCD): A Guide Using Vendor FeedsWhat is Slowly Changing Dimensions (SCD)? So, let’s say you’re dealing with a data warehouse—a massive storehouse of information that helps businesses make sense of complex data. Now, Slowly Changing Dimensions (SCD) is a method used in data warehous...dataengineering
Eric Torreborreetorreborre.blog·Dec 31, 20242024 in reviewThis year I decided to do a quick professional retrospective. It’s easier to plan the road ahead when you also have an eye on the rear-view mirror! I can group most of my highlights of 2024 in 3 categories: Becoming a technologist Unison The small...147 readsockam
Mahira Technology Private Limitedmahiratechnology.hashnode.dev·Dec 30, 2024How Link API Integration for AWS to Snowflake Proxy Service Can Transform Your Business OperationsIntroduction :- AWS is renowned for its robust cloud computing solutions, while Snowflake is celebrated for its powerful data warehousing capabilities. Connecting these two through API integration allows for seamless data flow, resulting in enhanced ...snowflake
