Shaileshshaileshpashte.hashnode.dev·Aug 29, 2024Amazon Kinesis Data Firehose and Kinesis Data Analytics: Real-Time Data Processing SimplifiedIntroduction In the era of big data, the ability to collect, process, and analyze data in real-time is crucial for businesses seeking to gain a competitive edge. Amazon Kinesis provides a suite of services designed to handle real-time data streams, a...DiscussKinesisDataFirehose
Didik Tri Susantoblog.didiktrisusanto.dev·Aug 28, 2024Large CSV Processing Using Javascript #WeekendBuildPrevious series I already covered large csv processing using PHP and Go. Now in new #WeekendBuild series I will use Javascript to process large csv file. Same requirements: extract and parse the file, count total of rows, collect city data and how ma...Discuss·29 reads#WeekendBuildJavaScript
ByteScrum TechnologiesforByteScrum Technologiesblog.bytescrum.com·Aug 21, 2024How to Convert Files Between Formats with a Python Script (e.g., CSV to Excel)File format conversion is a common task in data processing and management. One frequently encountered scenario is converting CSV files to Excel format, especially when working with large datasets that need to be shared or further analyzed. In this gu...Discuss·10 likes·37 readsPythoncsv to excel
Tarun Sharmatapstechie.hashnode.dev·Aug 7, 2024How to Work with Iterators and Generators in PythonIn Python, iterators and generators are powerful tools for working with sequences of data. They allow you to iterate over data without having to store the entire sequence in memory. This blog will explain iterators and generators in a simple and unde...DiscussPython Interview Prep: Essential Concepts and TechniquesLazyEvaluation
Christopher Wilsontechshopper.hashnode.dev·Aug 6, 2024Edge Computing in IoT Ecosystems: Enhancing Data Processing at the SourceThe rapid growth of the Internet of Things (IoT) has ushered in an era where vast amounts of data are generated from an array of connected devices. From smart homes to industrial sensors, the volume and velocity of data being produced are unprecedent...DiscussIoT ecosystems
Didik Tri Susantoblog.didiktrisusanto.dev·Jul 28, 2024Large CSV Processing Using Go #WeekendBuildSo lately I was thinking how to spend my weekend productively. I mean not a full weekend, but instead spend couple hours to do experiment, build something which I could gain knowledge from it. There's no boundaries and could be anything as long as I ...Discuss·206 reads#WeekendBuildGo Language
Muhammad Fahad Bashirmfahadbashir.hashnode.dev·Jul 28, 2024A Guide to Data Manipulation with PandasIn the modern world, pandas play a key role in data manipulation. It helps us to manipulate, analyze, and extract insights from Data. This article is based on data manipulation from the basic understanding of data to getting data on our needs. This i...DiscussData Science
Venkat Rvenkatr.hashnode.dev·Jul 12, 2024Unleashing the Power of Automated Machine Learning (AutoML)Automated Machine Learning (AutoML) is transforming the landscape of data science and machine learning, making advanced predictive analytics accessible to a broader audience. This blog post delves into the world of AutoML, exploring its definition, b...DiscussAutomated Machine learning (AutoML)
Shani Riversshanirivers.hashnode.dev·Jul 7, 2024How to Quickly Extract Data from Big Datasets in 3 StepsSo I wanted to do a data science project based on one I found that was similar, but I wanted to use a more recent dataset, rather than some random one that was out-of-date and pulled from an API that hasn't been updated in awhile. I wanted to do the ...Discusslarge dataset
Vivek Bhandarivivekbhandari.hashnode.dev·Jul 2, 2024Understanding the Mongoose Aggregation PipelineAggregation pipelines in MongoDB, particularly when using Mongoose, provide a powerful and flexible way to process and transform data. Each stage in the pipeline operates on the data, passing the transformed data to the next stage. This allows for co...DiscussMongoDB