Harsh Vermaforcedev.hashnode.dev·Sep 30, 2024Batch Apex: A Developer’s GuideIn Salesforce development, efficiently managing large volumes of data is a common challenge. Apex Batch is an essential feature that allows developers to process records in the background, enhancing performance and user experience. In this guide, we’...DiscussSalesforce
Gyuhang Shimplto001.hashnode.dev·Sep 22, 2024Data Pipeline in the Field of Big Data (Korean)Introduction to Data Pipeline 데이터 파이프라인은 원시 데이터 (Raw Data) 를 수집하여 유용한 정보로 변환하는 일련의 프로세스를 말합니다. 데이터의 수집, 저장, 처리, 분석, 그리고 시각화까지의 전 과정을 포함하며, Big Data 환경에서는 대용량 데이터의 효율적인 처리를 위해 필수적인 요소입니다. 데이터 파이프라인의 주요 구성 요소 데이터 수집 (Data Ingestion) 데이터 저장 (Data ...Discussdata pipeline
Freda Victorlearndataengineering.hashnode.dev·Sep 19, 2024Building a Recommender System on AWS: Batch and Streaming PipelinesIntroduction Recommender systems have become essential to e-commerce, helping customers find products they’re interested in, ultimately improving the customer experience and driving sales. In this blog, we’ll guide you through implementing your recom...DiscussAWS
James Tranjamestrandung.hashnode.dev·Aug 31, 2024Java + Spring: How to correctly batch multiple requests into 1 network call with correlation supportTo guarantee the scalability and availability of our own service, it's a must to protect downstream dependencies from being flooded with requests within a very shot period of time. One popular technique is to call a Batch API if one is available down...DiscussJava
Amr Elhewyhewi.blog·Aug 22, 2024White Paper Summaries | Apache FlinkHello folks! In this summary we're going to be talking about Apache Flink. We're going to dive into what it is, what problems does it aim to solve and a few deep dives here and there. Let's start Introduction Apache Flink is an open-source system for...Discuss·60 readsapache
Imran Anwarimrananwar.hashnode.dev·Jul 23, 2024A Comprehensive Guide to AWS Compute Services: Your Gateway to Scalable Cloud SolutionsAWS Compute Services: In today’s rapidly evolving digital landscape, businesses need reliable, scalable, and cost-effective computing solutions to stay competitive. Amazon Web Services (AWS) provides a suite of powerful compute services that cater to...Discuss·12 likesOutposts
SHARIQUE KALAMshariquekalam.hashnode.dev·May 18, 2024Passing variables from one Batch to anotherProblem Statement - Let's discuss a scenario where we want to query all the Account records from one Batch and then for further processing or comparisions we wanted to have a copy of the same in another Batch. Scenario - We have created two Batch cla...Discuss·164 readsSalesforce
Divya MahajanforPartner Penspartnerpens.hashnode.dev·Mar 26, 2024AWS Containerization, Serverless Computing, and Simplified Infrastructure ManagementLink to exam: https://aws.amazon.com/certification/certified-cloud-practitioner/ Containerization: Docker Definition: Software development platform for deploying apps. Apps are packaged in containers runnable on any OS. Advantages: Uniform app ...DiscussAWS Certified Cloud Practitioner | CLF-C02 preparation KitDocker
Raghuveer Sriramanraghuveer.me·Mar 24, 2024Using Google Cloud Run to process batch jobsCloud Run helps you deploy containerized workloads at scale. Using it as a backend for web server use cases is quite well known, but it also can be very useful for large batch jobs that tend to be CPU heavy, especially if the job can be divided into ...Discuss·364 readsGoogle Cloud Platform
navinkumarnotes123.hashnode.dev·Feb 16, 2024Organize your files using python, shell and bat scripts ✨These scripts will automates file organization by categorizing files based on their extensions into individual directories within a parent directory. Python (.py) import os import shutil def fileOrganise(directory): # Iterate over files in the d...Discussautomation