Sign in
Log inSign up
Shubham Gore's photo

Product Development Engineer I @Phenom

Hyderabad
Member Since Nov, 2024

Writes at

Learning Kafka: Week 1 of 14-Day Journey

Learning Kafka: Week 1 of 14-Day Journey

apachekafkain14days.hashnode.dev

Read the blog

About Me

No bio to display

My Tech Stack

JavaSpringbootkafkaelasticsearchMongoDBNoSQLSQLShow all

I am available for

I am a dedicated Product Development Engineer with a strong foundation in software development and data engineering. My expertise lies in leveraging technologies such as Java and Python to build robust applications and services. I have a proven track record of developing high-quality, scalable systems, particularly in the areas of RESTful API development, microservices architecture using Spring Boot, and event-driven architectures with Apache Kafka. In my current role at Phenom People, I have been instrumental in the development of key services, including the Profile Service, which integrates candidate data from various sources. My contributions include designing data merging logic and implementing user journey tracking, ensuring that all candidate interactions are captured and stored securely in AWS S3. This service not only enhances data accuracy but also improves the overall user experience by providing comprehensive insights into candidate activities. I have also played a significant role in enhancing the Identity Resolution Service by refining Elasticsearch queries and developing APIs to integrate additional data sources. This has expanded the service's capabilities beyond basic identity management, allowing for more nuanced data handling and analysis. My work on an Apache Flink-based ETL service has further strengthened my skills in data transformation and processing, where I implemented custom Jolt transformations to ensure that raw event data aligns with the expected structure. Additionally, I developed a GDPR compliance service that effectively manages personal data requests while adhering to regulatory requirements. This involved implementing Kafka-based event consumption for managing requests and designing comprehensive data handling flows to ensure complete removal or masking of personal information across all storage systems. My technical toolkit includes a wide array of technologies such as MongoDB, MySQL, Elasticsearch, Docker, and Kubernetes, among others. I am also proficient in using tools like Jira for project management, Grafana for monitoring, and Jenkins for CI/CD processes. My commitment to continuous learning drives me to stay updated with industry trends and best practices, ensuring that I can deliver innovative solutions that meet evolving business needs. I am passionate about harnessing technology to solve complex problems and improve processes, making me an asset to any team focused on driving impactful change in the tech landscape.

Recent Activity

Dec 1

Wrote an article