About
I bring hands-on experience building end-to-end data pipelines using PySpark, Databricks, SQL, Kafka and Azure, with a strong focus on performance, cost and reliability. I’ve worked on real production systems handling daily batch and near–real-time data, dealt with failures, schema drift and reruns and optimized jobs using partitioning, joins and Delta Lake features. I understand not just how things work, but why design choices matter, which helps me deliver stable, scalable solutions and add value quickly to any data engineering team.
Skills & Expertise (12)
Work Experience
Software Developer
MagicOrange Software Solutions
9-2024 - 10-2025
Built 15+ .NET Core APIs for order flow and customer management, improving response consistency and performance. Developed PySpark pipelines in Databricks for data cleaning, aggregations and KPI preparation, reducing manual reporting work by ~60%. Collaborated with the integration team on Informatica workflows to improve batch stability. Took on cross-functional responsibilities typical of a startup, including requirement clarifications and internal process coordination.
Data Engineer
Capgemini
09-2021 - 09-2024
Migrated ~1 TB of data across 40+ Oracle schemas into Azure using ADF, ADLS Gen2. Built incremental and CDC pipelines for customer and transaction tables, syncing changes with a latency of 5–7 minutes. Developed PySpark transformations for reconciliation, business rules and timestamp cleanup, improving data consistency to ~80 percent.
Education
Bachelors of Engineering: Computer Engineering
2017 - 2021 · India
Certifications
Microsoft certified AZ-900
MICROSOFT · 2022
Microsoft certified az-900
Interested in this developer?
Profile Score Breakdown
Profile Overview
Availability Details
Visa Status
No Visa
Relocation
Open to Relocation
Skills (12)
Similar Profiles
Umaid Hashmi
Microsoft Certified Technology Associate in Python
Shaik Arshad Ahemed Shaik
Cybersecurity Analyst | SOC Analyst | Threat Hunter | Microsoft Security Expert
Sailesh Palanisamy
Cloud Engineer - Microsoft Azure & AWS
Samiksha Warade
Intern - Microsoft Power Apps and SharePoint