Sreekanth.A
Systems Engineer - Big Data
About
Computer Science (AI) graduate with 1 year of professional experience specializing in Data Engineering. Proficient in Python, SQL, and PySpark, with hands-on experience building scalable batch ETL pipelines, optimizing relational data models, and implementing automated data validation frameworks to ensure reliable, high-performance analytical datasets.
Skills & Expertise (26)
Work Experience
Systems Engineer - Big Data
Infosys
Present - Present
Developed and maintained batch data transformation pipelines using Python, PySpark, and Spark SQL to process 500+ GB of structured data daily. Implemented DataFrame operations including filtering, joins, aggregations, and schema validation across 15+ relational datasets to prepare clean analytical tables. Optimized SQL queries and Spark jobs by applying partitioning and basic Spark optimization techniques, improving pipeline execution time by 20%. Created automated Python data quality scripts and unit tests to identify data anomalies and ensure reliable data for downstream reporting. Collaborated with senior engineers to monitor ETL workflows, investigate production job failures, and support daily BI dashboard refreshes.
Education
BS (Data Science) - IIT MADRAS
2022 - · Afghanistan
B-tech (CSE-AI) - Sree Vidyanikethan Engineering College
2021 - 2025 · Afghanistan
Certifications
No certifications added yet
Interested in this developer?
Profile Score Breakdown
Profile Overview
Skills (26)
Click a skill to find developers with the same skill