sudhakar Sk

Data Engineer

Chennai 5+ yrs exp 90 · Outstanding

About

Results-driven Data Engineer with 5+ years of experience building scalable data pipelines, ETL workflows, and cloud-based data platforms. Strong expertise in SQL, Python, PySpark, AWS, and Tableau, with hands-on experience in data modelling and database optimisation. Skilled in managing end-to-end data lifecycle, including data ingestion, transformation, and reporting. Proven ability to deliver reliable, data-driven insights for business decision-making. Experienced in integrating AI/ML capabilities into data workflows, with exposure to Generative AI (GenAI). Passionate about transforming raw data into actionable insights and building AI-driven data solutions.

Skills & Expertise (44)

Data Pipelines Advanced

8.5/10

Years Exp

AWS Advanced

8.5/10

Years Exp

ETL Advanced

8.3/10

Years Exp

Python Advanced

8.2/10

Years Exp

Data Integration Advanced

8.0/10

Years Exp

SQL Advanced

8.0/10

Years Exp

Apache Spark Advanced

7.8/10

Years Exp

Tableau Advanced

7.5/10

Years Exp

Data Warehouse Advanced

7.5/10

Years Exp

Data Governance Advanced

7.0/10

Years Exp

Generative AI Intermediate

6.5/10

Years Exp

Data Validation Data Quality Data Security Data Modelling Semantic Search Data visualisation Dashboard Development Git Cd pipelines Jenkins Prompt Engineering NLP Retrieval-Augmented Generation Vector Databases EC2 Data Transformation Batch Processing Data Orchestration Pandas NumPy PySpark Kafka Airflow S3 SQL Server Glue Lambda Redshift RDS IAM CloudWatch MySql Oracle

Work Experience

Data Engineer

Comcast India Engineering Centre

Feb 2023 - Present

Built scalable ETL pipelines using PySpark and SQL, processing large datasets into AWS S3 data lake for analytics. Designed data ingestion frameworks integrating data from S3, RDS and structured sources (CSV/JSON). Optimised SQL queries with indexing and tuning, improving performance and reducing processing time. Developed Python-based automation pipelines for sustainability reporting, reducing manual effort and improving accuracy. Delivered Tableau dashboards for executive-level insights and data-driven decision-making. Managed AWS services (EC2, S3, RDS, IAM, CloudWatch) for data processing, storage, and monitoring. Monitored ETL workflows, performed log analysis, and resolved production issues to ensure reliability. Implemented CI/CD pipelines using Git for automated deployments. Reduced AWS infrastructure cost by $2000/month through resource optimisation. Explored basic AI/ML use cases for data analysis and workflow automation.

Associate

Cognizant Technology Solutions

Nov 2020 - Feb 2023

Assisted in developing ETL pipelines using Python and SQL for processing structured and semi-structured data. Supported data ingestion from AWS S3, RDS and external data sources into centralised data platforms. Performed data transformation, cleansing, and validation using Pandas and NumPy. Wrote and maintained SQL queries, joins for reporting and data extraction. Gained hands-on experience in distributed data processing of large datasets. Worked with AWS services such as S3 and RDS for data storage and retrieval. Monitored ETL jobs and analysed logs using AWS CloudWatch to identify and resolve issues. Assisted in deploying data processing scripts on AWS EC2 instances. Supported workflow automation using Windows scheduler for scheduling. Integrated multiple data sources, including CSV, JSON and relational databases. Performed data validation and basic quality checks to ensure data consistency.