Isha Nighute

GCP Data Engineer

Pune 4+ yrs exp 89 · Excellent

About

Data Engineer with total 4 years of experience in designing, testing and building end-to-end data pipelines on Google Cloud Platform (GCP). Skilled in Python, PySpark, Big Query, Dataproc, and Cloud Composer, with hands-on experience in ETL validation, data quality, SQL-based testing, and Python automation. Strong hands-on experience with Python, SQL, PySpark, BigQuery, GCP, Kafka, and Apache Airflow. Skilled in source-to-target validation, transformation testing, data quality checks, large-volume data validation, and pipeline failure analysis. Experienced in CI/CD automation using GitHub Actions, with a solid understanding of Agile practices and version control using GitHub.

Skills & Expertise (25)

SQL Advanced

8.1/10

Years Exp

Python Advanced

8.1/10

Years Exp

ETL Advanced

8.0/10

Years Exp

Apache Airflow Advanced

8.0/10

Years Exp

PySpark Intermediate

7.5/10

Years Exp

Data Warehousing Intermediate

7.5/10

Years Exp

GitHub Actions Intermediate

7.5/10

Years Exp

Dataproc Intermediate

7.0/10

Years Exp

Cloud functions Intermediate

7.0/10

Years Exp

Power BI Intermediate

7.0/10

Years Exp

data quality testing Data Reconciliation Source-to-Target Validation Data Validation ETL Testing GitHub Git Kafka Spark Medallion Architecture Data Modeling Cloud Composer Sub Pub Big Query

Work Experience

Data Engineer

Hover Technologies

Oct 2024 - Present

Performed end-to-end validation of ETL pipelines to ensure reliable movement of data from source systems through transformation layers to BigQuery. Validated batch and streaming data pipelines and monitored data delivery. Designed and executed test scenarios for data ingestion, transformation, validation, and loading processes. Automated repetitive validation activities using Python and integrated automation into CI/CD workflows using GitHub Actions. Developed and maintained Apache Airflow workflows and performed pipeline failure analysis, root-cause investigation, and reprocessing. Optimized BigQuery validation and analytical queries using partitioning and clustering for large datasets.

Research Assistant

Shree Enterprises

Jul 2022 - Oct 2024

Performed data validation and reconciliation of healthcare datasets. Developed SQL queries to validate record counts, duplicate records, NULL values, data types, and business-rule consistency. Validated data transformation and loading processes to ensure reporting datasets were complete and accurate. Optimized BigQuery queries using partitioning, clustering, and query optimization techniques for large datasets. Built Power BI dashboards and KPI reports using validated and reporting-ready datasets.