Kanak Upadhyay

Data Engineer | Python Developer

Noida, Uttar Pradesh 3+ yrs exp 86 · Excellent

About

Data Engineer and Python Developer with 3+ years of experience building ETL workflows, web data extraction pipelines, and data validation processes. Skilled in Python, SQL, Pandas, MySQL, PostgreSQL, MongoDB, Selenium, BeautifulSoup, REST API integration, and Power BI. Experienced in collecting, cleaning, transforming, and validating large datasets from dynamic and static websites and delivering clean, business-ready data for analytics and reporting. Familiar with Django, FastAPI, Linux, Git, and AI-assisted development, with basic knowledge of Generative AI and AI agents.

Skills & Expertise (50)

Python Advanced

8.5/10

Years Exp

SQL Advanced

8.0/10

Years Exp

REST APIs Advanced

8.0/10

Years Exp

Postgresql Advanced

8.0/10

Years Exp

MySql Advanced

8.0/10

Years Exp

Pandas Advanced

8.0/10

Years Exp

Data Cleaning Advanced

8.0/10

Years Exp

Data Pipelines Advanced

8.0/10

Years Exp

ETL workflows Advanced

8.0/10

Years Exp

Power BI Intermediate

7.5/10

Years Exp

NumPy Intermediate

7.5/10

Years Exp

Git Intermediate

7.5/10

Years Exp

VS Code HTML OpenAI Codex CSS JavaScript sessions Headers Pagination Rate Limiting GitHub GitHub Copilot Postman LINUX Generative AI AI Agents ChatGPT Gemini Cursor SQL Query Optimization Php Data Transformation Data Validation Deduplication CSV Excel JSON XML MongoDb DAX Selenium BeautifulSoup Requests cURL Web crawling Browser Automation Django FastAPI API Integration

Work Experience

Data Engineer (Python & PHP)

ITSYS Solutions Pvt. Ltd.

Sep 2023 - Present

Built and maintained ETL workflows to collect, clean, validate, transform, and store structured and unstructured web data for downstream analytics. Designed and deployed automated Python extraction pipelines using Selenium, BeautifulSoup, and Requests for dynamic and static websites. Stored and managed extracted data in MySQL, PostgreSQL, MongoDB, CSV, and Excel formats. Improved data accuracy through SQL-based validation, deduplication, and consistency audits. Integrated REST APIs and JSON/XML data sources into Python-based data pipelines. Debugged pipeline failures, monitored logs, and implemented error handling to ensure uninterrupted data pipelines. Developed Power BI dashboards using SQL and Excel datasets, with KPI cards, DAX measures, slicers, and drill-through reports. Collaborated with internal teams to understand data requirements and delivered clean datasets on schedule. Used AI-assisted development tools (Cursor, GitHub Copilot, ChatGPT, Gemini, Codex) to speed up coding, debugging, and documentation.