PALEN PUSHKAR
Software Engineer - Data Engineer
About
Experienced Software Engineer with a demonstrated history of working in the information technology and services industry. Skilled in data engineering, CI/CD pipelines, and cloud infrastructure. Strong engineering professional with a Bachelor of Technology (B.Tech.) focused in Information Technology from Indian Institute of Information Technology, Allahabad.
Skills & Expertise (42)
Work Experience
Software Engineer
Ethos Life
7-2024 - 4-2025
Developed automated test workflows within CI/CD pipelines using GitHub Actions, validating code changes across production and test environments. Boosted code quality by 40% and reduced manual review time by 60%, ensuring stable deployments. • Migrated 15+ Apache Airflow DAGs to Kubernetes Pod for containerized, scalable data pipelines with fault isolation. Utilized Docker and AWS ECR for image management, cutting execution failures by 35% and maintenance efforts by 50%. • Engineered a YAML - driven data processing framework to automate SQL processing. Achieved 80% faster query performance and integrated data publishing to platforms like SFTP, S3, and Segment, with deployments managed via ArgoCD. • Designed and deployed scalable, ETL - based data pipelines using DBT, accelerating data processing by 6x. Optimized Snowflake data models, reducing query latency by 60%, and containerized components using Docker for consistent deployment. • Built over 5 Apache Airflow DAGs from scratch to automate complex workflows. Adopted modular and reusable components, with CI/CD integration via GitHub Actions and deployment through ArgoCD, resulting in a 90% reduction in data processing time.
Associate Software Engineer
MAQ Software
1-2024 - 5-2024
• Designed and deployed a distributed PySpark pipeline on Apache Spark for sentiment analysis of survey comments using NLP techniques, achieving 97% accuracy in emotion classification and using LLM-generated comments to enlarge the dataset. • Conducted data analysis using Power BI by developing multiple visualization charts and generating insightful reports. • Managed sprint planning, task tracking, and project workflows using Jira in an Agile Scrum environment.
Software Engineer - Data Engineer
Ethos Life
July-2024 - April-2025
Developed automated test workflows within CI/CD pipelines using GitHub Actions, validating code changes across production and test environments. Boosted code quality by 40% and reduced manual review time by 60%, ensuring stable deployments. Migrated 15+ Apache Airflow DAGs to Kubernetes Pod for containerized, scalable data pipelines with fault isolation. Utilized Docker and AWS ECR for image management, cutting execution failures by 35% and maintenance efforts by 50%. Engineered a YAML-driven data processing framework to automate SQL processing. Achieved 80% faster query performance and integrated data publishing to platforms like SFTP, S3, and Segment, with deployments managed via ArgoCD. Designed and deployed scalable, ETL-based data pipelines using DBT, accelerating data processing by 6x. Optimized Snowflake data models, reducing query latency by 60%, and containerized components using Docker for consistent deployment. Built over 5 Apache Airflow DAGs from scratch to automate complex workflows. Adopted modular and reusable components, with CI/CD integration via GitHub Actions and deployment through ArgoCD, resulting in a 90% reduction in data processing time.
Associate Software Engineer
MAQ Software
January-2024 - May-2024
Designed and deployed a distributed PySpark pipeline on Apache Spark for sentiment analysis of survey comments using NLP techniques, achieving 97% accuracy in emotion classification and using LLM-generated comments to enlarge the dataset. Conducted data analysis using Power BI by developing multiple visualization charts and generating insightful reports. Managed sprint planning, task tracking, and project workflows using Jira in an Agile Scrum environment.
Education
B.Tech in Information Technology
2020 - 2024 · India
Bachelor of Technology
2018 - 2024 · India
Certifications
Expert on Codeforces
Codeforces · 2021
Rated Expert on Codeforces with Rating 1631
Interested in this developer?
Profile Score Breakdown
Profile Overview
Availability Details
Visa Status
No Visa
Relocation
Open to Relocation
Skills (42)
Click a skill to find developers with the same skill
