Back to Developers
Anchal Tiwari

Anchal Tiwari

Data Engineer

85
Profile Score

About

A pragmatic and committed data engineer and BI developer with 4+ years of experience. Responsible for developing and implementing efficient solutions for ETL processes, with a track record of leading teams and spearheading data migration efforts to ensure seamless data transfer within complex environments along with consuming the same from the serving layer to build interactive dashboards for the end business users. Equipped with a wide range of domain knowledge covering sales, people analytics, FinTech and FMCG.

Skills & Expertise (29)

SQL Advanced
8.5/10
5
Years Exp
Python Advanced
8.3/10
5
Years Exp
Spark-Core Advanced
8.2/10
4
Years Exp
Microsoft Azure Advanced
8.1/10
3
Years Exp
Tableau Advanced
7.9/10
3
Years Exp
CICD Snowflake Redshift VS Code Visual Studio Git Microsoft SQL Server Jenkins Airflow Talend Data Integrity Quality Control Postgresql MySql MapReduce Spark-SQL Hive Sqoop HDFS Power BI Amazon QuickSight QlikSense Shell Scripting HiveQL

Work Experience

Data Engineer

Think Future Technologies

Feb 2025 - Apr 2025

Monitored scalable ETL/ELT pipeline development with Apache Spark (PySpark) processing large structured and semi-structured datasets for sales operations. Orchestrated data ingestion from diverse systems including policy administration, claims databases, and external APIs into Azure Data Lake Storage (Gen2) ensuring data integrity and compliance. Collaborated closely with actuarial, underwriting, and analytics teams to gather data requirements, analyze business processes, and deliver data engineering solutions aligned with business goals. Facilitated communication between technical and non-technical stakeholders to ensure clear understanding of process workflows and data needs.

MIS Engineer

PB Tech Pvt Ltd.

Feb 2019 - Apr 2020

Designed and deployed Tableau dashboards to provide senior management with real-time insights into key sales and marketing performance indicators (KPIs), enabling data-driven strategic decisions. Collaborated with stakeholders across departments to define and implement a standardized reporting framework, which improved data accuracy and consistency while reducing report generation time by 25%. Utilized SQL and Python to compile and analyze user behavior data, identifying key trends and patterns that informed product development and optimized the user lifecycle.

Software Engineer

Adani Wilmar Ltd.

Aug 2022 - Sep 2024

Built and optimized scalable data transformation pipelines using Azure Databricks, improving data processing speed by 30% and enabling real-time analytics for complex sales datasets (transaction history, customer profiles). Developed and managed Delta Lake tables with schema evolution, supporting the ingestion of new data daily and boosting query performance by 40%. Designed and extended data ontologies and performed source system data mining to accurately extract and translate key business events, collaborating closely with underwriting, actuarial, and analytics teams. Implemented automated data quality checks, validations, and monitoring frameworks to maintain data accuracy and integrity, which led to a 90% reduction in data-related errors. Followed CI/CD best practices using Azure DevOps for version control, testing, and deployment of data pipelines, ensuring reliable production workflows and a 25% decrease in deployment time.

Education

Master of Business Administration - Adani Institute of Infrastructure Management, Ahmedabad

2020 - 2022 · Afghanistan

Bachelor of Engineering - Lakshmi Narain College of Tech. & Sc., Bhopal

2013 - 2017 · Afghanistan

Certifications

Advanced SQL Programming

LinkedIn Learning · 2024

Programming Foundations: Databases

LinkedIn Learning · 2024

SQL Intermediate

HackerRank · 2021

Interested in this developer?

Profile Score Breakdown

📷 Photo 10/10
📄 Resume 10/10
💼 Job Title 10/10
✍️ Bio 10/10
🛠️ Skills 20/20
🎓 Education 10/10
⏱️ Experience 5/15
💰 Rate 0/5
🏆 Certs 5/5
Verified 5/5
Total Score 85/100

Profile Overview

Member sinceMar 2026

Skills (29)

SQL Python Spark-Core Microsoft Azure Tableau CICD Snowflake Redshift VS Code Visual Studio +19 more