About
Results-driven Azure Data Engineer with 3+ years of experience designing scalable ETL/ELT pipelines, data integration, and data warehousing solutions on Azure cloud. Proven expertise in Azure Data Factory, Azure Databricks, ADLS Gen2, and Azure Synapse Analytics. Experienced in building end-to-end data pipelines, implementing Medallion Architecture, and delivering high-performance analytics solutions in Agile environments.
Skills & Expertise (21)
Work Experience
Azure Data Engineer
VisionQuest Solutions Private Limited
Oct 2022 - Jul 2024
Developed ADF pipelines to ingest data from ADLS Gen2 and Excel sources into the enterprise data lake. Built and maintained Databricks notebooks to process raw data and load it into Delta tables for downstream analytics. Performed ETL transformations using PySpark and Spark SQL to clean, enrich, and structure data for reporting. Integrated Azure Data Factory with Databricks workflows to orchestrate end-to-end data movement and transformation. Managed CI/CD pipelines using Azure DevOps, streamlining deployment across dev, QA, and production environments. Created detailed data mapping and requirements documents (DMR) for alignment with business and engineering stakeholders. Automated data workflows using Azure Logic Apps, reducing manual steps and improving processing reliability. Scheduled pipeline triggers and monitored execution, ensuring timely data availability for the RTVA dashboard. Performed unit testing and provided ongoing production support to maintain pipeline stability.
Azure Data Engineer
UXInterfacely IT Solutions LLP
Apr 2024 - Present
Designed and built scalable ETL pipelines using Azure Data Factory and Azure Databricks to process large volumes of treasury data across multiple source systems. Implemented Medallion Architecture (Bronze, Silver, Gold layers) to ensure structured data flow and enforce quality standards across the analytics platform. Developed complex SQL transformation logic aligned with DI documents, ensuring accurate and consistent downstream reporting. Ingested data from multiple heterogeneous sources into ADLS Gen2, maintaining data consistency and full lineage tracking. Created and managed ADF triggers (event-based and schedule-based) to automate pipeline execution and reduce manual intervention. Monitored data pipelines in production and resolved incidents proactively to maintain SLA compliance. Developed PySpark and Spark SQL jobs in Azure Databricks for large-scale data transformation and aggregation. Built a centralized analytics layer with enforced data quality checks, enabling self-service BI across business units.
Education
Bachelor of Business Administration (BBA) - KL University
2019 - 2022 · Afghanistan
