Urgent Hiring Data Engineer (Remote) India

We are seeking a Data Engineer to work remotely on a project that involves building scalable data pipelines, optimizing data storage, and processing large datasets for real-time analytics. The selected candidate will collaborate with our data science and engineering teams to ensure data availability, quality, and security.

The project includes developing ETL pipelines for a leading e-commerce company, migrating on-premise data infrastructure to the cloud, and optimizing real-time data ingestion for a fintech startup.

Key Project Responsibilities

Design, develop, and maintain ETL pipelines to process and transform structured and unstructured data. Optimize data storage solutions for high availability and scalability. Work with big data technologies like Hadoop, Spark, and Kafka to manage large-scale datasets. Collaborate with data scientists to ensure data accessibility for machine learning models. Implement data security and compliance best practices. Monitor data pipeline performance and troubleshoot issues proactively.

Project Details

E-Commerce Data Pipeline Optimization

Goal: Enhance customer behavior tracking using real-time data processing. Tech Stack: Apache Kafka, AWS Glue, Snowflake. Outcome: Improved recommendation system efficiency, boosting sales by 18%. Cloud Data Migration for a Healthcare Client

Goal: Migrate healthcare data from on-premise servers to Google Cloud for improved accessibility. Tech Stack: Google Cloud Storage, BigQuery, Airflow. Outcome: 40% faster data processing and improved HIPAA compliance. Real-Time Transaction Monitoring for Fintech

Goal: Build a scalable system to detect fraudulent transactions in real-time. Tech Stack: Apache Flink, PostgreSQL, AWS Lambda. Outcome: Increased fraud detection accuracy by 35%, reducing financial losses.