Looking for Data Engineers

Job Description

As a Data Engineer, you will be responsible for designing, building, and maintaining the infrastructure that enables data processing, storage, and retrieval for our organization. You will work closely with data scientists, analysts, and other IT teams to ensure the data pipeline's reliability, scalability, and efficiency. Your role will involve implementing best practices in data engineering, ensuring data quality, and developing frameworks for data integration and analysis.

Key Responsibilities

Design and develop robust data pipelines and architectures to support data processing and analytics needs. Optimize data flows and ensure data integrity across different storage solutions. Work with big data tools and frameworks like Hadoop, Spark, and Kafka to manage and process large datasets. Collaborate with data scientists to translate business requirements into scalable data solutions. Troubleshoot and resolve issues related to data systems and pipeline performance. Maintain data security and compliance with relevant regulations.

Qualifications

Bachelor's degree in Computer Science, Engineering, or related field. Proven experience in SQL, Python, or other data-related programming languages. Familiarity with big data processing frameworks and cloud platforms (e.g., AWS, Azure, Google Cloud). Strong understanding of data modeling, ETL processes, and data warehousing. Excellent problem-solving and analytical skills, with a detail-oriented approach.

Preferred Skills

Experience with machine learning models and data visualization tools. Knowledge of data governance and best practices for data privacy. Familiarity with DevOps principles as they relate to data engineering.