Data Engineer - ETL

Job Title : Data Engineer

Location :

Hyderabad / Bengaluru

Experience : 5+ Years

Employment Type Summary :

We are seeking a highly skilled Data Engineer with over 5 years of experience to design, build, and optimize data pipelines and architectures that support large-scale data processing and analytics. The ideal candidate will work closely with data scientists, analysts, and business teams to enable reliable data availability, quality, and performance. This role requires hands-on expertise in modern data engineering tools, cloud platforms, and big data technologies to deliver scalable and efficient data solutions.

Key Responsibilities :

• Design, develop, and maintain scalable and robust data pipelines to ingest, process, and transform structured and unstructured data from diverse sources.
• Build and optimize data warehouses, data lakes, and ETL / ELT processes to support analytics and business intelligence initiatives.
• Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver high-quality data solutions.
• Implement data modeling, schema design, and metadata management best practices to ensure data integrity and usability.
• Work with cloud data platforms (AWS, Azure, GCP) to deploy and manage data infrastructure components.
• Develop and maintain batch and real-time streaming data pipelines using technologies such as Apache Spark, Kafka, or similar frameworks.
• Monitor data pipeline performance, troubleshoot issues, and implement optimizations to ensure reliability and efficiency.
• Ensure data security, privacy, and compliance with organizational policies and regulatory standards.
• Automate data workflows and deployments using CI / CD tools and scripting languages.
• Document data architecture, processes, and best practices to facilitate knowledge sharing and operational excellence.
• Stay updated with emerging data engineering technologies and recommend improvements to existing systems.

Required Qualifications :

Preferred Qualifications :

ref : hirist.tech)