Data Engineer - Python / SQL / ETL

Job Title : Data Engineer

Location : Hyderabad, Kochi, Trivandrum

Experience Required : 10-19 Yrs

Skills :

Primary - Scala, Pyspark, Python / Secondary - ETL, SQL, Azure

Role Proficiency :

The role demands expertise in building robust, scalable data pipelines that support ingestion, wrangling, transformation, and integration of data from multiple sources. The ideal candidate should have hands-on experience with ETL tools (e.g., Informatica, AWS Glue, Databricks, GCP DataProc), and strong programming skills in Python, PySpark, SQL, and optionally Scala. Proficiency across various data domains and familiarity with modern data warehouse and lakehouse architectures (Snowflake, BigQuery, Delta Lake, Lakehouse) is essential. A solid understanding of DevOps and infrastructure cost optimization is required.

Key Responsibilities & Outcomes :

Technical Development :

• Develop high-performance data pipelines and applications.
• Optimize development using design patterns and reusable solutions.
• Create and tune code using best practices for performance and scalability.
• Develop schemas, data models, and data storage solutions (SQL / NoSQL / Delta Lake).
• Perform debugging, testing, and validation to ensure solution quality.

Documentation & Design :

Customer Interaction :

Testing & Release :

Knowledge Management & Compliance :

Expected Deliverables :

Code :

Documentation :

Configuration & Testing :

Knowledge Sharing :

Skill Requirements :

Mandatory Technical Skills :

Additional Skills :

Certifications (Preferred) :

Soft Skills :

ref : hirist.tech)