Lead Data Engineer - AWS

Job Title : Lead Data Engineer - AWS

Location : Kochi / : 6- 8 Years

Notice Period : Immediate to 15 Days

Job Overview :

We are looking for a highly skilled Lead Data Engineer (AWS) to architect, build, and manage scalable data pipelines with a strong emphasis on data quality, governance, and secure API integrations. The role requires deep expertise in AWS cloud services, Python, and PySpark, along with leadership in Agile delivery and cross team Responsibilities :

• Lead the design and implementation of end-to-end data ingestion pipelines using AWS services (Glue, Lambda, EMR, Step Functions, ECS, EC2, S3).
• Define and enforce data quality, validation, and monitoring standards to ensure reliable datasets.
• Develop and deploy scalable RESTful APIs for secure and seamless data integration.
• Collaborate with business stakeholders, product owners, and data science teams to translate business needs into technical solutions.
• Oversee data architecture, modeling, and database optimization (Aurora, Postgres, Redshift, DynamoDB).
• Drive Agile ceremonies, sprint planning, and CI / CD best practices using GitLab or equivalent tools.
• Mentor and guide junior engineers, ensuring adherence to coding standards and best practices.
• Ensure cost optimization, security, and scalability of AWS Skillsets :
• Strong experience in Python, PySpark, and SQL for large-scale ETL and data transformation.
• Hands-on expertise in AWS services (Glue, S3, Lambda, EMR, Step Functions, ECS, EC2).
• Proven knowledge of database systems Aurora, Postgres, DynamoDB, Redshift.
• Solid experience in designing and implementing RESTful APIs.
• Proficiency in CI / CD pipelines (GitLab, Jenkins, or equivalent) and Agile methodology.
• Strong understanding of data modeling, governance, and data lakehouse architectures.
• Excellent analytical, problem-solving, and communication Skillsets :
• Experience with AWS Kinesis, Firehose, SQS for real-time streaming.
• Familiarity with data quality frameworks and metadata management tools.
• Exposure to machine learning data preparation pipelines.
• Bachelors / Masters degree in Computer Science, Information Systems, or related Note : Only candidates who are immediately available (0- 15 days notice) and match the job requirements should apply.

(ref : hirist.tech)