This job offer is not available in your country.

Mycom - Technical Lead - DataLake Development

MycomGurgaon

16 days ago

Job description

Job Title : Technical Lead - Data Lake Developer

Experience Required : 8 to 10 years

Employment Type : the Role :

We are seeking a highly skilled and experienced Technical Lead Data Lake Developer to architect and implement scalable, high-performance data lakehouse solutions.

You will lead the development of robust data pipelines and work with cutting-edge Big Data and Cloud technologies to enable real-time and batch data processing across the Responsibilities :

Design & Implement Scalable Data Lakehouse Architectures :

Architect and build modern data lakehouse ecosystems using open-source and cloud-native technologies.
Ensure scalability, reliability, and performance of data platforms.

Develop High-Performance Data Pipelines :

Build and optimize real-time and batch data pipelines using Spark, Kafka, and streaming technologies.

Implement data ingestion, transformation, and storage strategies.

Collaborate Across Teams :

Work closely with data engineers, data scientists, and business stakeholders to understand data requirements.

Mentor junior developers and contribute to technical leadership.

Ensure Data Quality & Governance :

Implement data validation, monitoring, and governance frameworks.

Ensure compliance with data security and privacy Technical Skills :

Big Data & Streaming Technologies :

Apache Kafka

Apache Pekko (formerly Akka)

Apache Spark & Spark & Storage Technologies :

Delta Lake or Apache Iceberg

AWS S3 or MinIO S3

Query Engines & Databases :

AWS Athena

Trino (PrestoSQL)

& Containerization :

AWS Cloud Services

Kubernetes or Qualifications :

Bachelors degree in Computer Science, Engineering, or related field.

Proven experience in designing and implementing large-scale data platforms.

Strong understanding of distributed systems and microservices architecture.

Experience with CI / CD pipelines and DevOps practices.

Excellent problem-solving and communication Join Us?

Work on cutting-edge technologies in a fast-paced, innovative environment.

Lead impactful projects that drive data-driven decision-making.

Collaborate with a passionate and talented team.

Opportunities for continuous learning and career growth

(ref : hirist.tech)

Create a job alert for this search

Technical Lead • Gurgaon