Talent.com
This job offer is not available in your country.
Data Engineer / Tech Lead

Data Engineer / Tech Lead

CliqHRPune
30+ days ago
Job description

Contract duration -1 year

We are seeking a dynamic and experienced Tech Lead with a strong foundation in Java and Apache Spark to join our team. In this role, you will lead the development and deployment of scalable cloud-based data solutions, leveraging your expertise in AWS and big data technologies.

Key Responsibilities :

  • Lead the design, development, and deployment of scalable and reliable data processing solutions on AWS using Java and Spark.
  • Architect and implement big data processing pipelines using Apache Spark on AWS EMR.
  • Develop and deploy Serverless applications using AWS Lambda, integrating with other AWS services.
  • Utilize Amazon EKS for container orchestration and microservices management.
  • Design and implement workflow orchestration using Apache Airflow for complex data pipelines.
  • Collaborate with cross-functional teams to define project requirements and ensure seamless integration of services.
  • Mentor and guide team members in Java development best practices, cloud architecture, and data

engineering.

  • Monitor and optimize performance and cost of deployed solutions across AWS infrastructure.
  • Stay current with emerging technologies and industry trends to drive innovation and maintain a competitive edge.
  • Required Skills :

  • Strong hands-on experience in Java development.
  • Proficiency in Apache Spark for distributed data processing.
  • Experience with AWS services including EMR, Lambda, EKS, and Airflow.
  • Solid understanding of Serverless architecture and microservices.
  • Proven leadership and mentoring capabilities.
  • Excellent problem-solving and communication skills.
  • (ref : hirist.tech)

    Create a job alert for this search

    Lead Data • Pune

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgePune, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Aws Data Engineer

    Lead Aws Data Engineer

    ACL DigitalPune, Maharashtra, India
    Multi-year work experience as a Platform Lead, Delivery Leader or similar role.Good working knowledge of Aws Services, Python, Pyspark, data modelling. Knowledge of columnar and NoSQL databases, pre...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incpune, maharashtra, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 20 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesPune, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHpune, maharashtra, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesPune, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 28 days ago
    • Promoted
    Technical Lead

    Technical Lead

    CircanaPune, Maharashtra, India
    Let’s be unstoppable together!.At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an en...Show moreLast updated: 9 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ACL DigitalPune, Maharashtra, India
    Experience : - 10 years to 13 years.Location : Pune,Bangalore,Chennai.Notice Period : - Immediate Joiner only.Experience in Python & pyspark. Experience in ETL Development, ETL pipeline.Experience in Dat...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Pune, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kline + CompanyPune, IN
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kalyani TechnologiesPune, Maharashtra, India
    Overview : We are looking for a highly skilled Python Data Engineer to join our team in an on-premise data engineering environment. The ideal candidate will have experience in ETL tools , data...Show moreLast updated: 20 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsPune, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer (AWS cloud ecosystem) | Green Card holders or valid H1B | Jersey City, New Jer

    Senior Data Engineer (AWS cloud ecosystem) | Green Card holders or valid H1B | Jersey City, New Jer

    Trupti Solutions - IndiaPune, Maharashtra, India
    We are seeking Senior Data Engineers with 8–12 years of experience to join our client's team in Jersey City.This is a hybrid role that requires both strong technical expertise in cloud-based data e...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Futran SolutionsPune, Maharashtra, India
    Job Description : We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms. The ideal candidate will have a proven track record...Show moreLast updated: 28 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Everisepune, maharashtra, in
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 7 days ago
    • Promoted
    Lead Big Data Engineer

    Lead Big Data Engineer

    QualysPune, Maharashtra, India
    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.We are seeking a talented Lead Big Data Engineer to deliver roadmap features of ...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer Team Lead

    Data Engineer Team Lead

    SGIpune, maharashtra, in
    To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainPune, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIPune, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Servicespune, maharashtra, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 6 days ago