Talent.com
No longer accepting applications
Lead PySpark Data Engineer _ Exp : 7+ Years

Lead PySpark Data Engineer _ Exp : 7+ Years

Atyeti IncDelhi, IN
9 days ago
Job description

Job Description : Roles and Responsibility :

  • Build and maintain all facets of Data Pipelines for Data Engineering team.
  • Build the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, Python and Airflow.
  • Work with internal and external stakeholders to assist with data-related technical issues and data quality issues.
  • Engage in proof of concepts, technical demos and interaction with customers and other technical teams
  • Participate in the agile ceremonies
  • Ability to solve complex data-driven scenarios and triage towards defects and production issues

Technical Skills

  • Must Have Skills :
  • Proficient with Python, PySpark and Airflow
  • Strong understanding of Object-Oriented Programming and Functional Programming paradigm
  • Must have experience working with Spark and its architecture
  • Knowledge of Software Engineering best practices
  • Advanced SQL knowledge (preferably Oracle)
  • Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources.
  • Good to Have Skills :
  • Knowledge of ‘Data’ related AWS Services
  • Knowledge of GitHub and Jenkins
  • Automated testing
  • Create a job alert for this search

    Lead Data Engineer • Delhi, IN

    Related jobs
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    IGT SolutionsGurugram, Haryana, India
    We are seeking a highly skilled.Databricks, PySpark, ETL development, and SQL.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and analytics...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    MakeMyTripGurugram, Haryana, India
    At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    EXLGurugram, Haryana, India
    We are looking for a Python & PySpark developer and data engineer who can design and build solutions for one of our Fortune 500 Client programs in the realm of Financial Master & Reference Data Man...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    NABGurugram, Haryana, India
    Proficient in executing ETL processes between data environments.Proficient at coding in SQL (additional knowledge in Python and R is highly regarded). Proficient at creating analytics related docume...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    COVET IT INCGhaziabad, IN
    Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc. We are seeking a highly skilled AWS Data Engine...Show moreLast updated: 21 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIDelhi, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (Spark / Scala)

    Data Engineer (Spark / Scala)

    Tata Consultancy ServicesDelhi, India
    TCS is Hiring for Data Engineer (Spark / Scala) Experience : 5+Yrs Location : .Chennai, Bangalore, Pune, Gurugram Notice Period : 0-60 Days. Please find the JD below Good work experience & Proven experi...Show moreLast updated: 27 days ago
    • Promoted
    AWS Data Engineer (PySpark)

    AWS Data Engineer (PySpark)

    Atyeti IncDelhi, India
    Technical Skills Must Have Skills : Proficient with Python, PySpark and Airflow Strong understanding of Object-Oriented Programming and Functional Programming paradigm Must have experience working w...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Lead Data Engineer (Databricks)

    Lead Data Engineer (Databricks)

    SII Group IndiaNoida, Uttar Pradesh, India
    We are looking for a highly skilled.The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support analytics, reporting, an...Show moreLast updated: 5 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeDelhi, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    ManpowerGroup IndiaGurgaon, Haryana, India
    Qualifications : Strong 5 yrs to 8 yrs experience and understanding of ADF, ETL and SSIS, Python and SQL including data warehousing concepts and data warehousing principles.Proficiency in ETL ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    ImpetusGurgaon, Haryana, India
    Job Title : Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark) Location : Gurgaon Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibilities...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    VRIZEDelhi, India
    Experience as a Data Engineer with strong track record of designing and implementing data solutions.Experience in programming language as Python, Pyspark with airflows Experience with cloud data wa...Show moreLast updated: 5 hours ago
    • Promoted
    Lead PySpark Data Engineer _ Exp : 7+ Years

    Lead PySpark Data Engineer _ Exp : 7+ Years

    Atyeti IncDelhi, India
    Job Description : Roles and Responsibility : .Build and maintain all facets of Data Pipelines for Data Engineering team.Build the pipelines required for optimal extraction, transformation, and loading ...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Havells India LtdNoida, Uttar Pradesh, India
    We are seeking a skilled and experienced Data Engineer to join our dynamic team.The ideal candidate will have a strong background in data engineering, with a focus on PySpark, Python, and SQL.Exper...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneDelhi, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivegurgaon, haryana, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SPIRODelhi, India
    Senior Data Engineer Location : .Job Summary : We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have ov...Show moreLast updated: 4 days ago