Talent.com
Lead PySpark Data Engineer _ Exp: 7+ Years
Lead PySpark Data Engineer _ Exp: 7+ YearsAtyeti Inc • aurangabad, maharashtra, in
No longer accepting applications
Lead PySpark Data Engineer _ Exp : 7+ Years

Lead PySpark Data Engineer _ Exp : 7+ Years

Atyeti Inc • aurangabad, maharashtra, in
18 hours ago
Job description

Job Description : Roles and Responsibility :

  • Build and maintain all facets of Data Pipelines for Data Engineering team.
  • Build the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, Python and Airflow.
  • Work with internal and external stakeholders to assist with data-related technical issues and data quality issues.
  • Engage in proof of concepts, technical demos and interaction with customers and other technical teams
  • Participate in the agile ceremonies
  • Ability to solve complex data-driven scenarios and triage towards defects and production issues

Technical Skills

  • Must Have Skills :
  • Proficient with Python, PySpark and Airflow
  • Strong understanding of Object-Oriented Programming and Functional Programming paradigm
  • Must have experience working with Spark and its architecture
  • Knowledge of Software Engineering best practices
  • Advanced SQL knowledge (preferably Oracle)
  • Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources.
  • Good to Have Skills :
  • Knowledge of ‘Data’ related AWS Services
  • Knowledge of GitHub and Jenkins
  • Automated testing
  • Create a job alert for this search

    Lead Data Engineer • aurangabad, maharashtra, in

    Related jobs
    Lead Data Engineer

    Lead Data Engineer

    INDI Staffing Services • Maharashtra, India, India
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeans • aurangabad, maharashtra, in
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
    Last updated: 2 days ago • Promoted
    Lead Python Data Engineer _ Exp : 7+ Years

    Lead Python Data Engineer _ Exp : 7+ Years

    Atyeti Inc • Aurangabad, IN
    Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles. Python; strong SQL and cloud-native development experience ...Show more
    Last updated: 23 hours ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    LTIMindtree • aurangabad, maharashtra, in
    Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Dexian India • Aurangabad, IN
    Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines. High proficiency in Python, ...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Aurangabad, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer

    Data Engineer

    Aceolution • Aurangabad, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Aurangabad, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • Aurangabad, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 23 hours ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Aurangabad, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Data & Analytics Engineer

    Data & Analytics Engineer

    APPIT Software Inc • Aurangabad, IN
    Data Engineer : Snowflake -Mandatory – Hands -on Experience.ETL Tool -Informatica [IVS version],BDT.GCP : Big query – Mandatory -handson experience. Data Modelling & Data Warehouse -Mandatory -Hands...Show more
    Last updated: 7 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    People Consultancy Services (PCS) • Aurangabad, IN
    Shift Timing : 11 : 00 AM – 8 : 00 PM (India Time).Looking for 5+ Years experience in Advanced SQL, Azure Data Factory (ADF), Databricks (with PySpark). Experience with Azure Synapse (added advantage).St...Show more
    Last updated: 4 days ago • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutions • Aurangabad, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straive • aurangabad, maharashtra, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpress • aurangabad, maharashtra, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show more
    Last updated: 10 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Saras Analytics • aurangabad, maharashtra, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellias • Aurangabad, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer

    Data Engineer

    Veraxion • Aurangabad, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show more
    Last updated: 21 days ago • Promoted