Talent.com
Python Data Engineer
Python Data EngineerDexian India • Gurgaon, Republic Of India, IN
Python Data Engineer

Python Data Engineer

Dexian India • Gurgaon, Republic Of India, IN
28 days ago
Job description

Python Data Engineer : -

  • Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
  • Constructing infrastructure for efficient ETL processes from various sources and storage systems.
  • Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
  • Leading the implementation of algorithms and prototypes to transform raw data into useful information.
  • Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI / ML transformations.
  • Creating innovative data validation methods and data analysis tools.
  • Ensuring compliance with data governance and security policies.
  • Interpreting data trends and patterns to establish operational alerts.
  • Developing analytical tools, programs, and reporting mechanisms.
  • Conducting complex data analysis and presenting results effectively.
  • Preparing data for prescriptive and predictive modeling.
  • Continuously exploring opportunities to enhance data quality and reliability.
  • Applying strong programming and problem-solving skills to develop scalable solutions.
  • Passion for testing strategy, problem-solving, and continuous learning.
  • Willingness to acquire new skills and knowledge.
  • Possess a product / engineering mindset to drive impactful data solutions.
  • Experience working in distributed environments with global teams.

Technical Skills and Experience requirements :

  • Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
  • High proficiency in Python, Scala and Spark for applied large-scale data processing.
  • Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
  • Solid understanding of batch and streaming data processing techniques.
  • Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
  • Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
  • Experience with RDBMS and OLAP databases like MySQL, Snowflake.
  • Familiarity with Agile methodologies.
  • Obsession for service observability, instrumentation, monitoring, and alerting.
  • Knowledge or experience in architectural best practices for building data lakes.
  • Create a job alert for this search

    Data Engineer Python • Gurgaon, Republic Of India, IN

    Related jobs
    Data Engineer

    Data Engineer

    IGT Solutions • Gurgaon, Gurgaon (district)
    We are seeking a highly skilled.Databricks, PySpark, ETL development, and SQL.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and analytics...Show more
    Last updated: 5 hours ago • Promoted • New!
    Data Engineer - GCP

    Data Engineer - GCP

    People Prime Worldwide • gurugram, India
    Senior Data Engineer - GCP + Python.Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed...Show more
    Last updated: 24 days ago • Promoted
    Data Engineer

    Data Engineer

    Talent Worx • Gurugram, HR, IN
    Quick Apply
    The Data Engineer will have responsibility to use various methods to transform raw data into useful.The person must have familiarity with several programming languages and knowledge of.The primary ...Show more
    Last updated: 30+ days ago
    Sr Data Analytics Engineer (Python, AzureAWS, Data Pipelining)

    Sr Data Analytics Engineer (Python, AzureAWS, Data Pipelining)

    Gartner • Gurgaon, Haryana, India
    Join a world-class team of skilled engineers who build creative digital solutions to support our colleagues and clients.We make a broad organizational impact by delivering cutting-edge technology s...Show more
    Last updated: 18 days ago • Promoted
    Manager Data Engineer (AWS, Python, UI and Web Engineer

    Manager Data Engineer (AWS, Python, UI and Web Engineer

    Genpact • Gurgaon, Haryana, India
    Ready to build the future with AI.At Genpact we dont just keep up with technologywe set the pace.AI and digital innovation are redefining industries and were leading the charge.Genpacts AI Gigafact...Show more
    Last updated: 25 days ago • Promoted
    Fullstack Python Engineer (Cloud and AI)

    Fullstack Python Engineer (Cloud and AI)

    Luxoft • Gurugram, Haryana, India
    Noida / Hyderabad / Chennai / Gurgaon.Must have experience of maintaining & upgrading.NET based applications on Windows OS / Azure Cloud ,Experience with the MVC. NET, SSIS, Web Services, Azure Web API, I...Show more
    Last updated: 2 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Impetus • gurugram, uttar pradesh, in
    Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.Use Python and PySpark / Spark to transform, clean, aggregate and prepare data for an...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    TerraGiG • gurgaon, haryana, in
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Engineer

    Big Data Engineer

    K&K Talents - India • gurugram, uttar pradesh, in
    This position is with one of our.Title : Big Data Engineer (Scala & Spark).Required Experience : 8 Years and above.We are seeking a highly skilled. Azure cloud, Big Data technologies, and distributed ...Show more
    Last updated: 18 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    BLJ Tech Geeks • gurgaon, India
    Notice Period - Serving only till 31st Dec not more than this.We are looking for a skilled and detail-oriented.You will be responsible for building and maintaining scalable data pipelines, optimizi...Show more
    Last updated: 9 hours ago • Promoted • New!
    Staff Data Engineer

    Staff Data Engineer

    ANSR Summit Consulting • Gurgaon, India
    Participate in the entire data pipeline lifecycle, focusing on building data lakes, data warehouses and related processes. Contribute to the design and documentation of our data lake platform.Partne...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • gurgaon, haryana, in
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 19 days ago • Promoted
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    Impetus • Gurgaon, Haryana, India
    Job Title : Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark) Location : Gurgaon Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibiliti...Show more
    Last updated: 10 days ago • Promoted
    Python + Redis Data Engineer

    Python + Redis Data Engineer

    People Prime Worldwide • Gurgaon, Republic Of India, IN
    Important Note (Please Read Before Applying).You have less than 9 years or more than 13 years of experience.You do not have hands-on Python Developer with Radis DB 5+ experience.You are on a notice...Show more
    Last updated: 13 days ago • Promoted
    Lead Python Developer_ Exp : 8+ Years

    Lead Python Developer_ Exp : 8+ Years

    Atyeti Inc • gurugram, uttar pradesh, in
    Strong hands-on experience in Python.Strong experience on Django / Flask framework development.Solid understanding of OOP, REST APIs, and microservices architecture. Exposure to SQL / NoSQL databases f...Show more
    Last updated: 18 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    CXC • gurgaon, haryana, in
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 1 day ago • Promoted
    Python Data Engineer

    Python Data Engineer

    Dexian India • gurugram, India
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show more
    Last updated: 27 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • gurugram, uttar pradesh, in
    Primesoft Enterprise IT Services Pvt.As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learnin...Show more
    Last updated: 30+ days ago • Promoted