Talent.com
Python Data Engineer

Python Data Engineer

Dexian Indiasurat, gujarat, in
6 days ago
Job description

Python Data Engineer : -

  • Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
  • Constructing infrastructure for efficient ETL processes from various sources and storage systems.
  • Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
  • Leading the implementation of algorithms and prototypes to transform raw data into useful information.
  • Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI / ML transformations.
  • Creating innovative data validation methods and data analysis tools.
  • Ensuring compliance with data governance and security policies.
  • Interpreting data trends and patterns to establish operational alerts.
  • Developing analytical tools, programs, and reporting mechanisms.
  • Conducting complex data analysis and presenting results effectively.
  • Preparing data for prescriptive and predictive modeling.
  • Continuously exploring opportunities to enhance data quality and reliability.
  • Applying strong programming and problem-solving skills to develop scalable solutions.
  • Passion for testing strategy, problem-solving, and continuous learning.
  • Willingness to acquire new skills and knowledge.
  • Possess a product / engineering mindset to drive impactful data solutions.
  • Experience working in distributed environments with global teams.

Technical Skills and Experience requirements :

  • Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
  • High proficiency in Python, Scala and Spark for applied large-scale data processing.
  • Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
  • Solid understanding of batch and streaming data processing techniques.
  • Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
  • Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
  • Experience with RDBMS and OLAP databases like MySQL, Snowflake.
  • Familiarity with Agile methodologies.
  • Obsession for service observability, instrumentation, monitoring, and alerting.
  • Knowledge or experience in architectural best practices for building data lakes.
  • Qualification : Bachelor’s / Master’s Degree.

    Relevant Development Experience : 8+ Years

    Relevant Experience : 8+ Years (as Python and Data Engineer)

    Overall IT Experience : 8 to 12 Years

    Create a job alert for this search

    Data Engineer Python • surat, gujarat, in

    Related jobs
    • Promoted
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    SyntasaSurat, IN
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsmohali, gujarat, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyantSurat, IN
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 17 days ago
    • Promoted
    • New!
    Data Engineer (Airflow +Python)

    Data Engineer (Airflow +Python)

    Tata Consultancy Servicesmohali, gujarat, in
    Greetings from Tata Consulting Services.TCS is Hiring for Data engineer.Required Technical Skill - Airflow, Python, DBT, SQL.Show moreLast updated: 19 hours ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGSurat, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 17 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicesmohali, gujarat, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreesurat, gujarat, in
    We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasSurat, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 6 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    People Consultancy Services (PCS)Surat, IN
    Shift Timing : 11 : 00 AM – 8 : 00 PM (India Time).Looking for 5+ Years experience in Advanced SQL, Azure Data Factory (ADF), Databricks (with PySpark). Experience with Azure Synapse (added advantage).St...Show moreLast updated: 23 hours ago
    • Promoted
    Senior Python / / AI Engineer

    Senior Python / / AI Engineer

    Luxoft IndiaSurat, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show moreLast updated: 23 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneSurat, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeSurat, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsSurat, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroSurat, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Servicesmohali, gujarat, in
    Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
    • Promoted
    Python Developer

    Python Developer

    True Tech ProfessionalsSurat, IN
    Job Type : Full-time / Contractual.We’re looking for an experienced Data Engineer / Developer with strong hands-on expertise in Snowflake, Databricks, Python scripting, and REST API integration.The id...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    LTIMindtreesurat, gujarat, in
    Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AISurat, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago