Talent.com
This job offer is not available in your country.
Python Data engineer

Python Data engineer

People Prime WorldwideChennai, IN
2 days ago
Job description

About Company :

They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what’s now to what’s next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society.

About Client :

Our client is a global digital solutions and technology consulting company headquartered in Mumbai, India. The company generates annual revenue of over $4.29 billion (₹35,517 crore), reflecting a 4.4% year-over-year growth in USD terms. It has a workforce of around 86,000 professionals operating in more than 40 countries and serves a global client base of over 700 organizations.

Our client operates across several major industry sectors, including Banking, Financial Services & Insurance (BFSI), Technology, Media & Telecommunications (TMT), Healthcare & Life Sciences, and Manufacturing & Consumer. In the past year, the company achieved a net profit of $553.4 million (₹4,584.6 crore), marking a 1.4% increase from the previous year. It also recorded a strong order inflow of $5.6 billion, up 15.7% year-over-year, highlighting growing demand across its service lines.

Key focus areas include Digital Transformation, Enterprise AI, Data & Analytics, and Product Engineering—reflecting its strategic commitment to driving innovation and value for clients across industries.

Job Description

Apache Airflow Python Tech Lead

Location : Pan India

Experience : 7+Years

Who are we looking for?

We are seeking an Apache Airflow Senior Python Tech Lead with strong expertise in Python and hands-on experience in Azure cloud technologies. The role will focus on migrating processes from the current 3rd Party RPA modules to Apache Airflow modules, ensuring seamless orchestration and automation of workflows. The ideal candidate will bring technical proficiency, problem-solving skills, and a deep understanding of workflow automation, along with a strong grasp of the North America insurance industry processes.

Technical Skills :

  • Design, develop, and implement workflows using Apache Airflow to replace the current 3rd Party RPA modules.
  • Build and optimize Python scripts to enable automation and integration with Apache Airflow pipelines.
  • Leverage Azure cloud services for deployment, monitoring, and scaling of Airflow workflows.
  • Collaborate with cross-functional teams to understand existing processes, dependencies, and business objectives.
  • Lead the migration of critical processes such as Auto, Package, Work Order Processing, and Policy Renewals within CI, Major Accounts, and Middle Market LOBs.
  • Ensure the accuracy, efficiency, and scalability of new workflows post-migration.
  • Perform unit testing, troubleshooting, and performance tuning for workflows and scripts.
  • Document workflows, configurations, and technical details to maintain clear and comprehensive project records.
  • Mentor junior developers and share best practices for Apache Airflow and Python development.

Responsibilities

  • Strong expertise in Apache Airflow workflow orchestration.
  • Proficiency in Python programming for scripting, data transformation, and process automation.
  • Hands-on experience in Azure cloud technologies (e.g., Azure Data Factory, Azure DevOps, Azure Storage).
  • Proven experience in migrating and automating processes from legacy systems or RPA modules.
  • Strong analytical and problem-solving skills with attention to detail.
  • Excellent communication and documentation skills.
  • Process Skills :

  • Experience working with Auto, Package, Work Order Processing, and Policy Renewals.
  • Familiarity with Commercial Insurance (CI), Major Accounts, and Middle Market LOBs in the North America insurance industry.
  • Understanding of RPA processes and architecture.
  • Create a job alert for this search

    Data Engineer Python • Chennai, IN

    Related jobs
    • Promoted
    Senior Data Engineer – Snowflake & Python (Remote, India or EU)

    Senior Data Engineer – Snowflake & Python (Remote, India or EU)

    Az-Tec TalentChennai, IN
    Remote
    Senior Data Engineer – Snowflake & Python (Remote, India or EU).ASAP (ideally next week following interview).SQL Server to Snowflake migration project. This is a high-impact role requiring strong ha...Show moreLast updated: 12 days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    Response InformaticsChennai, Tamil Nadu, India
    Response Informatics is looking for.Python Full Stack Developer – Chennai(WFO).Skills -Python,ReactJS,RESTful APIs,PostgreSQL or MySQL,Agile / Scrum,FastAPI, Flask, or Django,JSON,TypeScript and fami...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticschennai, tamil nadu, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KPG99 INCchennai, tamil nadu, in
    Duration- 12+ months with Extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development. Proficiency in SQL for data querying, tra...Show moreLast updated: 3 days ago
    • Promoted
    Senior Software Engineer - Python

    Senior Software Engineer - Python

    techjayschennai, tamil nadu, in
    What makes Techjays an inspiring place to work.At Techjays, we are driving the future of artificial intelligence with a bold mission to empower businesses worldwide by helping them build AI solutio...Show moreLast updated: 11 days ago
    • Promoted
    Backend Python / AI Engineer

    Backend Python / AI Engineer

    JuiceLabs AIchennai, tamil nadu, in
    Where creative engineering meets applied AI.At JuiceLabs, we’re building vertical AI-native tools that unlock fresh insights and creative superpowers for our clients in advertising, ecommerce, and ...Show moreLast updated: 25 days ago
    • Promoted
    PySpark Data Engineer

    PySpark Data Engineer

    EXTRAGIGChennai, IN
    Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role. Execute creative software and data solutions, including des...Show moreLast updated: 3 days ago
    • Promoted
    Python Engineer

    Python Engineer

    Chetty TechnologiesChennai, IN
    Chetty Technologies is a specialized Technology Company providing high-end consulting services in the Banking & Finance, Telecom, Healthcare, and Hospitality domains. With offices in the US and Indi...Show moreLast updated: 12 days ago
    • Promoted
    Senior Python Engineer

    Senior Python Engineer

    Acorn GlobusChennai, IN
    This is a full-time remote role for a Python Developer at Acorn Globus.The Python Developer will be responsible for back-end web development, software development, object-oriented programming (OOP)...Show moreLast updated: 17 days ago
    • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    The Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations. Location - Kolkata / Chennai / Trivan...Show moreLast updated: 3 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    K&K Talents - Indiachennai, tamil nadu, in
    This position is with one of our.Title : Principal Data Engineer.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune. Employment Type : Full-time Permanent.GCP or AWS, Spark, Pyspa...Show moreLast updated: 3 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDchennai, tamil nadu, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 13 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsChennai, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 23 days ago
    • Promoted
    • New!
    Databricks Engineer

    Databricks Engineer

    KPG99 INCchennai, tamil nadu, in
    REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development.Proficiency in SQL for data querying, transformation, and troubleshooting.Soli...Show moreLast updated: 22 hours ago
    • Promoted
    AWS Data engineer ( Only Chennai / Hyderabad and kolkata Location)- 6-8 Years

    AWS Data engineer ( Only Chennai / Hyderabad and kolkata Location)- 6-8 Years

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Greetings from TATA Consultancy Services.Pls find the Job Description below.Hands-on experience in Pyspark, Glue.Experience on EMR, S3, IAM, Lambda, Cloud formation, Python.AMI Rehydration, Python,...Show moreLast updated: 17 days ago
    • Promoted
    Lead Software Engineer - Python (Storage)

    Lead Software Engineer - Python (Storage)

    DDNChennai, IN
    This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a globa...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Serviceschennai, tamil nadu, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 22 days ago
    • Promoted
    Appglide - Senior Python Data Engineer

    Appglide - Senior Python Data Engineer

    Appglide.ioChennai
    We are seeking a Senior Python Data Engineer to join our customers Solutions Engineering Team.This role is ideal for an experienced professional who thrives in a fast-paced, customer-facing environ...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer(Chennai, Indore,Pune)

    AWS Data Engineer(Chennai, Indore,Pune)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Good knowledge and experience in Pyspark for forming complex Transformation logic.Secondary : AWS Glue , Airflow.A minimum of 3 + years' experience and understanding of Python core concepts, and im...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHChennai, Tamil Nadu, India
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago