Talent.com
Lead Data Pipeline Engineer

Lead Data Pipeline Engineer

Sonata SoftwareBengaluru, Republic Of India, IN
15 days ago
Job description

About the Company

In today's market, we observe a distinct duality in technology adoption. On one front, clients are keenly focused on cost containment, while on the other, there is a strong drive to modernize their digital storefronts, aiming to appeal to both consumers and B2B customers alike. As a leading Modernization Engineering company, we aim to deliver modernization-driven hypergrowth for our clients based on the deep differentiation we have created in Modernization Engineering, powered by our Lightening suite and 16-step Plat formation playbook. In addition, we bring agility and systems thinking to accelerate time to market for our clients. Headquartered in Bengaluru, India, Sonata Software has a strong global presence, with strategic operations spanning across key regions such as the US, UK, Europe, APAC, and ANZ. We are a trusted partner of world-leading companies in TMT (Telecom, Media, and Technology), Retail & CPG, Manufacturing, BFSI (Banking, Financial Services and Insurance), and HLS (Healthcare and Lifesciences). Our bouquet of Modernization Engineering services cuts across Cloud, Data, Dynamics, Contact Centers, and around newer technologies like Generative AI, MS Fabric, and other modernization platforms. To know more, visit : www.Sonata-software.Com

About the Role

Senior Data Engineer

Responsibilities

  • Proven experience in building scalable data pipelines
  • Strong proficiency in Python, especially working with Data Frames
  • Hands-on experience with AWS services :
  • Lambda
  • SQS (Events)
  • API Gateway
  • Kinesis
  • DynamoDB
  • Expertise in SQL querying
  • Experience with Snowflake or similar analytics databases
  • Skilled in extracting data from both SQL and NoSQL databases
  • Familiarity with CI / CD pipelines for code deployment across environments
  • Working knowledge of Cursor AI or Copilot

Qualifications

  • Experience : 5+ Years
  • Location : Bangalore / Hyderabad
  • Employment Type : Full-time
  • Required Skills

  • Proven experience in building scalable data pipelines
  • Strong proficiency in Python, especially working with Data Frames
  • Hands-on experience with AWS services
  • Expertise in SQL querying
  • Experience with Snowflake or similar analytics databases
  • Skilled in extracting data from both SQL and NoSQL databases
  • Familiarity with CI / CD pipelines for code deployment across environments
  • Working knowledge of Cursor AI or Copilot
  • Preferred Skills

  • Experience with AWS CDK (Cloud Development Kit)
  • Hands-on experience upgrading Python versions and managing related connectors in AWS using CDK
  • Exposure to modern ETL platforms
  • Familiarity with Snow pipe for data movement from S3 to Snowflake
  • Equal Opportunity Statement

    We are committed to diversity and inclusivity.

    Create a job alert for this search

    Data Pipeline Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticshosur, tamil nadu, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    MakeMyTripBangalore Urban, Karnataka, India
    At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    CoffeeBeansBengaluru, Karnataka, India
    Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of del...Show moreLast updated: 30+ days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD Systemsbangalore district, karnataka, in
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Recrohosur, tamil nadu, in
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    Dexian Indiahosur, tamil nadu, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 1 day ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyanthosur, tamil nadu, in
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladehosur, tamil nadu, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ImpetusBengaluru, Karnataka, India
    GCP Lead for Bangalore / Gurgaon location.We are looking candidate should have strong experience in Bigdata, spark, pyspark, Python, GCP-Bigquery, Airflow, Dataflow, Dataproc, Pubsub, Cloud Composer,...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    INDI Staffing ServicesBangalore Urban, Karnataka, India
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show moreLast updated: 1 day ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    LTIMindtreehosur, tamil nadu, in
    Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Lead Engineer

    GCP Lead Engineer

    ImpetusBangalore Urban, Karnataka, India
    IT experience range is preferred.Tech or any other Engineering degrees in related fields.The candidate should have extensive production experience (5 Years) with GCP, Other cloud experience would b...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer GCP

    Lead Data Engineer GCP

    EgenBengaluru, IN
    We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team.The ideal candidate will...Show moreLast updated: 12 days ago
    • Promoted
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    ImpetusBengaluru, Karnataka, India
    Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show moreLast updated: 10 days ago
    • Promoted
    Lead Data Engineer - Databricks

    Lead Data Engineer - Databricks

    Tredence Inc.Bengaluru, Karnataka, India
    Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, Cali...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    CimpressBengaluru, Karnataka, India
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    AIMLEAPBangalore, IN
    Senior Data Engineer – ETL & Pipeline Development.Remote (Work from Home) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.Pandas, Airflow, o...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticshosur, tamil nadu, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago