Talent.com
No longer accepting applications
Lead Data Pipeline Engineer

Lead Data Pipeline Engineer

DataWeaveBengaluru, Republic Of India, IN
22 days ago
Job description

About DataWeave :

DataWeave provides Digital Shelf Analytics and Dynamic Pricing solutions to help digital commerce businesses make smarter, data-driven decisions. We turn billions of publicly available data points into actionable intelligence.

Role & Responsibilities :

  • Build and maintain scalable data pipelines and APIs powering dashboards and integrations.
  • Develop web crawlers to collect structured and unstructured data at scale.
  • Ensure data quality, completeness, and system performance .
  • Collaborate with cross-functional teams in a fast-paced start-up environment .

Skills & Qualifications :

  • 5–7 years of experience in Data Engineering or related fields.
  • Strong Python programming and scripting skills.
  • Experience with RDBMS, big data pipelines , and data management.
  • Knowledge of Elasticsearch, Cassandra, Solr , or web crawling is a plus.
  • Good communication and problem-solving skills.
  • Why Join Us :

  • Work on challenging data problems with large-scale datasets.
  • Mentorship, learning opportunities, and fast career growth.
  • Flexible hours, flat hierarchy, and a collaborative culture.
  • Create a job alert for this search

    Data Pipeline Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticshosur, tamil nadu, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
    • Promoted
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    ImpetusBengaluru, Karnataka, India
    Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show moreLast updated: 8 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD Systemsbangalore district, karnataka, in
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Recrohosur, tamil nadu, in
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    Dexian Indiahosur, tamil nadu, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladehosur, tamil nadu, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ImpetusBengaluru, Karnataka, India
    GCP Lead for Bangalore / Gurgaon location.We are looking candidate should have strong experience in Bigdata, spark, pyspark, Python, GCP-Bigquery, Airflow, Dataflow, Dataproc, Pubsub, Cloud Composer,...Show moreLast updated: 1 day ago
    • Promoted
    Azure Cloud Data Engineer

    Azure Cloud Data Engineer

    Intelebeehosur, tamil nadu, in
    Data Factory, Synapse, and Databricks.Python, PySpark, and Advanced SQL.Lakehouse / Medallion architecture.Customer Interaction & Technical Documentation. Interact with clients and business stakehol...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Digitalzonehosur, tamil nadu, in
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Delta Air LinesBengaluru, India
    Data Pipeline Development and Maintenance : .Design, build, and optimize scalable ETL / ELT pipelines using AWS Serverless services (Lambda, Glue, s3, Airflow) to ingest data from diverse sources such ...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill Set : AWS...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    ClearDemandhosur, tamil nadu, in
    Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIhosur, tamil nadu, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    CimpressBengaluru, Karnataka, India
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticshosur, tamil nadu, in
    We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 30+ days ago
    • Promoted
    Sr ETL Data Engineer -HL7

    Sr ETL Data Engineer -HL7

    BigRiohosur, tamil nadu, in
    Job Title : Sr ETL Data Engineer -HL7.Location : Remote – India (UK Shift).BigRio is a remote-based, technology consulting firm headquartered in Boston, MA. We specialize in delivering advanced softwa...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian Indiahosur, tamil nadu, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreehosur, tamil nadu, in
    We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago