Talent.com
AI-Driven Data Pipeline Engineer

AI-Driven Data Pipeline Engineer

Sustainability Economics.aiBengaluru, Republic Of India, IN
30+ days ago
Job description

Location : Bengaluru, Karnataka

About the Company :

Sustainability Economics.Ai is a global organization, pioneering the convergence of clean energy and AI, enabling profitable energy transitions while powering end-to-end AI infrastructure. By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems that drive efficiency, innovation, and long-term impact across industries. Guided by exceptional leaders and visionaries with decades of expertise in finance, policy, technology, and innovation, we are committed to making long-term efforts to fulfil this vision through our technical innovation, client services, expertise, and capability expansion.

Role Summary :

We are seeking a skilled and experienced Agentic Data Engineer with a minimum of 2 years of experience in AI-driven data pipelines, agentic databases, and orchestration frameworks. The role focuses on designing intelligent, scalable, and adaptive data architectures that support next-generation AI-based systems and applications. The ideal candidate will have a strong background in AWS services (including Glue, EMR, and Lambda), along with expertise in data modelling, Python, SQL , and hands-on experience in integrating third-party APIs from the ground up.

Key Responsibilities :

  • Design, develop, and maintain AI-driven, agentic data pipelines and intelligent end-to-end architectures that support scalable, adaptive systems.
  • Build and optimize data models and schemas that adapt to evolving business needs, ensuring flexibility across structured and unstructured data.
  • Integrate AI-driven components and advanced data workflows into production systems for seamless orchestration and automation.
  • Work with cross-functional teams and stakeholders to turn business requirements into technical solutions.
  • Implement scalable pipelines on AWS using services such as S3, Glue, EMR, Lambda, and DynamoDB for reliability and performance.
  • Develop and manage ETL / ELT pipelines, integrating third-party APIs and diverse data sources with accuracy and consistency.
  • Apply best practices in data governance, lineage, and observability with modern monitoring tools.
  • Optimize SQL queries, storage, and throughput to improve efficiency across data systems.
  • Document pipelines, data flows, and transformations to ensure clarity and maintainability.
  • Explore emerging tools in agentic systems, orchestration frameworks, and AWS to continuously strengthen the data engineering ecosystem.

Key Requirements

Education and Experience :

  • Bachelor’s degree in Computer Science, Data Engineering, or a related field.
  • Minimum of 2 years of experience in data engineering, with exposure to AI-driven or agentic systems.
  • Strong proficiency in AWS services including S3, Glue, EMR, Lambda, DynamoDB, and Postgres, along with familiarity with AI-focused databases.
  • Hands-on experience in data scraping, data modeling, schema design, and relational database concepts .
  • Solid working knowledge of SQL, including performance tuning and query optimization best practices.
  • Prior experience in integrating APIs and AI components into data pipelines.
  • What You’ll Do :

  • Build adaptive data pipelines that can self-optimize and scale with business needs.
  • Develop and manage systems that support multimodal data (text, geospatial).
  • Enable real-time transformations in pipelines using agentic architectures.
  • Contribute to the evolution of agentic databases and autonomous data workflows.
  • What You Bring :

  • Passion for AI, agentic architectures, and next-gen data systems .
  • Strong problem-solving ability and a drive for innovation.
  • Ability to collaborate across engineering, product, and data science teams.
  • Agile mindset, adaptability, and eagerness to learn emerging technologies.
  • Why Join Us

  • Shape a first-of-its-kind AI + clean energy platform .
  • Work with a small, mission-driven team obsessed with impact.
  • An aggressive growth path.
  • A chance to leave your mark at the intersection of AI, design, and sustainability .
  • Create a job alert for this search

    Data Pipeline Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    • Promoted
    Data engineer (Pyspark) with AI

    Data engineer (Pyspark) with AI

    Tata Consultancy Servicesbangalore, karnataka, in
    Greetings from TATA Consultancy Services.Data engineer (Pyspark) with AI.Pls find the Job Description below.Strong design and data solutioning skills. PySpark hands-on experience with complex transf...Show moreLast updated: 19 days ago
    • Promoted
    Data & Analytics Engineer

    Data & Analytics Engineer

    APPIT Software Inchosur, tamil nadu, in
    Data Engineer : Snowflake -Mandatory – Hands -on Experience.ETL Tool -Informatica [IVS version],BDT.GCP : Big query – Mandatory -handson experience. Data Modelling & Data Warehouse -Mandatory -Hands...Show moreLast updated: 2 days ago
    • Promoted
    AI & Data Analytics Engineer

    AI & Data Analytics Engineer

    AmphenolBangalore Urban district, India, India
    We are seeking a highly motivated.Data Analytics & Transformation Analyst.This role will play a critical part in modernizing and streamlining our testing processes through automation,.The Analyst w...Show moreLast updated: 16 days ago
    • Promoted
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    TuringBengaluru, IN
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show moreLast updated: 3 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD Systemsbangalore district, karnataka, in
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Recrohosur, tamil nadu, in
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyanthosur, tamil nadu, in
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladehosur, tamil nadu, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Digitalzonehosur, tamil nadu, in
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 4 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    LTIMindtreehosur, tamil nadu, in
    Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill Set : AWS...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Mitchell Martin Inc.hosur, tamil nadu, in
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    AIMLEAPBengaluru, IN
    Senior Data Engineer – ETL & Pipeline Development.Remote (Work from Home) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.Pandas, Airflow, o...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeBengaluru, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire Solutionshosur, tamil nadu, in
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticshosur, tamil nadu, in
    We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian Indiahosur, tamil nadu, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 4 days ago