Talent.com
Data Pipeline Engineer
Data Pipeline EngineerProductSquads • Ahmedabad, Republic Of India, IN
Data Pipeline Engineer

Data Pipeline Engineer

ProductSquads • Ahmedabad, Republic Of India, IN
7 days ago
Job description

About the Company

Company Profile : ProductSquads was founded with a bold mission : to engineer capital efficiency through autonomous AI agents, exceptional engineering, and real-time decision intelligence. We’re building an AI-native platform that redefines how software teams deliver value—whether through code written by humans, agents, or both. Our stack combines agentic AI systems, ML pipelines, and high-performance engineering workflows. This is your chance to build not just models, but systems that think, decide, and act. We’re developing AI fabric tools, domain-intelligent agents, and real-time decision systems to power the next generation of product delivery

Job Summary :

We are seeking a skilled and detail-oriented Data Engineer to join our growing team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures Experience with big data technologies, cloud platforms, and ETL processes is essential us to play a key role in driving data-driven decision-making across the organization.

Responsibilities

  • Design, develop, and maintain scalable ETL / ELT pipelines on AWS cloud infrastructure.
  • Build and manage data lakes, data warehouses, using AWS services (e.G., S3, DMS, Glue, Athena, Redshift, EMR, Lambda).
  • Implement data quality checks, monitoring, logging, and alerting for pipelines.
  • Optimize data workflows for performance, scalability, and cost-efficiency.
  • Collaborate with cross-functional teams including Data Science, Operations, and Product teams to integrate and deliver data-driven solutions.
  • Ensure compliance with data governance, security, and privacy standards.
  • Write clear, maintainable documentation and contribute to data engineering best practices.
  • Carrying out POCs on new and emerging technologies to meet business requirements.
  • Experience with AWS Bedrock as well as integrating LLMs into data workflow and applications.
  • Engineer and optimize LLM prompts for tasks such as data classification, summarization, enrichment, and semantic search.
  • Create API services allowing applications to access the data using Python and AWS technologies (Lambda, API Gateway, etc).

Qualifications

  • A minimum of five years of hands-on experience with AWS cloud technologies and data engineering.
  • Required Skills

  • Strong expertise in AWS data services such as S3, Glue, Redshift, Athena, Lambda, and Kinesis.
  • Proficient in Python, SQL, and distributed data processing frameworks (e.G., PySpark).
  • Experience integrating LLMs via APIs (e.G., OpenAI, AWS Bedrock, etc.).
  • Experience with CI / CD pipelines, Infrastructure as Code (IaC), and version control (e.G., Terraform).
  • Understanding of data privacy, security, and compliance in AI systems.
  • Excellent problem-solving skills, communication, and collaboration abilities.
  • Familiarity with AI-related technologies, such as the foundational LLM's and associated frameworks and tools such as LangChain, Hugging Face, Bedrock, etc.
  • Preferred Skills

  • Experience with CI / CD pipelines, Infrastructure as Code (IaC), and version control (e.G., Terraform).
  • Familiarity with AI-related technologies, such as the foundational LLM's and associated frameworks and tools such as LangChain, Hugging Face, Bedrock, etc.
  • Create a job alert for this search

    Data Pipeline Engineer • Ahmedabad, Republic Of India, IN

    Related jobs
    Data Engineer

    Data Engineer

    Aceolution • Ahmedabad, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Adastra • Ahmedabad, IN
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
    Last updated: 2 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group Inc • Gandhinagar, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Ahmedabad, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Kanerika Inc • Ahmedabad, Republic Of India, IN
    Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI. We leverage cutting-edge technologies in...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    HCLTech • Anand, IN
    Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
    Last updated: 16 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Ahmedabad, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Nadiad, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 16 days ago • Promoted
    Data Engineer (4 to 6 Years exp)

    Data Engineer (4 to 6 Years exp)

    DXFactor • Ahmedabad, Gujarat, India
    DXFactor is a US-based tech company working with customers across the globe.We are looking for candidates for.Data Engineer (4 to 6 Yrs exp). Designation : Data Engineer (Expertise in SnowFlake, AWS ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Nadiad, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Analytix Business Solutions (India) Pvt. Ltd. • Ahmedabad, Gujarat, India
    Businesses of all sizes are faced with a rapidly changing competitive environment.Companies that possess both the ability to successfully navigate obstacles and the agility to react to market condi...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer with Databricks & GCP

    Data Engineer with Databricks & GCP

    iitjobs, Inc. • Gandhinagar, IN
    Role : - Data Engineer with Databricks & GCP.Extensive hands-on experience with Databricks (Autoloader, DLT, Delta Lake, CDF) and PySpark. Expertise in SQL and advanced query optimization.Proficiency ...Show more
    Last updated: 18 hours ago • Promoted • New!
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Nadiad, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    ProductSquads • Ahmedabad, Gujarat, India
    Company Profile : ProductSquads was founded with a bold mission : to engineer capital efficiency through autonomous AI agents, exceptional engineering, and real-time decision intelligence.We’re build...Show more
    Last updated: 7 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    PamTen Inc • Gandhinagar, IN
    You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
    Last updated: 8 days ago • Promoted
    Senior Data Engineer (AWS / GCP)

    Senior Data Engineer (AWS / GCP)

    Armakuni • Ahmedabad, Gujarat, India
    We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results.If you are a tea...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Gandhinagar, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 7 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Advantmed • Ahmedabad, Gujarat, India
    Lead Data Engineer – Azure Cloud.We are looking for an experienced.The ideal candidate will design, develop, and maintain scalable data pipelines, ensure data quality, and leverage cloud technologi...Show more
    Last updated: 8 days ago • Promoted