Talent.com
Data Pipeline Engineer

Data Pipeline Engineer

AtomicworkBengaluru, Republic Of India, IN
30+ days ago
Job description

Atomicwork is on a mission to transform the digital workplace experience by uniting people, processes, and platforms through AI automation. Our team is building a modern service management platform that enables growing businesses to reduce operational complexity and drive business success.

We are seeking a skilled and motivated Data Pipeline Engineer to join our

team. In this role, you will be responsible for designing, building, and

maintaining scalable data pipelines that support our enterprise search

capabilities. Your work will ensure that data from various sources is efficiently

ingested, processed, and indexed, enabling seamless and secure search

experiences across the organisation.

This position is based out of our Bengaluru office. We offer competitive pay to

employees and practical benefits for their whole family.

If this sounds interesting to you, read on.

What We’re Looking For (Qualifications)

We value hands-on skills and a proactive mindset. Formal qualifications are

less important than your ability to deliver results and collaborate effectively.

  • Proficiency in programming languages such as Python, Java, or Scala.
  • Strong experience with data pipeline frameworks and tools (e.G., Apache

Airflow, Apache NiFi).

  • Experience with search platforms like Elasticsearch or OpenSearch.
  • Familiarity with data ingestion, transformation, and indexing processes.
  • Understanding of enterprise search concepts, including crawling,
  • indexing, and query processing.

  • Knowledge of data security and access control best practices.
  • Experience with cloud platforms (AWS, GCP, or Azure) and related - Backend Engineer - Search / Integrations services.
  • Familiarity with Model Context Protocol (MCP) is a strong plus
  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration
  • What You’ll Do (Responsibilities)

  • Design, develop, and maintain data pipelines for enterprise search
  • applications.

  • Implement data ingestion processes from various sources, including
  • databases, file systems, and APIs.

  • Develop data transformation and enrichment processes to prepare data
  • for indexing.

  • Integrate with search platforms to index and update data efficiently.
  • Ensure data quality, consistency, and integrity throughout the pipeline.
  • Monitor pipeline performance and troubleshoot issues as they arise.
  • Collaborate with cross-functional teams, including data scientists,
  • engineers, and product managers.

  • Implement security measures to protect sensitive data during processing
  • and storage.

  • Document pipeline architecture, processes, and best practices.
  • Stay updated with industry trends and advancements in data engineering
  • and enterprise search.

    Why we are different (culture)

    As a part of Atomicwork, you can shape our company and business from idea to production. Our cultural values also set the bar high, helping us create a better workplace for everyone.

  • Agency : Be self-directed. Take initiative and solve problems creatively.
  • Taste : Hold a high bar. Sweat the details. Build with care and discernment.
  • Ownership : We demonstrate unwavering commitment to our mission and goals, taking full responsibility for triumphs and setbacks.
  • Mastery : We relentlessly pursue continuous self-improvement as individuals and teams, dedicating ourselves to constant learning and growth.
  • Impatience : We recognize that our world moves swiftly and is driven by an unyielding desire to progress with every endeavor.
  • Customer Obsession : We place our customers at the heart of everything we do, relentlessly seeking to understand their needs and exceed their expectations.
  • What we offer (compensation and benefits)

    We are big on benefits that make sense to you and your family.

  • Fantastic team —the #1 reason why everybody joins us.
  • Convenient offices — well-located offices spread over five different cities.
  • Paid time off — Unlimited sick leaves and 15 days off every year.
  • Health insurance — comprehensive health coverage upto 75% premium covered.
  • Flexible allowances — with hassle-free reimbursements across spends.
  • Annual outings — for everyone to have fun together.
  • What next (applying for this role)

  • Click on the apply button to get started with your application.
  • Answer a few questions about yourself and your work.
  • Wait to hear from us about the next steps.
  • Do you have anything else to tell us? Email careers@atomicwork.com and let us know what’s on your mind.

    Create a job alert for this search

    Data Pipeline Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Recrohosur, tamil nadu, in
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladehosur, tamil nadu, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    Dexian Indiahosur, tamil nadu, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 4 days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyanthosur, tamil nadu, in
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 15 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    LTIMindtreehosur, tamil nadu, in
    Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgehosur, tamil nadu, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 13 days ago
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    Lemongrasshosur, tamil nadu, in
    Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Veraxionhosur, tamil nadu, in
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHhosur, tamil nadu, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradhosur, tamil nadu, in
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 24 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsBangalore, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    JRD Systemshosur, tamil nadu, in
    Collaborate with data architects, analysts, and business teams to define and maintain.Roadnet) and modernized data sources. Partner with governance and infrastructure teams to establish.Automate and...Show moreLast updated: 9 days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Mitchell Martin Inc.hosur, tamil nadu, in
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgehosur, tamil nadu, in
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticshosur, tamil nadu, in
    We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian Indiahosur, tamil nadu, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 4 days ago