Talent.com
Data Pipeline Engineer

Data Pipeline Engineer

Acuity Knowledge PartnersBengaluru, Republic Of India, IN
4 days ago
Job description

Role : Sr. Python Developer / Programmer

Team : Data and Technology Services

Job Location : Bangalore (hybrid)

Acuity Knowledge Partners is hiring a hands‑on engineer to design and build a reusable Python frameworks that spans front‑end integrations, backend / middle‑tier services, and cloud execution. The person will translate complex, post‑trade data flows into robust data models, stored procedures, and regression automation, and own CI / CD—including scripts to run AutoSys / batch jobs and stored procs across environments. The ideal candidate brings pragmatic engineering discipline, capital‑markets data intuition, and a builder’s mindset.

Experience Level : 4-9 years

Notice period : 0-30 days

Essential skills :

  • Bachelor’s or master’s degree in computer science, Engineering, or a related field.
  • Minimum 4 years of hands‑on software engineering with Python (incl. packaging, virtual envs, unit / integration testing);

strong use of librariessuch as pandas, SQL Alchemy / pyodbc, and asyncio / celery for pipelines and services.

  • Expert SQL skills and stored‑proc development (SQL Server / Oracle / Postgres), query tuning, and execution‑plan analysis for large datasets.
  • Proven experience designing CI / CD pipelines and automating promotion (code + data + DB objects) with Azure DevOps / Jenkins / GitLab;
  • strong Git practices and code‑review hygiene.

  • Comfort with schedulers (AutoSys / Control‑M / Airflow) and shell / Python scripting for batch orchestration;
  • familiarity with secrets management and environment configuration.

  • Domain understanding of post‑trade data flows and how to encode them into repeatable regression checks.
  • Strong communication skills
  • Key Responsibilities :

  • Collaborate with BAs, QEs, and traders / ops to clarify requirements and co‑design testable acceptance criteria;
  • maintain living technical documentation and run‑books.

  • Champion reusability : templates, golden pipelines, sample datasets, and coding standards that scale across engagements.
  • Interested candidates, please mail your updated resume at nihal.upadhyay@acuitykp.com

    Create a job alert for this search

    Data Pipeline Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticsbangalore, karnataka, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
    • Promoted
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    ImpetusBengaluru, Karnataka, India
    Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroBengaluru, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Acuity Knowledge PartnersBengaluru, Karnataka, India
    The position requires advanced proficiency in Python and SQL (covering both core programming and data manipulation), hands-on experience with cloud-native platform - Azure, and strong knowledge of ...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladehosur, tamil nadu, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Digitalzonehosur, tamil nadu, in
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 4 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD Systemshosur, tamil nadu, in
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Servicesbangalore district, karnataka, in
    Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    ClearDemandhosur, tamil nadu, in
    Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 4 days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradhosur, tamil nadu, in
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 24 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    JRD Systemshosur, tamil nadu, in
    Collaborate with data architects, analysts, and business teams to define and maintain.Roadnet) and modernized data sources. Partner with governance and infrastructure teams to establish.Automate and...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    AIMLEAPBengaluru, IN
    Senior Data Engineer – ETL & Pipeline Development.Remote (Work from Home) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.Pandas, Airflow, o...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeBengaluru, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyantBengaluru, IN
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticshosur, tamil nadu, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian Indiahosur, tamil nadu, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreehosur, tamil nadu, in
    We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago