Lead Data Pipeline ArchitectPersistent Systems • Bengaluru, Republic Of India, IN

Lead Data Pipeline Architect

Persistent Systems • Bengaluru, Republic Of India, IN

30+ days ago

Job description

About Position :

We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data team. The ideal candidate will have deep expertise in SQL / PLSQL development , AWS cloud services , DBT (Data Build Tool) , Python , and Snowflake . You will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support analytics, reporting, and data science initiatives.

Role : Senior Data Engineer
Location : Bangalore
Experience : 6+years
Job Type : Full Time Employment

What You'll Do :

Design, develop, and optimize robust ETL / ELT pipelines using SQL / PLSQL , DBT , and Python .

Build and manage scalable data solutions on AWS (e.G., S3, Glue, Lambda, Redshift, EMR).

Develop and maintain data models and transformations in Snowflake .

Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements.

Ensure data quality, integrity, and governance across all data pipelines.

Monitor and troubleshoot data workflows and performance issues.

Implement best practices for data engineering, including CI / CD, version control, and testing.

Mentor junior engineers and contribute to team knowledge sharing.

Expertise You'll Bring :

Strong proficiency in SQL and PLSQL for data manipulation and performance tuning.

Hands-on experience with AWS cloud services related to data engineering.

Expertise in DBT for data transformation and modeling.

Proficient in Python for scripting and automation.

Experience with Snowflake data warehouse architecture and development.

Familiarity with data pipeline orchestration tools (e.G., Airflow, AWS Step Functions).

Strong understanding of data warehousing concepts and dimensional modeling.

Excellent problem-solving and communication skills.

Benefits :

Competitive salary and benefits package

Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications

Opportunity to work with cutting-edge technologies

Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

Annual health check-ups

Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment :

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

We support hybrid work and flexible hours to fit diverse lifestyles.

Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.

If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.Com / careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."

Create a job alert for this search

Data Pipeline Architect • Bengaluru, Republic Of India, IN

Related jobs

Data Pipeline Architect

Veca Consulting Pvt Ltd • Bengaluru, Republic Of India, IN

Location : Bangalore(No relocation).Notice Period : 20-30 days(who are currently serving).As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable ...Show more

Last updated: 25 days ago • Promoted

Data Pipeline Architect

Property Finder • Bengaluru, Republic Of India, IN

Relocation would be required but with highly competitive, tax free salary package.Property Finder is the leading digital real estate platform in the Middle East and North Africa region.A UAE-born s...Show more

Last updated: 12 days ago • Promoted

Data Pipeline Architect

AtkinsRéalis • Bengaluru, Republic Of India, IN

We are looking for an experienced professional with strong expertise in Data Engineering and MLOps / ML Engineering.This role involves designing scalable data pipelines, ensuring data quality and gov...Show more

Last updated: 3 days ago • Promoted

Data Pipeline Architect (Bangalore)

Acme Services • Bengaluru, Republic Of India, IN

Design, develop, and maintain scalable and robust data pipelines (ETL / ELT) using PySpark on the Databricks platform.Implement data ingestion strategies to load data from various sources (e.APIs, da...Show more

Last updated: 17 days ago • Promoted

Lead Data Pipeline Architect

Algonomy • Bengaluru, Republic Of India, IN

At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will constantly test and refine AI-driven ac...Show more

Last updated: 16 hours ago • Promoted • New!

Senior Data Pipeline Architect

Dr. Martens plc • Bengaluru, Republic Of India, IN

Working within a multi-disciplined team led by the.Senior Manager - Data Engineer.This is an exciting opportunity to contribute to a dynamic and innovative environment, where your work will directl...Show more

Last updated: 7 days ago • Promoted

Lead Data Pipeline Architect

ADM • Bengaluru, Republic Of India, IN

We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transforming crops int...Show more

Last updated: 30+ days ago • Promoted

Data Pipeline Architect

Licious • Bengaluru, Republic Of India, IN

SDE 2 – Data Platform Engineer.We are looking for a strong and hands-on.The role requires solid technical expertise in building reliable data pipelines, working with big data technologies, and ensu...Show more

Last updated: 9 days ago • Promoted

Data Pipeline Architect

Talent500 • Bengaluru, Republic Of India, IN

Talent500 is hiring for one of its clients.Founded in 1999 and headquartered in New York City, Huge is a global design and technology company that creates digital experiences for the world’s most a...Show more

Last updated: 4 hours ago • Promoted • New!

Senior Data Pipeline Architect

SPIRO • Bengaluru, Republic Of India, IN

We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designi...Show more

Last updated: 8 days ago • Promoted

Data Pipeline Architect

KnowledgeTrek Consulting • Bengaluru, Republic Of India, IN

Job Title : IT Engineer Data Engineering.Founded in 1871, the technology company offers safe, efficient, intelligent, and affordable solutions for vehicles, machines, traffic, and transportation.In ...Show more

Last updated: 12 days ago • Promoted

Lead Data Pipeline Architect

Tata Consultancy Services • Bengaluru, Republic Of India, IN

Required Technical Skill Set : Senior Data Engineer.Desired Experience Range : 7 - 12 yrs.Notice Period : Immediate to 90Days only. We are currently planning to do a Virtual.Primary Skills (Java, Pytho...Show more

Last updated: 30+ days ago • Promoted

Data Pipeline Architect

Tech Mahindra • Bengaluru, Republic Of India, IN

W are hiring Data Engineers, 4-9 years experience with below mandatory Skills.Job Location : Pan India ( Tech M Location). Azure Databricks, ETL, Pyspark & SQL, Medallion architecture.Data bricks ce...Show more

Last updated: 17 days ago • Promoted

Lead Data Pipeline Architect

Northern Arc Capital • Bengaluru, Karnataka, India

We are looking for a Lead Data Engineer — immediate joiners only.QUALIFICATIONS, EXPERIENCE, & COMPETENCIES - 9+ years of experience in similar role - Bachelor's or master’s degree in computer sc...Show more

Last updated: 20 hours ago • Promoted • New!

Lead Data Pipeline Architect

DigiRecruitx • Bengaluru, Republic Of India, IN

CTC- 20-50 LPA(Based on experience).The ideal candidate will have hands-on experience with real-time data ingestion using. This role demands strong programming skills, experience with.Develop, desig...Show more

Last updated: 30+ days ago • Promoted

Senior Data Pipeline Architect

PriceEasy AI • Bengaluru, Republic Of India, IN

Join one of the most respected and cutting-edge companies in the pricing and analytics industry! PriceEasy, a VC-backed leader, empowers convenience retailers with actionable insights through advan...Show more

Last updated: 30+ days ago • Promoted

Data Pipeline Architect

Alp Consulting Ltd. • Bengaluru, Republic Of India, IN

Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show more

Last updated: 30+ days ago • Promoted

Data Pipeline Architect

HashedIn by Deloitte • Bengaluru, Republic Of India, IN

Bengaluru, Kolkata, Hyderabad, Chennai, Gurgaon.Design, build, and optimize scalable data pipelines and ETL / ELT workflows using Spark (Scala / Python), SQL, and orchestration tools (e.Apache Airflow,...Show more

Last updated: 14 days ago • Promoted