Data Pipeline AdministratorLTIMindtree • Bengaluru, Republic Of India, IN
Data Pipeline Administrator
LTIMindtree • Bengaluru, Republic Of India, IN
3 days ago
Job description8-12 years of experience with AWS(Azure / GCP) and Kafka / Amazon MSK Bachelor’s degree in computer science or related fields Minimum 10+ years of industry experience Experience with AWS MSK and / or Confluent Cloud Experience with monitoring tools like CloudWatch, Prometheus and Grafana. Familiarity with Kubernetes, CI / CD pipelines, and GitOps workflows. Proficiency in foundational AWS cloud services (ex. Cloud Watch, AWS EC2, IAM, VPC, RDS, S3, etc). Design and manage Amazon MSK / Kafka-based streaming data pipelines. Configure and monitor Kafka clusters for performance and scalability. Integrate Kafka with AWS services like EC2, EKS, Lambda, and S3. Implement security protocols, disaster recovery, and high availability. Use Infrastructure as code (IaC) tools such as Terraform for infrastructure automation. Collaborate with cross-functional teams for real-time analytics and data pipelines Excellent understanding of Kubernetes and containerization concepts Good experience with AWS Cloud and its services Programming, Scripting, and automation skills highly preferred (JAVA, APIs, Python, Bash, PowerShell)
Working experience in Linux
- Window System Administration good to have.
Create a job alert for this search
Data Pipeline • Bengaluru, Republic Of India, IN
Related jobs
Data Warehouse Administrator
Tata Consultancy Services • Bengaluru, Karnataka, India
TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
Last updated: 12 days ago • Promoted
Data Pipeline Engineer
Luxoft • Bengaluru, Republic Of India, IN
This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure.
The goal is to enhance data access...Show more
Last updated: 30+ days ago • Promoted
Principal Data Pipeline Engineer
Andor Tech • Bengaluru, Republic Of India, IN
If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you!.Deployment to a Product-Based Retail MNC.
Work on cutting-edge big data solutions f...Show more
Last updated: 21 days ago • Promoted
Data Pipeline Engineer
lululemon • Bengaluru, Republic Of India, IN
Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well.We owe our success...Show more
Last updated: 22 days ago • Promoted
Data Pipeline Engineer
Brillio • Bengaluru, Republic Of India, IN
Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
Implement data ETL processes for batch and streaming an...Show more
Last updated: 1 day ago • Promoted
Senior Data Pipeline Engineer
Cargill • Bengaluru, Republic Of India, IN
The Senior Professional, Data Engineering designs, builds, and maintains complex data systems that enable data analysis and reporting.
This role includes a focus on Treasury-specific data solutions,...Show more
Last updated: 13 days ago • Promoted
Data Pipeline Developer
LTIMindtree • Bengaluru, Republic Of India, IN
Location : Any LTIMindtree location.Notice Period : Immediate to 90 Days.Extract transform and load ETL data from multiple sources ERP logistics compliance tools etc.
Develop reusable data pipelines t...Show more
Last updated: 19 days ago • Promoted
Lead Data Pipeline Developer
Licious • Bengaluru, Republic Of India, IN
We are seeking a highly skilled and experienced.SDE 3 – Data Platform Engineer.This role requires deep technical proficiency, architectural foresight, and strategic thinking to ensure our data syst...Show more
Last updated: 22 days ago • Promoted
Lead Data Pipeline Engineer
TEKsystems Global Services in India • Bengaluru, Republic Of India, IN
Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL.
Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show more
Last updated: 4 days ago • Promoted
Lead Data Pipeline Engineer
ACL Digital • Bengaluru, Republic Of India, IN
Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts.Key responsibilities ...Show more
Last updated: 20 days ago • Promoted
Lead Data Pipeline Engineer
Zluri • Bengaluru, Republic Of India, IN
Job Location : Whitefield, Bangalore.Reporting to : Engineering Manager.Zluri is a next-gen Identity Governance and Administration (IGA) platform that enables IT and security teams to discover iden...Show more
Last updated: 19 days ago • Promoted
Data Lake Administrator
Tata Consultancy Services • Bengaluru, Republic Of India, IN
TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
Last updated: 12 days ago • Promoted
Data Pipeline Specialist
Grid Dynamics • Bengaluru, Republic Of India, IN
Grid Dynamics (Nasdaq : GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies.
Grid Dynamics provides digital tra...Show more
Last updated: 19 days ago • Promoted
Azure Data Pipeline Engineer
Capgemini Invent • Bengaluru, Republic Of India, IN
At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
Last updated: 4 days ago • Promoted
Senior Data Pipeline Engineer
Quess IT Staffing • Bengaluru, Republic Of India, IN
We are looking for a highly skilled.The ideal candidate should have deep expertise in.Snowflake, PySpark, SQL, DBT, Airflow.Show more
Last updated: 7 days ago • Promoted
Senior Data Pipeline Specialist
Rainier Softech Solutions Pvt Ltd • Bengaluru, Republic Of India, IN
We’re looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks.You’ll turn requirements into production-grade ELT / ETL jobs, Delta Lake tables, and reusable comp...Show more
Last updated: 7 days ago • Promoted
Senior Data Pipeline Engineer
Infosys • Bengaluru, Republic Of India, IN
As a Software Developer you will work in a constantly evolving environment, due to technological advances and the strategic direction of the organization you work for.
You will create, maintain, aud...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Engineer
Emids • Bengaluru, Republic Of India, IN
We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team.
The ideal candidate will be responsible fo...Show more
Last updated: 1 day ago • Promoted