Senior Data EngineerBrillio • Bengaluru, Republic Of India, IN
No longer accepting applications
Senior Data Engineer
Brillio • Bengaluru, Republic Of India, IN
2 days ago
Job descriptionProficiency in Hadoop ecosystems such as Spark, HDFS, Hive, Iceberg, Spark SQL. Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies. Proven ability to design and implement automated data pipelines and materialized views. Proficiency in Python, Unix or similar languages. Good understanding of SQL oracle, SQL server or similar languages. Ops & CI / CD : Monitoring (Prometheus / Grafana), logging, pipelines (Jenkins / GitHub Actions). Core Engineering : Data structures / algorithms, testing (JUnit / pytest), Git, clean code. 5+ years of directly applicable experience BS in Computer Science, Engineering, or equivalent experience.
Min 5 years of Exp
Key Responsibilities
- Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
- Implement data ETL processes for batch and streaming analytics requirements.
- Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
- Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
- Ensure data security, integrity, and compliance throughout the infrastructure.
- Maintain documentation and contribute to architecture reviews.
- Participate in incident response and operational excellence initiatives for the data warehouse.
- Continuously learn mindset and apply new Hadoop ecosystem tools and data technologies.
Required Skills and Experience
Create a job alert for this search
Senior Data Engineer • Bengaluru, Republic Of India, IN
Related jobs
Senior Data Enginer
Tredence Inc. • Bengaluru, Republic Of India, IN
Primary Roles and Responsibilities : .Developing Modern Data Warehouse solutions using Databricks and Azure Stack.Ability to provide solutions that are forward-thinking in data engineering and analyt...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
TEKsystems Global Services in India • Bengaluru, Karnataka, India
Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL.
Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Zluri • Bengaluru, Karnataka, India
Job Location : Whitefield, Bangalore.Reporting to : Engineering Manager.Identity Governance and Administration (IGA) platform that enables IT and security teams to discover identities and applicati...Show more
Last updated: 20 days ago • Promoted
Senior Data Engineer
ACL Digital • Bengaluru, Karnataka, India
Job Description : Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts.Key ...Show more
Last updated: 22 days ago • Promoted
Senior Data Engineer
Roku • Bengaluru, Karnataka, India
Teamwork makes the stream work.Roku is changing how the world watches TV.Roku is the #1 TV streaming platform in the U.Canada and Mexico and weve set our sights on powering every television in the ...Show more
Last updated: 13 hours ago • Promoted • New!
Senior Data Engineer
Verve • Bangalore, Karnataka, India
Verve has created a more efficient and privacy-focused way to buy and monetize advertising.Verve is an ecosystem of demand and supply technologies fusing data media and technology together to deliv...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer - Databricks
Tredence Inc. • Bengaluru, India
Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI.
Headquartered in San Jose, Cali...Show more
Last updated: 17 days ago • Promoted
Senior Data Engineer
Meril • Bengaluru, India
We're Hiring : Senior Data Engineer.We are looking for a highly skilled Senior Data Engineer to help build and scale our data pipelines and infrastructure.
If you are passionate about modern data a...Show more
Last updated: 7 hours ago • Promoted • New!
Senior Data Engineer
Cargill • Bengaluru, Karnataka, India
The Senior Professional, Data Engineering designs, builds, and maintains complex data systems that enable data analysis and reporting.
This role includes a focus on Treasury-specific data solutions,...Show more
Last updated: 13 days ago • Promoted
Senior Data Engineer
Arcana • Bengaluru, Republic Of India, IN
Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show more
Last updated: 5 days ago • Promoted
Senior Data Engineer
Publicis Production • Bangalore Urban, Karnataka, India
We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer
Relevance Lab • Bengaluru, Karnataka, India
Design, build and maintain enterprise data models and data assets on Microsoft Azure to support analytics, reporting, ML / AI and data products.
Translate business requirements into robust logical and...Show more
Last updated: 8 days ago • Promoted
Senior Data Engineer
London Stock Exchange Group • Bangalore, India
Senior Data Engineer- Customer Lifecycle Engineering, CMR ABOUT US : LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business.We are de...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
N-iX • Bengaluru, Karnataka, India
Data solution to gather and transform data from multiple heterogeneous systems across our clients organization into the Azure Data Lakehouse using Databricks and ADF.
Design complex ETL processes of...Show more
Last updated: 13 days ago • Promoted
SENIOR DATA ENGINER
Tredence Inc. • Bengaluru, Karnataka, India
Primary Roles and Responsibilities : .Developing Modern Data Warehouse solutions using Databricks and Azure Stack.Ability to provide solutions that are forward-thinking in data engineering and analyt...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Pretium Enterprise Services, India • Bengaluru, Karnataka, India
Would be a lead responsible for developing data products & solutions for the organization.IT with experience in Data warehouse, ETL, BI projects is required.
Would collaborate within Agile teams to ...Show more
Last updated: 20 days ago • Promoted
Senior Big Data Solutions Engineer
SPIRO • Bengaluru, Republic Of India, IN
We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies.
The ideal candidate will have over five years of hands-on experience designi...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer
VRIZE • Bangalore, IN
Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database.
Develop and optimize complex SQL queries for data extract...Show more
Last updated: 2 days ago • Promoted