Senior Data EngineerSPIRO • Bengaluru, Karnataka, India
Senior Data Engineer
SPIRO • Bengaluru, Karnataka, India
10 days ago
Job descriptionBachelor’s or Master’s degree in Computer Science, Engineering, or a related field. 5+ years of experience in data engineering roles. Expertise in PySpark and Spark for large-scale data processing. Strong understanding of Big Data ecosystems and technologies (e.g., Hadoop, Hive). Hands-on experience with ETL development, data modeling, and data warehousing. Proficiency in programming languages such as Python, Scala, or Java. Experience with cloud platforms like AWS, Azure, or Google Cloud. Strong problem-solving skills and a detail-oriented mindset. Excellent communication and collaboration skills. Experience with containerization and orchestration tools like Docker and Kubernetes. Knowledge of SQL and relational database management systems. Familiarity with data orchestration tools like Airflow, Prefect, or similar.
Position : Senior Data Engineer
Location : Bengaluru
Experience : 5+ years
Job Summary :
We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.
Key Responsibilities :
- Design, develop, and maintain scalable data pipelines and ETL processes using PySpark and Spark.
- Perform data wrangling, transformation, and integration across diverse data sources.
- Optimize the performance and reliability of data processing workflows.
- Implement data quality frameworks to ensure data accuracy and integrity.
- Develop and maintain data architectures and data models to support business needs.
- Collaborate with cross-functional teams including data analysts, software engineers, and business stakeholders to understand data requirements.
- Stay updated with the latest advancements in Big Data tools, frameworks, and best practices.
- Mentor and guide junior data engineers in technical and professional growth.
Required Skills and Qualifications :
Preferred Qualifications :
Create a job alert for this search
Senior Data Engineer • Bengaluru, Karnataka, India
Related jobs
Senior Data Enginer
Tredence Inc. • Bengaluru, Republic Of India, IN
Primary Roles and Responsibilities : .Developing Modern Data Warehouse solutions using Databricks and Azure Stack.Ability to provide solutions that are forward-thinking in data engineering and analyt...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
TEKsystems Global Services in India • Bengaluru, Karnataka, India
Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL.
Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
VRIZE • Bengaluru, IN
Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database.
Develop and optimize complex SQL queries for data extract...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer
Zluri • Bengaluru, Karnataka, India
Job Location : Whitefield, Bangalore.Reporting to : Engineering Manager.Identity Governance and Administration (IGA) platform that enables IT and security teams to discover identities and applicati...Show more
Last updated: 20 days ago • Promoted
Senior Data Engineer
ACL Digital • Bengaluru, Karnataka, India
Job Description : Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts.Key ...Show more
Last updated: 22 days ago • Promoted
Senior Data Engineer
Roku • Bengaluru, Karnataka, India
Teamwork makes the stream work.Roku is changing how the world watches TV.Roku is the #1 TV streaming platform in the U.Canada and Mexico and weve set our sights on powering every television in the ...Show more
Last updated: 8 hours ago • Promoted • New!
Senior Data Engineer
Verve • Bangalore, Karnataka, India
Verve has created a more efficient and privacy-focused way to buy and monetize advertising.Verve is an ecosystem of demand and supply technologies fusing data media and technology together to deliv...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer - Databricks
Tredence Inc. • Bengaluru, India
Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI.
Headquartered in San Jose, Cali...Show more
Last updated: 17 days ago • Promoted
Senior Data Engineer
Meril • Bengaluru, India
We're Hiring : Senior Data Engineer.We are looking for a highly skilled Senior Data Engineer to help build and scale our data pipelines and infrastructure.
If you are passionate about modern data a...Show more
Last updated: 2 hours ago • Promoted • New!
Senior Data Engineer
Cargill • Bengaluru, Karnataka, India
The Senior Professional, Data Engineering designs, builds, and maintains complex data systems that enable data analysis and reporting.
This role includes a focus on Treasury-specific data solutions,...Show more
Last updated: 13 days ago • Promoted
Senior Data Engineer
Arcana • Bengaluru, Republic Of India, IN
Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show more
Last updated: 5 days ago • Promoted
Senior Data Engineer
Publicis Production • Bangalore Urban, Karnataka, India
We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer
Relevance Lab • Bengaluru, Karnataka, India
Design, build and maintain enterprise data models and data assets on Microsoft Azure to support analytics, reporting, ML / AI and data products.
Translate business requirements into robust logical and...Show more
Last updated: 8 days ago • Promoted
Senior Data Engineer
London Stock Exchange Group • Bangalore, India
Senior Data Engineer- Customer Lifecycle Engineering, CMR ABOUT US : LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business.We are de...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
N-iX • Bengaluru, Karnataka, India
Data solution to gather and transform data from multiple heterogeneous systems across our clients organization into the Azure Data Lakehouse using Databricks and ADF.
Design complex ETL processes of...Show more
Last updated: 13 days ago • Promoted
SENIOR DATA ENGINER
Tredence Inc. • Bengaluru, Karnataka, India
Primary Roles and Responsibilities : .Developing Modern Data Warehouse solutions using Databricks and Azure Stack.Ability to provide solutions that are forward-thinking in data engineering and analyt...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Pretium Enterprise Services, India • Bengaluru, Karnataka, India
Would be a lead responsible for developing data products & solutions for the organization.IT with experience in Data warehouse, ETL, BI projects is required.
Would collaborate within Agile teams to ...Show more
Last updated: 20 days ago • Promoted
Senior Big Data Solutions Engineer
SPIRO • Bengaluru, Republic Of India, IN
We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies.
The ideal candidate will have over five years of hands-on experience designi...Show more
Last updated: 1 day ago • Promoted