Senior Data Engineer (Spark/Airflow) - Investment SolutionsAtyeti Inc • Bengaluru, Republic Of India, IN
Senior Data Engineer (Spark / Airflow) - Investment Solutions
Atyeti Inc • Bengaluru, Republic Of India, IN
13 days ago
Job descriptionMust Have Skills : Proficient with Python, PySpark and Airflow Strong understanding of Object-Oriented Programming and Functional Programming paradigm Must have experience working with Spark and its architecture Knowledge of Software Engineering best practices Advanced SQL knowledge (preferably Oracle) Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources. Good to Have Skills : Knowledge of ‘Data’ related AWS Services Knowledge of GitHub and Jenkins Automated testing
Background :
This position will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform at Bank.
Roles and Responsibility :
- Build and maintain all facets of Data Pipelines for Data Engineering team.
- Build the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, Python and Airflow.
- Work with internal and external stakeholders to assist with data-related technical issues and data quality issues.
- Engage in proof of concepts, technical demos and interaction with customers and other technical teams
- Participate in the agile ceremonies
- Ability to solve complex data-driven scenarios and triage towards defects and production issues
Technical Skills
Create a job alert for this search
Senior Data Engineer • Bengaluru, Republic Of India, IN
Related jobs
Senior Data Engineer
RapidBrains • Bengaluru, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
Last updated: 15 days ago • Promoted
Senior Data Engineer
TEKsystems Global Services in India • Bengaluru, Karnataka, India
Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL.
Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer (Onpremise)
Blend • Bengaluru, Karnataka, India
Python / Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client.
This role is part of a strategic initiative to enable ro...Show more
Last updated: 4 days ago • Promoted
Senior Data Enginer
Tredence Inc. • Bengaluru, Republic Of India, IN
Primary Roles and Responsibilities : .Developing Modern Data Warehouse solutions using Databricks and Azure Stack.Ability to provide solutions that are forward-thinking in data engineering and analyt...Show more
Last updated: 30+ days ago • Promoted
BW HANA Senior Data Engineer
Orcapod • Bengaluru, Karnataka, India
BW HANA - (Looking for Databricks, Datasphere, BDC).Bachelor’s degree in computer science, Engineering, or related fields.
SAP HANA and SAP BW modeling in various functional domains.Strong experienc...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer
Tredence Inc. • Bengaluru, Karnataka, India
Location - Bangalore, Pune, Kolkata, Chennai, Gurgaon.Bachelor's and / or master’s degree in computer science or equivalent experience.
IT experience and 3+ years' experience in Data warehouse / ETL pro...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Publicis Production • Bangalore Urban, Karnataka, India
We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show more
Last updated: 3 days ago • Promoted
Senior Data Engineer
Cargill • Bengaluru, India
The Senior Professional, Data Engineering designs, builds, and maintains complex data systems that enable data analysis and reporting.
This role includes a focus on Treasury-specific data solutions,...Show more
Last updated: 14 days ago • Promoted
Senior Data Engineer - Big-data
Confidential • Bengaluru / Bangalore, India
Proven experience leading data engineering teams, including distributed teams across multiple geographies and time zones.
Effective in managing cross-team collaboration with architects, product mana...Show more
Last updated: 23 days ago • Promoted
Senior Data Engineer
SPIRO • Bengaluru, Karnataka, India
We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies.
The ideal candidate will have over five years of hands-on experience designi...Show more
Last updated: 12 days ago • Promoted
Senior Data Engineer
SAIVA AI • Bengaluru, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer Platform
Confidential • Bengaluru / Bangalore
Proven expertise in building and maintaining complex ETL / ELT pipelines.Deep knowledge of orchestration frameworks (e.Airflow), and workflow optimization.
Strong cloud infrastructure experience (GCP ...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Cloudwick • Bengaluru, Karnataka, India
The ideal fit for the role will have a strong background in handling large volumes of data with Apache Spark to build , enhance bespoke systems to harness data.
The key focus of the position is to b...Show more
Last updated: 15 days ago • Promoted
Senior Data Engineer(Big Data)
Andor Tech • Bengaluru, Republic Of India, IN
If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you!.Deployment to a Product-Based Retail MNC.
Work on cutting-edge big data solutions f...Show more
Last updated: 24 days ago • Promoted
Senior Big Data Solutions Engineer
SPIRO • Bengaluru, Republic Of India, IN
We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies.
The ideal candidate will have over five years of hands-on experience designi...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer
Sutherland • Bangalore Urban, Karnataka, India
Location : Bangalore | Hyderabad | Chennai | Mumbai.If interested please reach out to me with your updated resume @Priti.
We’re transforming how we work by harnessing the power of AI, data, and digit...Show more
Last updated: 24 days ago • Promoted
Senior Data Engineer - PySpark
NeerInfo Solutions • Bengaluru, Republic Of India, IN
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications.
Use modern frameworks and agile practices to deliver scalable, hi...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer
Commonwealth Bank • Bengaluru, Republic Of India, IN
At CommBank, we never lose sight of the role we play in other people’s financial wellbeing.Our focus is to help people and businesses move forward to progress.
To make the right financial decisions ...Show more
Last updated: 30+ days ago • Promoted