Data Engineer (Pyspark)_ Investment BankingAtyeti Inc • Bengaluru, Karnataka, India
Data Engineer (Pyspark)_ Investment Banking
Atyeti Inc • Bengaluru, Karnataka, India
13 days ago
Job descriptionMust Have Skills : Proficient with Python, PySpark and Airflow Strong understanding of Object-Oriented Programming and Functional Programming paradigm Must have experience working with Spark and its architecture Knowledge of Software Engineering best practices Advanced SQL knowledge (preferably Oracle) Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources. Good to Have Skills : Knowledge of ‘Data’ related AWS Services Knowledge of GitHub and Jenkins Automated testing
Background :
This position will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform at Bank.
Roles and Responsibility :
- Build and maintain all facets of Data Pipelines for Data Engineering team.
- Build the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, Python and Airflow.
- Work with internal and external stakeholders to assist with data-related technical issues and data quality issues.
- Engage in proof of concepts, technical demos and interaction with customers and other technical teams
- Participate in the agile ceremonies
- Ability to solve complex data-driven scenarios and triage towards defects and production issues
Technical Skills
Create a job alert for this search
Data Engineer Pyspark • Bengaluru, Karnataka, India
Related jobs
Data Engineer
Vriba Solutions • Bangalore, IN
Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions.
Data validation, quality & cleansing.Translate busin...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
NexionPro Services • Bangalore Urban, Karnataka, India
PySpark-based data processing workflows.Collaborate with data architects, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.Optimi...Show more
Last updated: 30+ days ago • Promoted
Gcp Data Engineer
Tata Consultancy Services • Bengaluru, Karnataka, India
Required Technical Skill Set • •.Big Data,Pyspark, Google Cloud, Airflow, Scala.Bangalore - TCS Bangalore Global axis (walk-in Drive).
Min 8+ years experience in BigData, Spark and Scala.Experience in...Show more
Last updated: 23 days ago • Promoted
Data Engineer Scala / Spark
Tata Consultancy Services • Bengaluru, Karnataka, India
I hope you're doing well! I came across your profile and was impressed by your extensive experience as an / a (mention role / skill).
We have a similar opportunity to join our dynamic team at TCS.Job Ti...Show more
Last updated: 12 hours ago • Promoted • New!
Data Engineer - PySpark Specialist
NeerInfo Solutions • Bengaluru, Republic Of India, IN
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications.
Use modern frameworks and agile practices to deliver scalable, hi...Show more
Last updated: 1 day ago • Promoted
Data Engineer (GCP)
HISH IT SERVICES • Bangalore, IN
We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show more
Last updated: 15 days ago • Promoted
Data Engineer
Stackave Solutions • Bengaluru, Karnataka, India
Location : Pune, Gurgaon, Bangalore, Chennai.Pyspark, SQL, ETL, AWS,Glue, Unix, DW concept.Good Understanding of Cloud, Hadoop and DW concepts.
Hands on experience in Pyspark and strong knowledge on ...Show more
Last updated: 8 days ago • Promoted
Data Engineer - Pyspark and dbt labs
NYX • Bengaluru, Karnataka, India
We are looking for a highly skilled Data Engineer with strong Python experience and deep expertise in PySpark and dbt Labs (dbt Core / dbt Cloud).
These two skills are the primary focus of the role....Show more
Last updated: 6 hours ago • Promoted • New!
Data Engineer
Quess IT Staffing • Bengaluru, Karnataka, India
We are looking for a highly skilled.The ideal candidate should have deep expertise in.Snowflake, PySpark, SQL, DBT, Airflow.Show more
Last updated: 30+ days ago • Promoted
Data Analytics Platform Engineer
Andor Tech • Bengaluru, Republic Of India, IN
We're Hiring : Platform Engineer (Mid-Level) | 4+ Years Experience | Bangalore (Manyata Tech Park)🚀.Implement, test, and polish features using AI-generated guides or senior engineer inputs.Connect ...Show more
Last updated: 23 days ago • Promoted
Data Engineer (Spark | SQL | Big Data Pipelines)
Flexton Inc. • Bengaluru, Karnataka, India
Role : Data Engineer (Spark | SQL | Big Data Pipelines).Spark, SQL, Data Streaming / Batch Processing, HDFS, Kafka Streaming.
We’re specifically looking for immediate joiners or candidates who are read...Show more
Last updated: 20 days ago • Promoted
Data Engineer
L&T Technology Services • Bengaluru, Karnataka, India
PySpark, SQL, AWS and good to have Pandas.Show more
Last updated: 30+ days ago • Promoted
Data Engineer
HashedIn by Deloitte • Bengaluru, Karnataka, India
Bengaluru, Kolkata, Hyderabad, Chennai, Gurgaon.Design, build, and optimize scalable data pipelines and ETL / ELT workflows using Spark (Scala / Python), SQL, and orchestration tools (e.Apache Airflow,...Show more
Last updated: 2 days ago • Promoted
Data Engineer (Databricks / PySpark)
Tata Consultancy Services • Bengaluru, Republic Of India, IN
TCS has been a great pioneer in feeding the fire of young Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of ...Show more
Last updated: 23 days ago • Promoted
Data Engineer | Bangalore | Leading Big 4 Consulting Firm
Acme Services • Bengaluru, Karnataka, India
We are hiring sharp, hands-on Data Engineers to build scalable data solutions and drive performance across both traditional and cloud-based data platforms.
Key Roles and Responsibilities.Strong comm...Show more
Last updated: 8 days ago • Promoted
Pyspark Data Engineer
Tata Consultancy Services • Bengaluru, Karnataka, India
Role : Data Engineer with Mandatory Pyspark Knowledge.Required Technical Skill Set : Python , Pyspark, BigQuery.Desired Experience Range : 5+ yrs.
Location : Bangalore, Pune, Chennai, Gurugram.Desired C...Show more
Last updated: 18 days ago • Promoted
Cloud Data Solutions Engineer
Tata Consultancy Services • Bengaluru, Republic Of India, IN
Required Technical Skill Set • •.Big Data,Pyspark, Google Cloud, Airflow, Scala.Bangalore - TCS Bangalore Global axis (walk-in Drive).
Min 8+ years experience in BigData, Spark and Scala.Experience in...Show more
Last updated: 30+ days ago • Promoted
Data Engineer - Pyspark And Dbt Labs
NYX • Bengaluru, Republic Of India, IN
We are looking for a highly skilled Data Engineer with strong Python experience and deep expertise in PySpark and dbt Labs (dbt Core / dbt Cloud).
These two skills are the primary focus of the role....Show more
Last updated: 1 hour ago • Promoted • New!