Talent.com
Lead Data Engineer - PySpark/AWS
Lead Data Engineer - PySpark/AWSConfidential • Bengaluru / Bangalore
Lead Data Engineer - PySpark / AWS

Lead Data Engineer - PySpark / AWS

Confidential • Bengaluru / Bangalore
3 days ago
Job description

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

As a Lead Software Engineer at JPMorgan Chase within the Commercial and Investment Banking - Payments Technology Regulatory Reporting Team, you play a crucial role in an agile team dedicated to enhancing, building, and delivering trusted, market-leading technology products in a secure, stable, and scalable manner. As a core technical contributor, you are tasked with developing critical technology solutions across multiple technical domains, supporting various business functions to achieve the firm's business objectives.

Job responsibilities

  • Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
  • Develops secure high-quality production code, and reviews and debugs code written by others
  • Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems
  • Leads evaluation sessions with external vendors, startups, and internal teams to drive outcomes-oriented probing of architectural designs, technical credentials, and applicability for use within existing systems and information architecture
  • Leads communities of practice across Software Engineering to drive awareness and use of new and leading-edge technologies
  • Adds to team culture of diversity, opportunity, inclusion, and respect

Required qualifications, capabilities, and skills

  • Formal training or certification on software engineering concepts and 5+ years applied experience
  • Hands-on practical experience in system design, application development, testing, and operational stability
  • Advanced hands-on capability coding in one or more data engineering languages / platforms - Python / PySpark / Databricks or similar
  • Proficiency in automation and continuous delivery methods
  • Proficient in all aspects of the Software Development Life Cycle
  • Advanced understanding of agile methodologies such as CI / CD, Application Resiliency, and Security
  • Demonstrated proficiency in software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)
  • In-depth knowledge of the financial services industry and their IT systems
  • Practical cloud native experience

    Preferred qualifications, capabilities, and skills

  • Exposure to cloud technologies Databricks, AWS MSK, EC2, EKS, S3, RDS, Lambdas
  • Exposure to payment domain streaming systems
  • Exposure to payment regulatory reporting
  • Skills Required

    S3, Databricks, Cloud Technologies, Agile Methodologies, Pyspark, Rds, Aws, Automation, Python, Continuous Delivery, Software Development Life Cycle, Ec2

    Create a job alert for this search

    Lead Data Engineer • Bengaluru / Bangalore

    Related jobs
    Data Engineer (AWS / PySpark)

    Data Engineer (AWS / PySpark)

    Tata Consultancy Services • Bengaluru, Republic Of India, IN
    TCS is Hiring Data Engineer+AWS Pyspark For Hyderabad, Bangalore, Chennai location.AWS Pyspark / Python / Hive -Primary.AWS Glue, Lambda, Athena-Secondary. Good hands-on experience in Python programmin...Show more
    Last updated: 6 days ago • Promoted
    Big Data Engineer (AWS, PySpark)

    Big Data Engineer (AWS, PySpark)

    Atyeti Inc • Bengaluru, Republic Of India, IN
    Proficient with Python, PySpark and Airflow.Strong understanding of Object-Oriented Programming and Functional Programming paradigm. Must have experience working with Spark and its architecture.Know...Show more
    Last updated: 9 days ago • Promoted
    Data Engineer

    Data Engineer

    Stackave Solutions • Bengaluru, Karnataka, India
    Location : Pune, Gurgaon, Bangalore, Chennai.Pyspark, SQL, ETL, AWS,Glue, Unix, DW concept.Good Understanding of Cloud, Hadoop and DW concepts. Hands on experience in Pyspark and strong knowledge on ...Show more
    Last updated: 10 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Atyeti Inc • Bengaluru, Karnataka, India
    Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform. Build and maintain all facets of Data Pipel...Show more
    Last updated: 10 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • Bengaluru, India
    We're hiring for Tata consultancy services.Mode of Hire : Fulltime / Permanent / FTE.Interview date - 22nd November 2025 (Saturday). NOTE : "Only candidates who can attend the Walk-in on 22nd November ar...Show more
    Last updated: 30+ days ago • Promoted
    AWS Lead Data engineer

    AWS Lead Data engineer

    Tata Consultancy Services • Bengaluru, Karnataka, India
    In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show more
    Last updated: 22 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Emids • Bengaluru, Karnataka, India
    We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible fo...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Stackave Solutions • Bengaluru, Republic Of India, IN
    Location : Pune, Gurgaon, Bangalore, Chennai.Pyspark, SQL, ETL, AWS,Glue, Unix, DW concept.Good Understanding of Cloud, Hadoop and DW concepts. Hands on experience in Pyspark and strong knowledge on ...Show more
    Last updated: 9 days ago • Promoted
    AWS Data Solutions Engineer

    AWS Data Solutions Engineer

    LTIMindtree • Bengaluru, Republic Of India, IN
    We are Hiring for "AWS Data Engineer" With "LTI Mindtree" FTE.AWS Glue, Python ,ETL, Aws S3 and services.Interested Candidate share CV On neha.Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    L&T Technology Services • Bengaluru, Karnataka, India
    PySpark, SQL, AWS and good to have Pandas.Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer (PySpark)

    AWS Data Engineer (PySpark)

    Atyeti Inc • Bengaluru, India
    Proficient with Python, PySpark and Airflow.Strong understanding of Object-Oriented Programming and Functional Programming paradigm. Must have experience working with Spark and its architecture.Know...Show more
    Last updated: 9 days ago • Promoted
    Lead Data Engineer (AWS Cloud Development, Python)

    Lead Data Engineer (AWS Cloud Development, Python)

    S&P Global • Bengaluru, Karnataka, India
    This job is with S&P Global, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.About the Rol...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer - ETL / ELT Pipelines

    AWS Data Engineer - ETL / ELT Pipelines

    Xpheno • Bangalore
    Job Overview : We are seeking an experienced Data Engineer with strong hands-on expertise in AWS data services, PySpark, Databricks, and orchestration tools.The ideal candidate...Show more
    Last updated: 12 days ago • Promoted
    Data Engineer (AWS, ETL)

    Data Engineer (AWS, ETL)

    Live Connections • Bengaluru, Republic Of India, IN
    Show more
    Last updated: 7 days ago • Promoted
    Data Engineer(Azure / AWS / OCI, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS / OCI, Python / Pyspark, SQL)

    Sail Analytics • Bengaluru, Karnataka, India
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift) Minimum Qualifications Bachelo...Show more
    Last updated: 3 days ago • Promoted
    AWS Data Solutions Lead

    AWS Data Solutions Lead

    Tata Consultancy Services • Bengaluru, Republic Of India, IN
    In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Bengaluru, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Bengaluru, Karnataka, India
    TCS is Hiring Data Engineer+AWS Pyspark For Hyderabad, Bangalore, Chennai location.AWS Pyspark / Python / Hive -Primary.AWS Glue, Lambda, Athena-Secondary. Good hands-on experience in Python programmin...Show more
    Last updated: 30+ days ago • Promoted