Talent.com
This job offer is not available in your country.
Senior Pyspark Developer

Senior Pyspark Developer

LuxoftBengaluru, Karnataka, India
30+ days ago
Job description

Project description

We need a Senior Python and Pyspark Developer to work for a leading investment bank client.

Responsibilities

  • Develop software applications based on business requirements
  • Maintain software applications and make enhancements according to project specifications
  • Participate in requirement analysis, design, development, testing, and implementation activities
  • Propose new techniques and technologies for software development.
  • Perform unit testing and user acceptance testing to evaluate application functionality
  • Ensure to complete the assigned development tasks within the deadlines
  • Work in compliance with coding standards and best practices
  • Provide assistance to Junior Developers when needed.
  • Perform code reviews and recommend improvements.
  • Review business requirements and recommend changes to develop reliable applications.
  • Develop coding documentation and other technical specifications for assigned projects.
  • Act as primary contact for development queries and concerns.
  • Analyze and resolve development issues accurately.

Skills

Must have

  • 8+ years of experience in data intensive Pyspark development.
  • Experience as a core Python developer.
  • Experience developing Classes, OOPS, exception handling, parallel processing .
  • Strong knowledge of DB connectivity, data loading , transformation, calculation.
  • Extensive experience in Pandas / Numpy dataframes, slicing, data wrangling, aggregations.
  • Lambda Functions, Decorators.
  • Vector operations on Pandas dataframes / series.
  • Application of applymap, apply, map functions.
  • Concurrency and error handling data pipeline batch of size [1-10 gb].
  • Ability to understand business requirements and translate them into technical requirements.
  • Ability to design architecture of data pipeline for concurrent data processing.
  • Familiar with creating / designing RESTful services and APIs.
  • Familiar with application unit tests.
  • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services.
  • Debugging application.
  • Nice to have

  • Knowledge of web backend technology
  • Django, Python, PostgreSQL.
  • Apache Airflow
  • Atlassian Jira
  • Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus
  • Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus
  • Create a job alert for this search

    Pyspark Developer • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    • New!
    Senior Go Developer

    Senior Go Developer

    VisionPlusBengaluru, Karnataka, India
    Developer – API Development to join our Bangalore office.This individual will play a key role in developing, maintaining, and scaling the APIs that power VisionPlus’ crypto payment system.You will ...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    PySpark Scala Developer - Consultant / Senior Consultant

    PySpark Scala Developer - Consultant / Senior Consultant

    Talent Worxbangalore, India
    We’re hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and / or in the cloud. You should know how to write production-grade Spark application...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Pyspark Architect

    Pyspark Architect

    Saaki Argus & Averil Consultingbangalore, India
    A global IT services and consulting company specializing in digital transformation, cloud services, and automation solutions. Mumbai, Pune, Chennai, Bangalore & Noida.Proven experience as a Technica...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Python Azure developer with PySparks ( AWS to Azure Migration expert)

    Senior Python Azure developer with PySparks ( AWS to Azure Migration expert)

    ScaleneWorksbangalore, India
    Python Azure developer ( AWS to Azure Migration expert).Hands-on experience with Azure, Serverless (Azure Functions).AWS to Azure Cloud Migration (Preferred). Nice to have : Experience in Databricks ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Python Developer

    Senior Python Developer

    Destm TechnologiesBangalore, IN
    We’re looking for a talented and motivated Python Developer who has strong experience with both FastAPI and Django, and a solid command over MongoDB. You’ll play a key role in developing scalable ba...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    PySpark Developer

    PySpark Developer

    CGIbangalore, India
    At CGI, we’re a team of builders.We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries.Founded in ,...Show moreLast updated: 6 hours ago
    • Promoted
    Pyspark designer

    Pyspark designer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    We are looking for an experienced PySpark AWS Cloud Designer / Developer with a strong background in data integration and ETL. The ideal candidate will have : .Over 5 years’ experience designing and dev...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior Python Developer

    Senior Python Developer

    Andor TechBengaluru, Karnataka, India
    Hiring : Senior Python Developer (L6) – Immediate Joiners Only.AI / LLM integration for a global retail product company.This is a high-impact role combining system design, engineering excellence, and ...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    Pyspark Architect

    Pyspark Architect

    Talent Worxbangalore, India
    Job Description : PySpark Architect.Location : Bangalore,Pune,Kolkata.Experience Required : 7 to 13 Years.We are seeking a highly skilled and motivated PySpark Manager to lead our data.The ideal candi...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Python Developer

    Senior Python Developer

    Michael Pagebangalore, India
    Fast track growth & PnL ownership.Our client is a renowned name in the B2B food-tech space.Proficiency in designing and building REST APIs. Strong understanding of any Cloud platforms such as - GCP / ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Python Developer

    Senior Python Developer

    Epambangalore, India
    RESTful APIs for seamless communication between different components.In this role, you will be responsible for developing and maintaining microservices architecture using containerization tools suc...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Python Pyspark Lead

    Python Pyspark Lead

    Virtusabangalore, India
    Python Pyspark Lead - CREQ Description Design and develop on Hadoop applications,.Hands on in developing Jobs in pySpark with Python / SCALA (Preferred) or Java / SCALA. Experience on Core Java, Expe...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Python developer

    Senior Python developer

    DMAIC Academy & ConsultancyBangalore, IN
    Designing, implementing, and maintaining web applications that meet the needs of our.Focus on engineering best practices and continuous improvement, and have lots of business.Excellent knowledge of...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    Senior Python Developer

    Senior Python Developer

    AscendionBengaluru, Karnataka, India
    Notice Period : Immediate to 20 days.Skills : Python, AWS, infrastructure.Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    Pyspark Developer

    Pyspark Developer

    Tiger Analyticsbangalore, India
    Tiger Analytics is a global analytics consulting firm.With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around exp...Show moreLast updated: 6 hours ago
    • Promoted
    Pyspark Developer

    Pyspark Developer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI / CD. Hyderabad, Bangalore, Chennai, Kolkata, Pune.Data Engineer, Python devel...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Python Developer - Flask Exp - Greenfield Role - Custom Software Development

    Senior Python Developer - Flask Exp - Greenfield Role - Custom Software Development

    CareerXperts ConsultingGreater Bengaluru Area, India
    It is an engineering-first company focused on solving deep tech challenges.They partner with innovative organizations to build complex, scalable, and mission-critical systems.Their foundation is ro...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    Big Data PySpark Developer - V

    Big Data PySpark Developer - V

    Boolean Staffing Recruitment Solutions Pvt Ltdbangalore, India
    Postion - Big Data PySpark Developer.Build and optimize large-scale data processing pipelines using PySpark.Tune Spark jobs for better efficiency and cost optimization. Collaborate with cross-functi...Show moreLast updated: 6 hours ago