Talent.com
This job offer is not available in your country.
Senior Python and Pyspark developer_Chennai

Senior Python and Pyspark developer_Chennai

LuxoftChennai, Tamil Nadu, India
2 days ago
Job description

Mandatory Skills Description :

  • 8+ years of experience in data intensive python development.
  • Proven experience as a core Python and Pyspark developer.
  • Experience developing Classes, OOPS, exception handling, parallel processing .
  • Strong knowledge of DB connectivity, data loading , transformation, calculation.
  • Extensive experience in Pandas / Numpy dataframes, slicing, data wrangling, aggregations.
  • Lambda Functions, Decorators.
  • Vector operations on Pandas dataframes / series.
  • Application of applymap, apply, map functions.
  • Concurrency and error handling data pipeline batch of size [1-10 gb].
  • Ability to understand business requirements and translate them into technical requirements.
  • Ability to design architecture of data pipeline for concurrent data processing.
  • Familiar with creating / designing RESTful services and APIs.
  • Familiar with application unit tests.
  • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services.
  • Debugging application.

Nice-to-Have Skills :

  • Knowledge of web backend technology - Django, Python, PostgreSQL.
  • Apache Airflow
  • Atlassian Jira
  • Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus
  • Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus
  • Languages :

    English : C2 Proficient

    Create a job alert for this search

    Python Pyspark • Chennai, Tamil Nadu, India

    Related jobs
    Data Engineer

    Data Engineer

    Colan Infotech Private LimitedChennai, Tamil Nadu, India
    Greetings from Colan Infotech!!.Designation : Azure Data engineer with MS Fabric.Experience in Azure Microsoft Fabric Developer to design, develop, and implement scalable data solutions using Microso...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    Dexian IndiaChennai, Tamil Nadu, India
    Python Data Engineer – (6 to 12 Years Experience) in Python, Pyspark,.Data warehousing, Data pipeline design.Work location : Bangalore or Chennai. Design and develop data pipelines and ETL processes....Show moreLast updated: 2 days ago
    Pyspark & Python Developer - C11 - CHENNAI / PUNE - C11

    Pyspark & Python Developer - C11 - CHENNAI / PUNE - C11

    12542 Citicorp Services India Private LimitedChennai Tamil Nadu India
    The Python and Pyspark Developer is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordi...Show moreLast updated: 13 days ago
    Python PySpark Developer

    Python PySpark Developer

    SYNECHRONINDIA
    Strong understanding of other technology platforms such as mobile, cloud, IoT, and blockchain.Knowledge of software development life cycle (SDLC) and Agile methodologies. Work closely with cross-fun...Show moreLast updated: 30+ days ago
    Senior Software Engineer, Developer Productivity (Python / Go) - Chennai, India.

    Senior Software Engineer, Developer Productivity (Python / Go) - Chennai, India.

    ExasolChennai, Tamil Nadu, IN
    Quick Apply
    Exasol is the world’s fastest analytics database, trusted by the world’s most ambitious organizations.Built for speed and flexibility, it can analyze billions of rows in seconds and run high-perfor...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Python / PySpark

    Senior Data Engineer - Python / PySpark

    DexianChennai
    Python Data : 6 to 12 Years Skills : Python, Pyspark, Data warehousing, Data pipeline design Show moreLast updated: 3 days ago
    • Promoted
    Azure Data Engineer - Python / PySpark

    Azure Data Engineer - Python / PySpark

    AceNetChennai
    About Us : AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology co...Show moreLast updated: 28 days ago
    Pyspark Architect

    Pyspark Architect

    Saaki Argus & Averil ConsultingChennai, Tamil Nadu, India
    Quick Apply
    A global IT services and consulting company specializing in digital transformation, cloud services, and automation solutions. Mumbai, Pune, Chennai, Bangalore & Noida.Proven experience as a Tech...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Python / PySpark

    Senior Data Engineer - Python / PySpark

    Vtricks TechnologiesChennai
    Job Title : Senior Data Engineer - Azure | ADF | Databricks | PySpark | AWS Location : Bangalore, Hyderabad, Chennai (Hybrid Mode) Experience Required : 5+...Show moreLast updated: 15 days ago
    • Promoted
    PySpark Developer

    PySpark Developer

    Risk Resources LLPChennai
    Job Description : Must-Have : - Mandatory skill : Pyspark.Big Data pipelines using PySpark, database migration, transformation...Show moreLast updated: 30+ days ago
    • Promoted
    CDM Smith - Senior Data Engineer - Python / PySpark

    CDM Smith - Senior Data Engineer - Python / PySpark

    CDM SMITH GLOBAL SERVICES INDIA LLPChennai
    Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer with deep expertise in Databricks to join our Digital Capital tea...Show moreLast updated: 17 days ago
    • New!
    GCP / Pyspark Developer

    GCP / Pyspark Developer

    VDart Software Services Pvt. Ltd.Chennai, TN, India
    Quick Apply
    Role Description The Developer is responsible for analyzing the technical requirements and perform code changes, unit testing, facilitate integration testing, UAT, production release.Th...Show moreLast updated: 19 hours ago
    • Promoted
    Senior ETL Developer(AWS PYSPARK)

    Senior ETL Developer(AWS PYSPARK)

    Innova ESIChennai, Tamil Nadu, India
    Location : Chennai (F2F Interview 12 / July / 2025).Skills required Senior ETL Developer : .Mandatory skills (8+ Years of experience in ETL development with 4+ Years on AWS Pyspark scripting).Experience...Show moreLast updated: 2 days ago
    PySpark Developers

    PySpark Developers

    LTIMindtreeChennai, Tamil Nadu, India
    Apache Spark, Big Data Hadoop Ecosystem, SparkSQL, Python).A good professional experience in Bigdata PySpark HIVE Hadoop PLSQL. Good knowledge of AWS and Snowflake.Good understanding of CICD and sys...Show moreLast updated: 13 days ago
    Python Developer -Reputed IT industry -Chennai, Tamil Nadu, India -4Lacs -Pooja

    Python Developer -Reputed IT industry -Chennai, Tamil Nadu, India -4Lacs -Pooja

    Seven ConsultancyChennai, Tamil Nadu, India
    Understand fundamental design principles and best practices for developing REST APIs and web applications.Gather requirements, scope functionality, estimate and translate those requirements into so...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / PySpark

    Data Engineer - Python / PySpark

    sphere ITChennai
    Responsibilities : - Ability to write clean, maintainable, and robust code in Python - Understanding and expertise of software engineeri...Show moreLast updated: 21 days ago
    Senior Frontend Developer React.Js, AWS / Azure

    Senior Frontend Developer React.Js, AWS / Azure

    Automotive Robotics Ind Private LimitedChennai, Tamil Nadu, India
    Requirement : Lead React Developer.Please share update CV to dpeddolla@arigs.This is a full-time on-site Senior Frontend UI Developer Angular / React role at ARi in Chennai. The role will involve devel...Show moreLast updated: 13 days ago
    Finacle Developer - Chennai

    Finacle Developer - Chennai

    ValueLabsChennai, Tamil Nadu, India
    Valuelabs is a leading technology company that has been revolutionizing the way businesses operate for 27 years.With over 7000+ employees across 28 office locations, we have established ourselves a...Show moreLast updated: 13 days ago