This job offer is not available in your country.
Senior Pyspark Developer
LuxoftBengaluru, Karnataka, India30+ days ago
Job description8+ years of experience in data intensive Pyspark development. Experience as a core Python developer. Experience developing Classes, OOPS, exception handling, parallel processing . Strong knowledge of DB connectivity, data loading , transformation, calculation. Extensive experience in Pandas / Numpy dataframes, slicing, data wrangling, aggregations. Lambda Functions, Decorators. Vector operations on Pandas dataframes / series. Application of applymap, apply, map functions. Concurrency and error handling data pipeline batch of size (1-10 gb). Ability to understand business requirements and translate them into technical requirements. Ability to design architecture of data pipeline for concurrent data processing. Familiar with creating / designing RESTful services and APIs. Familiar with application unit tests. Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services. Debugging application. Knowledge of web backend technology Django, Python, PostgreSQL. Apache Airflow Atlassian Jira Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus
Project description
We need a Senior Python and Pyspark Developer to work for a leading investment bank client.
Responsibilities
- Develop software applications based on business requirements
- Maintain software applications and make enhancements according to project specifications
- Participate in requirement analysis, design, development, testing, and implementation activities
- Propose new techniques and technologies for software development.
- Perform unit testing and user acceptance testing to evaluate application functionality
- Ensure to complete the assigned development tasks within the deadlines
- Work in compliance with coding standards and best practices
- Provide assistance to Junior Developers when needed.
- Perform code reviews and recommend improvements.
- Review business requirements and recommend changes to develop reliable applications.
- Develop coding documentation and other technical specifications for assigned projects.
- Act as primary contact for development queries and concerns.
- Analyze and resolve development issues accurately.
Skills
Must have
Nice to have
Create a job alert for this search
Pyspark Developer • Bengaluru, Karnataka, India
Related jobs
- Promoted
- New!
Senior Android Developer
Luxoft IndiaGreater Bengaluru Area, India Our Android Automotive IVI project is looking for a Senior Automotive HAL Developer for an agile project development team.
It is an ongoing development project for one of our OEM customers, which is...Show moreLast updated: 5 hours ago
- Promoted
Senior Manager - Data Engineering Lead
DIAGEO Indiahosur, tamil nadu, in Senior Manager - Data Engineering Lead.Bachelor’s or master’s degree in computer science, Data Engineering, or related field.
Experience in data engineering.Proven experience in cloud platforms (AWS...Show moreLast updated: 28 days ago
- Promoted
Pyspark designer
Tata Consultancy ServicesBengaluru, Karnataka, India We are looking for an experienced PySpark AWS Cloud Designer / Developer with a strong background in data integration and ETL.
The ideal candidate will have : .Over 5 years’ experience designing and dev...Show moreLast updated: 2 days ago
- Promoted
- New!
Senior Python Developer
AscendionBengaluru, Karnataka, India Notice Period : Immediate to 20 days.Skills : Python, AWS, infrastructure.Show moreLast updated: 5 hours ago
- Promoted
Pyspark Developer
Tata Consultancy ServicesBengaluru, Karnataka, India Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI / CD.
Hyderabad, Bangalore, Chennai, Kolkata, Pune.Data Engineer, Python devel...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior Python Developer - Flask Exp - Greenfield Role - Custom Software Development
CareerXperts ConsultingGreater Bengaluru Area, India It is an engineering-first company focused on solving deep tech challenges.They partner with innovative organizations to build complex, scalable, and mission-critical systems.Their foundation is ro...Show moreLast updated: 5 hours ago
- Promoted
Senior LogicMonitor Developer
iVedha Inc.hosur, tamil nadu, in Job Title : Senior LogicMonitor Developer.Platform Engineering Practice is looking for a.API-based integration and automation.
In this role, you will lead the design and implementation of monitoring ...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Deltacubeshosur, tamil nadu, in Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect.
Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 17 days ago
- Promoted
Senior Backend Developer
StealthBengaluru, IN Fintech Unicorn seeking backend engineers who love building systems that millions trust with their money.Your code directly affects millions of users' financial lives - from seamless payments to sm...Show moreLast updated: 6 days ago
- Promoted
Senior Technical Lead
PerfiosBengaluru, Karnataka, India We are seeking a seasoned Senior Technical Lead to drive the efforts of a dynamic, high-performing team of engineers responsible for developing and operating enterprise-grade platforms leveraging J...Show moreLast updated: 30+ days ago
- Promoted
Senior Developer
Datacore Technologieshosur, tamil nadu, in Required Skills for Role for Sr.Grafana - at least 6+ Years of experience in administering Grafana and create dashboards and alerts.
Requires expertise on skill set for below Create dashboards in Gr...Show moreLast updated: 8 days ago
- Promoted
SDE 3 (Python)
LearnTube.aihosur, tamil nadu, in In 2024, Google selected LearnTube for its AI First Accelerator, further fueling our growth.Alongside investment from funds of visionaries like Reid Hoffman and Naval Ravikant, we set out on a miss...Show moreLast updated: 7 days ago
- Promoted
Senior Cloud Engineer AWS
Matrix USAhosur, tamil nadu, in We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 6 days ago
- Promoted
Senior Developer
Tata Consultancy Servicesbangalore, karnataka, in Thank you for expressing your interest in exploring a career possibility with the TCS Family.Jenkins, Gitlab, Github Actions.
AWS, Azure or GCP) and services like Sagemaker, AzureML, Vertex AI.Nice ...Show moreLast updated: 30+ days ago
- Promoted
Senior Developer
HCLTechhosur, tamil nadu, in Notice Period : Immediate Joiner is Preferred.Remote (may be Hybrid later, demand basis – client location.Chennai, Bangalore , Hyderabad.
If interested, kindly revert this mail with the details in t...Show moreLast updated: 30+ days ago
- Promoted
Senior Backend Developer
VisionPlusBengaluru, Karnataka, India Developer – API Development to join our Bangalore office.This individual will play a key role in developing, maintaining, and scaling the APIs that power VisionPlus’ crypto payment system.You will ...Show moreLast updated: 8 days ago
- Promoted
- New!
Senior Go Developer
VisionPlusBengaluru, Karnataka, India Developer – API Development to join our Bangalore office.This individual will play a key role in developing, maintaining, and scaling the APIs that power VisionPlus’ crypto payment system.You will ...Show moreLast updated: 5 hours ago
- Promoted
Senior ETL Developer
BCE Global TechBengaluru, Karnataka, India At BCE Global Tech, immerse yourself in exciting projects that are shaping the future of both consumer and enterprise telecommunications.
This involves building innovative mobile apps to enhance use...Show moreLast updated: 26 days ago