Strong knowledge of DB connectivity, data loading , transformation, calculation.
Extensive experience in Pandas / Numpy dataframes, slicing, data wrangling, aggregations.
Lambda Functions, Decorators.
Vector operations on Pandas dataframes / series.
Application of applymap, apply, map functions.
Concurrency and error handling data pipeline batch of size [1-10 gb].
Ability to understand business requirements and translate them into technical requirements.
Ability to design architecture of data pipeline for concurrent data processing.
Familiar with creating / designing RESTful services and APIs.
Familiar with application unit tests.
Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services.
Debugging application.
Nice-to-Have Skills
Knowledge of web backend technology
Django, Python, PostgreSQL.
Apache Airflow
Atlassian Jira
Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus
Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus
Create a job alert for this search
Pyspark Developer • Bengaluru, Karnataka, India
Related jobs
Promoted
Senior Python Developer
Destm TechnologiesBangalore, IN
We’re looking for a talented and motivated Python Developer who has strong experience with both FastAPI and Django, and a solid command over MongoDB.
You’ll play a key role in developing scalable ba...Show moreLast updated: 30+ days ago
Promoted
Hybris developer
Brace Infotech Private LtdGreater Bengaluru Area, India
Desired Skills and Experience – Hybris Sr Developer.Technology consultant with an experience of 7 plus years of which minimum 5 years.
Strong experience & background in Java development (Spring, Aja...Show moreLast updated: 8 days ago
Promoted
GCP Data Architect
Tata Consultancy Serviceshosur, tamil nadu, in
Job Title : - GCP Data Architect.Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and co...Show moreLast updated: 19 days ago
Promoted
Senior Pyspark Developer
LuxoftBengaluru, Karnataka, India
We need a Senior Python and Pyspark Developer to work for a leading investment bank client.Develop software applications based on business requirements.
Maintain software applications and make enhan...Show moreLast updated: 30+ days ago
Promoted
Senior Scala / Spark Developer
Cyanous Software Private LimitedBangalore
Key Responsibilities : - Design, develop, and maintain data processing applications using Scala and Apache Spark.Collaborate with cross-functional ...Show moreLast updated: 30+ days ago
Promoted
Senior Backend Developer
AthlitixBangalore, IN
To apply, please complete the form at : https : / / forms.Only applications submitted through this link will be considered.
Join our team to drive meaningful impact with significant ownership and creativ...Show moreLast updated: 11 days ago
Promoted
Senior Python Developer (with (CrewAI)
LuxoftBengaluru, Karnataka, India
We're seeking a strong and creative Software Engineer eager to solve challenging problems of scale and work on cutting edge technologies.
In this project, you will have the opportunity to write code...Show moreLast updated: 16 days ago
Promoted
Pyspark developer
Tata Consultancy ServicesBengaluru, Karnataka, India
Virtual Interview Date-11th October 2025.Desired Experience : 4-11 years.Bangalore / Chennai / Hyderabad.Big Data, Hadoop, Spark, Hive ,Pyspark.
Must Have Technical Qualifications : .Ability to design ...Show moreLast updated: 19 days ago
Promoted
Senior Engineer
BrillioBangalore Urban, Karnataka, India
Senior Python Developer( Contract to Hire).Logstash alternatives, custom ETL pipelines.AWS, GCP, Azure) for log retrieval and monitoring automation.
Experience with streaming data frameworks (Kafka,...Show moreLast updated: 19 days ago
Promoted
Senior Python Full-Stack Developer (Python+React)
LuxoftGreater Bengaluru Area, India
We have an ambitious goal to migrate a legacy system written in HLASM (High-Level Assembler) from the mainframe to a cloud-based Java environment for one of the largest banks in the USA.We are look...Show moreLast updated: 16 days ago
Promoted
Senior Serdes Architect
Mulya TechnologiesGreater Bengaluru Area, India
Senior SerDes Architect and Lead.About Omni Design Technologies.Omni Design Technologies is a leading provider of high-performance, ultra-low power IP cores, from 28nm down through advanced FinFET ...Show moreLast updated: 27 days ago
Promoted
Senior Python Developer
Aarav SolutionsBengaluru, Karnataka, India
Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show moreLast updated: 14 days ago
Promoted
Senior Python Developer
Cactus Communicationsbangalore, India
You will be a part of Cactus Labs which is the R&D Cell of Cactus Communications.Cactus Labs is a high impact cell that works to solve complex technical and business problems that help keep us stra...Show moreLast updated: 12 days ago
Promoted
Senior Snowflake Developer
Tata Consultancy ServicesGreater Bengaluru Area, India
Role : Senior Snowflake Developer.Required Technical Skill Set • •.Strong proficiency in SQL for Snowflake.Hands-on experience with Excel data handling (e.
VBA, macros, or scripting to clean and transf...Show moreLast updated: 15 days ago
Promoted
Pyspark Developer
Tata Consultancy ServicesBengaluru, Republic Of India, IN
Virtual Interview Date-11th October 2025.Desired Experience : 4-11 years.Bangalore / Chennai / Hyderabad.Big Data, Hadoop, Spark, Hive ,Pyspark.
Must Have Technical Qualifications : .Ability to design ...Show moreLast updated: 30+ days ago
Promoted
Senior Python Developer
Deutsche TelekomBangalore
Your Role : This is a Senior Python Developer position focused on developing applications, extensions, and services for NVIDIA Omniverse using OpenUSD.In thi...Show moreLast updated: 3 days ago
Promoted
Senior AI Developer
Movado Group, IncBengaluru, India
The Senior AI Developer will play a critical role in designing and developing intelligent automation solutions that integrate SAP and non-SAP data sources to address complex business challenges.The...Show moreLast updated: 27 days ago
Summary : Soliton is a high-technology software company working with the top semiconductor industries in the world, looking for a Senior Developer ...Show moreLast updated: 30+ days ago