Strong knowledge of DB connectivity, data loading , transformation, calculation.
Extensive experience in Pandas / Numpy dataframes, slicing, data wrangling, aggregations.
Lambda Functions, Decorators.
Vector operations on Pandas dataframes / series.
Application of applymap, apply, map functions.
Concurrency and error handling data pipeline batch of size [1-10 gb].
Ability to understand business requirements and translate them into technical requirements.
Ability to design architecture of data pipeline for concurrent data processing.
Familiar with creating / designing RESTful services and APIs.
Familiar with application unit tests.
Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services.
Debugging application.
Nice-to-Have Skills :
Knowledge of web backend technology - Django, Python, PostgreSQL.
Apache Airflow
Atlassian Jira
Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus
Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus
Languages :
English : C2 Proficient
Create a job alert for this search
Python Pyspark • Chennai, Tamil Nadu, India
Related jobs
Data Engineer
Colan Infotech Private LimitedChennai, Tamil Nadu, India
Greetings from Colan Infotech!!.Designation : Azure Data engineer with MS Fabric.Experience in Azure Microsoft Fabric Developer to design, develop, and implement scalable data solutions using Microso...Show moreLast updated: 30+ days ago
Promoted
Senior Pyspark Developer [1 month NP max required]
LuxoftChennai, Tamil Nadu, India
We need a Senior Python and Pyspark Developer to work for a leading investment bank client.Develop software applications based on business requirements.
Maintain software applications and make enhan...Show moreLast updated: 30+ days ago
Pyspark & Python Developer - C11 - CHENNAI / PUNE - C11
12542 Citicorp Services India Private LimitedChennai Tamil Nadu India
The Python and Pyspark Developer is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordi...Show moreLast updated: 13 days ago
Python PySpark Developer
SYNECHRONINDIA
Strong understanding of other technology platforms such as mobile, cloud, IoT, and blockchain.Knowledge of software development life cycle (SDLC) and Agile methodologies.
Work closely with cross-fun...Show moreLast updated: 30+ days ago
Exasol is the world’s fastest analytics database, trusted by the world’s most ambitious organizations.Built for speed and flexibility, it can analyze billions of rows in seconds and run high-perfor...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer - Python / PySpark
DexianChennai
Python Data : 6 to 12 Years Skills : Python, Pyspark, Data warehousing, Data pipeline design Show moreLast updated: 3 days ago
Promoted
Azure Databricks Engineer - Python / PySpark
optimum solutionsChennai
We are seeking a skilled and experienced Azure Databricks Engineer to join our growing data engineering team.The ideal candidate will have deep hands-on expertise in building scalable data pipeline...Show moreLast updated: 4 days ago
Promoted
Azure Data Engineer - Python / PySpark
AceNetChennai
About Us : AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology co...Show moreLast updated: 29 days ago
GEN AI
VirtusaChennai
GEN AI - CREQ185676 Description Extensive implementation experience in data analytics space or a senior developer role in one of the modern technology stack Excellent programming skills and profici...Show moreLast updated: 30+ days ago
Pyspark Architect
Saaki Argus & Averil ConsultingChennai, Tamil Nadu, India
Quick Apply
A global IT services and consulting company specializing in digital transformation, cloud services, and automation solutions.
Mumbai, Pune, Chennai, Bangalore & Noida.Proven experience as a Tech...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer - Python / PySpark
Vtricks TechnologiesChennai
Job Title : Senior Data Engineer - Azure | ADF | Databricks | PySpark | AWS Location : Bangalore, Hyderabad, Chennai (Hybrid Mode) Experience Required : 5+...Show moreLast updated: 15 days ago
Promoted
PySpark Developer
Risk Resources LLPChennai
Job Description : Must-Have : - Mandatory skill : Pyspark.Big Data pipelines using PySpark, database migration, transformation...Show moreLast updated: 30+ days ago
Promoted
CDM Smith - Senior Data Engineer - Python / PySpark
CDM SMITH GLOBAL SERVICES INDIA LLPChennai
Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer with deep expertise in Databricks to join our Digital Capital tea...Show moreLast updated: 17 days ago
Junior Python Developer
Arting Digital Private LimitedChennai, TN, in
Quick Apply
Job Title : Junior Python Developer.Skills set : Python development, astAPI or similar Python web frameworks, PostgreSQL, MongoDB, Git.
Develop and maintain Python scripts for automati...Show moreLast updated: 14 days ago
Senior ETL Developer(AWS PYSPARK)
Innova ESIChennai, Tamil Nadu, India
Location : Chennai (F2F Interview 12 / July / 2025).Skills required Senior ETL Developer : .Mandatory skills (8+ Years of experience in ETL development with 4+ Years on AWS Pyspark scripting).Experience...Show moreLast updated: 2 days ago
GCP / Pyspark Developer
VDart Software Services Pvt. Ltd.Chennai, TN, India
Quick Apply
Role Description The Developer is responsible for analyzing the technical requirements and perform code changes, unit testing, facilitate integration testing, UAT, production release.Th...Show moreLast updated: 1 day ago
Python Developer -Reputed IT industry -Chennai, Tamil Nadu, India -4Lacs -Pooja
Seven ConsultancyChennai, Tamil Nadu, India
Understand fundamental design principles and best practices for developing REST APIs and web applications.Gather requirements, scope functionality, estimate and translate those requirements into so...Show moreLast updated: 30+ days ago
Promoted
Data Engineer - Python / PySpark
sphere ITChennai
Responsibilities : - Ability to write clean, maintainable, and robust code in Python - Understanding and expertise of software engineeri...Show moreLast updated: 22 days ago
Senior Frontend Developer React.Js, AWS / Azure
Automotive Robotics Ind Private LimitedChennai, Tamil Nadu, India
Requirement : Lead React Developer.Please share update CV to dpeddolla@arigs.This is a full-time on-site Senior Frontend UI Developer Angular / React role at ARi in Chennai.
The role will involve devel...Show moreLast updated: 14 days ago
Data Engineer
Tata Consultancy ServicesChennai, Tamil Nadu, India
TCS present an excellent opportunity for Data Engineer.Experience required : 5-12 yrs.Skills : Apache Spark, Python, PySpark, Java, GCP BQ,BIG Data, Python, SQL, PySpark GCP.Walk in Interview date : ...Show moreLast updated: 14 days ago