Strong knowledge of DB connectivity, data loading , transformation, calculation.
Extensive experience in Pandas / Numpy dataframes, slicing, data wrangling, aggregations.
Lambda Functions, Decorators.
Vector operations on Pandas dataframes / series.
Application of applymap, apply, map functions.
Concurrency and error handling data pipeline batch of size [1-10 gb].
Ability to understand business requirements and translate them into technical requirements.
Ability to design architecture of data pipeline for concurrent data processing.
Familiar with creating / designing RESTful services and APIs.
Familiar with application unit tests.
Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services.
Debugging application.
Nice-to-Have Skills :
Knowledge of web backend technology - Django, Python, PostgreSQL.
Apache Airflow
Atlassian Jira
Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus
Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus
Languages :
English : C2 Proficient
Create a job alert for this search
Python Pyspark • Chennai, Tamil Nadu, India
Related jobs
Data Engineer
Colan Infotech Private LimitedChennai, Tamil Nadu, India
Greetings from Colan Infotech!!.Designation : Azure Data engineer with MS Fabric.Experience in Azure Microsoft Fabric Developer to design, develop, and implement scalable data solutions using Microso...Show moreLast updated: 30+ days ago
Promoted
Senior Python Data Engineer
Dexian IndiaChennai, Tamil Nadu, India
Python Data Engineer – (6 to 12 Years Experience) in Python, Pyspark,.Data warehousing, Data pipeline design.Work location : Bangalore or Chennai.
Design and develop data pipelines and ETL processes....Show moreLast updated: 2 days ago
Pyspark & Python Developer - C11 - CHENNAI / PUNE - C11
12542 Citicorp Services India Private LimitedChennai Tamil Nadu India
The Python and Pyspark Developer is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordi...Show moreLast updated: 13 days ago
Python PySpark Developer
SYNECHRONINDIA
Strong understanding of other technology platforms such as mobile, cloud, IoT, and blockchain.Knowledge of software development life cycle (SDLC) and Agile methodologies.
Work closely with cross-fun...Show moreLast updated: 30+ days ago
Exasol is the world’s fastest analytics database, trusted by the world’s most ambitious organizations.Built for speed and flexibility, it can analyze billions of rows in seconds and run high-perfor...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer - Python / PySpark
DexianChennai
Python Data : 6 to 12 Years Skills : Python, Pyspark, Data warehousing, Data pipeline design Show moreLast updated: 3 days ago
Promoted
Azure Data Engineer - Python / PySpark
AceNetChennai
About Us : AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology co...Show moreLast updated: 28 days ago
Pyspark Architect
Saaki Argus & Averil ConsultingChennai, Tamil Nadu, India
Quick Apply
A global IT services and consulting company specializing in digital transformation, cloud services, and automation solutions.
Mumbai, Pune, Chennai, Bangalore & Noida.Proven experience as a Tech...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer - Python / PySpark
Vtricks TechnologiesChennai
Job Title : Senior Data Engineer - Azure | ADF | Databricks | PySpark | AWS Location : Bangalore, Hyderabad, Chennai (Hybrid Mode) Experience Required : 5+...Show moreLast updated: 15 days ago
Promoted
PySpark Developer
Risk Resources LLPChennai
Job Description : Must-Have : - Mandatory skill : Pyspark.Big Data pipelines using PySpark, database migration, transformation...Show moreLast updated: 30+ days ago
Promoted
CDM Smith - Senior Data Engineer - Python / PySpark
CDM SMITH GLOBAL SERVICES INDIA LLPChennai
Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer with deep expertise in Databricks to join our Digital Capital tea...Show moreLast updated: 17 days ago
New!
GCP / Pyspark Developer
VDart Software Services Pvt. Ltd.Chennai, TN, India
Quick Apply
Role Description The Developer is responsible for analyzing the technical requirements and perform code changes, unit testing, facilitate integration testing, UAT, production release.Th...Show moreLast updated: 19 hours ago
Promoted
Senior ETL Developer(AWS PYSPARK)
Innova ESIChennai, Tamil Nadu, India
Location : Chennai (F2F Interview 12 / July / 2025).Skills required Senior ETL Developer : .Mandatory skills (8+ Years of experience in ETL development with 4+ Years on AWS Pyspark scripting).Experience...Show moreLast updated: 2 days ago
PySpark Developers
LTIMindtreeChennai, Tamil Nadu, India
Apache Spark, Big Data Hadoop Ecosystem, SparkSQL, Python).A good professional experience in Bigdata PySpark HIVE Hadoop PLSQL.
Good knowledge of AWS and Snowflake.Good understanding of CICD and sys...Show moreLast updated: 13 days ago
Python Developer -Reputed IT industry -Chennai, Tamil Nadu, India -4Lacs -Pooja
Seven ConsultancyChennai, Tamil Nadu, India
Understand fundamental design principles and best practices for developing REST APIs and web applications.Gather requirements, scope functionality, estimate and translate those requirements into so...Show moreLast updated: 30+ days ago
Promoted
Data Engineer - Python / PySpark
sphere ITChennai
Responsibilities : - Ability to write clean, maintainable, and robust code in Python - Understanding and expertise of software engineeri...Show moreLast updated: 21 days ago
Senior Frontend Developer React.Js, AWS / Azure
Automotive Robotics Ind Private LimitedChennai, Tamil Nadu, India
Requirement : Lead React Developer.Please share update CV to dpeddolla@arigs.This is a full-time on-site Senior Frontend UI Developer Angular / React role at ARi in Chennai.
The role will involve devel...Show moreLast updated: 13 days ago
Finacle Developer - Chennai
ValueLabsChennai, Tamil Nadu, India
Valuelabs is a leading technology company that has been revolutionizing the way businesses operate for 27 years.With over 7000+ employees across 28 office locations, we have established ourselves a...Show moreLast updated: 13 days ago