Strong knowledge of DB connectivity, data loading , transformation, calculation.
Extensive experience in Pandas / Numpy dataframes, slicing, data wrangling, aggregations.
Lambda Functions, Decorators.
Vector operations on Pandas dataframes / series.
Application of applymap, apply, map functions.
Concurrency and error handling data pipeline batch of size [1-10 gb].
Ability to understand business requirements and translate them into technical requirements.
Ability to design architecture of data pipeline for concurrent data processing.
Familiar with creating / designing RESTful services and APIs.
Familiar with application unit tests.
Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services.
Debugging application.
Nice to have
Knowledge of web backend technology
Django, Python, PostgreSQL.
Apache Airflow
Atlassian Jira
Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus
Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus
Create a job alert for this search
Pyspark Developer • Bengaluru, Karnataka, India
Related jobs
Promoted
New!
Senior Go Developer
VisionPlusBengaluru, Karnataka, India
Developer – API Development to join our Bangalore office.This individual will play a key role in developing, maintaining, and scaling the APIs that power VisionPlus’ crypto payment system.You will ...Show moreLast updated: 5 hours ago
We’re hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and / or in the cloud.
You should know how to write production-grade Spark application...Show moreLast updated: 6 hours ago
Promoted
New!
Pyspark Architect
Saaki Argus & Averil Consultingbangalore, India
A global IT services and consulting company specializing in digital transformation, cloud services, and automation solutions.
Mumbai, Pune, Chennai, Bangalore & Noida.Proven experience as a Technica...Show moreLast updated: 6 hours ago
Promoted
New!
Senior Python Azure developer with PySparks ( AWS to Azure Migration expert)
ScaleneWorksbangalore, India
Python Azure developer ( AWS to Azure Migration expert).Hands-on experience with Azure, Serverless (Azure Functions).AWS to Azure Cloud Migration (Preferred).
Nice to have : Experience in Databricks ...Show moreLast updated: 6 hours ago
Promoted
New!
Senior Python Developer
Destm TechnologiesBangalore, IN
We’re looking for a talented and motivated Python Developer who has strong experience with both FastAPI and Django, and a solid command over MongoDB.
You’ll play a key role in developing scalable ba...Show moreLast updated: 5 hours ago
Promoted
New!
PySpark Developer
CGIbangalore, India
At CGI, we’re a team of builders.We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries.Founded in ,...Show moreLast updated: 6 hours ago
Promoted
Pyspark designer
Tata Consultancy ServicesBengaluru, Karnataka, India
We are looking for an experienced PySpark AWS Cloud Designer / Developer with a strong background in data integration and ETL.
The ideal candidate will have : .Over 5 years’ experience designing and dev...Show moreLast updated: 1 day ago
Promoted
New!
Senior Python Developer
Andor TechBengaluru, Karnataka, India
Hiring : Senior Python Developer (L6) – Immediate Joiners Only.AI / LLM integration for a global retail product company.This is a high-impact role combining system design, engineering excellence, and ...Show moreLast updated: 5 hours ago
Promoted
New!
Pyspark Architect
Talent Worxbangalore, India
Job Description : PySpark Architect.Location : Bangalore,Pune,Kolkata.Experience Required : 7 to 13 Years.We are seeking a highly skilled and motivated PySpark Manager to lead our data.The ideal candi...Show moreLast updated: 6 hours ago
Promoted
New!
Senior Python Developer
Michael Pagebangalore, India
Fast track growth & PnL ownership.Our client is a renowned name in the B2B food-tech space.Proficiency in designing and building REST APIs.
Strong understanding of any Cloud platforms such as - GCP / ...Show moreLast updated: 6 hours ago
Promoted
New!
Senior Python Developer
Epambangalore, India
RESTful APIs for seamless communication between different components.In this role, you will be responsible for developing and maintaining microservices architecture using containerization tools suc...Show moreLast updated: 6 hours ago
Promoted
New!
Python Pyspark Lead
Virtusabangalore, India
Python Pyspark Lead - CREQ Description Design and develop on Hadoop applications,.Hands on in developing Jobs in pySpark with Python / SCALA (Preferred) or Java / SCALA.
Experience on Core Java, Expe...Show moreLast updated: 6 hours ago
Promoted
New!
Senior Python developer
DMAIC Academy & ConsultancyBangalore, IN
Designing, implementing, and maintaining web applications that meet the needs of our.Focus on engineering best practices and continuous improvement, and have lots of business.Excellent knowledge of...Show moreLast updated: 5 hours ago
Promoted
New!
Senior Python Developer
AscendionBengaluru, Karnataka, India
Notice Period : Immediate to 20 days.Skills : Python, AWS, infrastructure.Show moreLast updated: 5 hours ago
Promoted
New!
Pyspark Developer
Tiger Analyticsbangalore, India
Tiger Analytics is a global analytics consulting firm.With data and technology at the core of our solutions, we are solving some of the toughest problems out there.
Our culture is modeled around exp...Show moreLast updated: 6 hours ago
Promoted
Pyspark Developer
Tata Consultancy ServicesBengaluru, Karnataka, India
Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI / CD.
Hyderabad, Bangalore, Chennai, Kolkata, Pune.Data Engineer, Python devel...Show moreLast updated: 30+ days ago
Promoted
New!
Senior Python Developer - Flask Exp - Greenfield Role - Custom Software Development
CareerXperts ConsultingGreater Bengaluru Area, India
It is an engineering-first company focused on solving deep tech challenges.They partner with innovative organizations to build complex, scalable, and mission-critical systems.Their foundation is ro...Show moreLast updated: 5 hours ago
Promoted
New!
Big Data PySpark Developer - V
Boolean Staffing Recruitment Solutions Pvt Ltdbangalore, India
Postion - Big Data PySpark Developer.Build and optimize large-scale data processing pipelines using PySpark.Tune Spark jobs for better efficiency and cost optimization.
Collaborate with cross-functi...Show moreLast updated: 6 hours ago