No longer accepting applications

Advanced PySpark

TEKNIKOZRajkot, IN

8 days ago

Job description

Greetings from Teknikoz

Experience : 9+Years

Roles and Responsibilities

Advanced PySpark (Expert Level - Required)

Mastery of DataFrame APIs and Spark SQL
Performance tuning : broadcast joins, caching strategies, shuffle reduction
Handling skewed data and optimizing wide transformations
Writing scalable, testable PySpark code with modular design

Databricks Expertise (Expert Level - Required)

Cluster sizing, autoscaling, and spot instance optimization

Job orchestration using Workflows with retries, alerts, and dependencies

Delta Lake :

OPTIMIZE with Z-Ordering

MERGE operations and schema evolution

Time travel and versioning

Use of Unity Catalog for data governance and access control

Monitoring via Databricks metrics and audit logs

PostgreSQL (Required)

Query profiling and execution plan analysis

Indexing strategies for analytical workloads

Table partitioning and parallel query execution

Create a job alert for this search

Pyspark • Rajkot, IN

Related jobs

Promoted

AWS Data Engineer

TerraGiGRajkot, IN

Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 8 days ago

Promoted

Senior AppDynamics Observability SME

Dexian IndiaRajkot, Gujarat, India

Position Title : Senior AppDynamics Observability SME.Required Qualifications : • 8+ years of experience in IT operations, system administration, or engineering • 3 + years experience leading people ...Show moreLast updated: 4 days ago

Promoted

Senior Analytics Support Engineer (GA4 | GTM | Looker | Tableau | SQL | AWS)

Sky Systems, Inc. (SkySys)Rajkot, IN

Senior Analytics Support Engineer.Full-Time Contract (40hrs / week).Hybrid (2x days onsite) in Bangalore, India.We’re looking for a skilled Analytics Support Engineer experienced in.GA4, GTM, Looker,...Show moreLast updated: 8 days ago

Promoted

Senior Engineer - Software (Python)

PramanaRajkot, IN

Cambridge, MA (USA), with R&D and manufacturing sites in Bangalore (India), Rochester (MN, USA) and Toronto (Canada).Pramana was established in 2021 as a spin-off from Nference.Pramana’s vision is ...Show moreLast updated: 30+ days ago

Promoted

Senior Software Engineer - Python

PICWA IndiaRajkot, IN

For an Australian ASX listed MedTech company.We're looking for a Python Engineer with 10+ years of experience and expertise in Flask. Years of Python, particularly Flask Framework experience .Servic...Show moreLast updated: 8 days ago

Promoted

Full Stack Engineer

Diligente Technologiesrajkot, India

Two rounds ( each ~ 30 to 45 mins, also includes coding ).On daily basis, 4 : 30 PM-1 : 30 AM IST.May get extended in case of prod issues. Big Data : Scala, Databricks, Spark SQL, Spark Streaming, Python...Show moreLast updated: 11 days ago

Promoted

AS400 / SYNON

CognizantRajkot, IN

Design, develop, test, and implement applications on AS / 400.Work with RPG IV, RPGLE, CL, and DB2 / 400 for development and support. Analyze user requirements and business processes to develop effectiv...Show moreLast updated: 8 days ago

Promoted

Senior Data Engineer

Straiverajkot, India

The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 11 days ago

Promoted

Python AWS Data Engineer

Digitrix Software LLPRajkot, IN

Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago

Promoted

Senior SAS Programmer (FSP & non FSP)

CytelRajkot, IN

Working fully embedded within one of our pharmaceutical clients, with the support of Cytel right behind you, you'll be at the heart of our client's innovation. As a Senior Statistical Programmer you...Show moreLast updated: 10 days ago

Promoted

Mongo DBA

Tata Consultancy ServicesRajkot, IN

Location : Gurgaon, Noida, Bangalore, Bhubaneswar, Hyderabad, kochi, Pune.As an individual contributor, will be involved with Development and Operations of a framework that caters to automating Mon...Show moreLast updated: 18 days ago

Promoted

Senior AWS Data Engineer

CYAN360Rajkot, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Sap Advanced Business Application Programming Consultant

ARA Resources Pvt. Ltd.rajkot, India

ARA’s client TechGlobal (pseudonym) is a global leader in strategy, technology consulting and digital services, enabling clients in more than 100+ countries to implement cutting edge solutions in t...Show moreLast updated: 11 days ago

Promoted

Data Engineer

VeraxionRajkot, IN

Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 8 days ago

Promoted

Python Software Architect

ConcentrixRajkot, IN

A new breed of tech company — Human-centered.We create game-changing solutions across the enterprise, that help brands grow across the world and into the future. We are trusted by clients across all...Show moreLast updated: 18 days ago

Promoted

Platform Engineer – Python / Databricks / Notebooks / Kubernetes

SyntasaRajkot, IN

Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show moreLast updated: 7 days ago

Promoted

Applications Administrator

Sikich IndiaRajkot, IN

Sikich India is seeking an Applications Administrator who will be responsible for ensuring the company has technical support for our Oracle HCM and ERP clouds, associated external applications, and...Show moreLast updated: 27 days ago

Promoted

Sap Advanced Business Application Programming Developer

DroisysRajkot, IN

Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agil...Show moreLast updated: 30+ days ago