Pyspark DeveloperTata Consultancy Services • Kolkata, West Bengal, India

Pyspark Developer

Tata Consultancy Services • Kolkata, West Bengal, India

28 days ago

Job description

TCS is Hiring Pyspark Developer For Chennai, Hyderabad, Kolkata location

Experience : 6 - 10 years

Mode of interview : Virtual

Location : Chennai, Hyderabad, Kolkata

JOB DESCRIPTION : Must have :

Minimum 3 Years of experience in design, development and deployment of big data applications and ETL jobs using PySpark APIs / sparkSQL.
Experience in design, build and deployment of Python based applications.
Experience in writing complex SQL queries / procedures using Relational databases like SQL Server or Oracle
Experience in version control system like Git and CI / CD pipeline is a must.
Experience in Delta lake APIs is a plus
Experience in Docker and Kubernetes is a plus
Knowledge of AWS services like S3, Athena, Glue, Lambda, Redshift or Cloud platform is a plus

Responsibilities :

Designing, implementing, and maintaining jobs written in PySpark for extracting raw data, applying transformation, and writing into file / tables on Apache Spark cluster.

Writing complex queries as per the business rules and data extraction logic

Query tuning and Performance optimization of various components as and when required.

Work with development leads, System Architects and other teams (as needed) to manage dependencies, risks and issues.

Contributing in all phases of the development lifecycle

Support testers and defect resolution

Update status / risks / issues / impediments in daily scrum calls to the customer and track it to closure.

Writing testable, scalable and efficient code

Working on the necessary documentations as needed

Create a job alert for this search

Pyspark Developer • Kolkata, West Bengal, India

Related jobs

IBMi developer

Programmers.io • Kolkata, IN

IO is actively seeking talented individuals who are skilled in IBMi.If you're looking for a flexible work environment that allows you to contribute from anywhere, we want to hear from you.US Based ...Show more

Last updated: 30+ days ago • Promoted

Blockchain Developer

GoQuant • Kolkata, IN

SOLANA BLOCKCHAIN ENGINEER (RUST) (Paid).Job Title : Solana Blockchain Engineer - Smart Contracts & Settlement Infrastructure. Company : GoQuant Technologies Inc.Smart Contract Development (60%).Desig...Show more

Last updated: 5 days ago • Promoted

Python Automation Developer - PAN India

Concentrix • Kolkata, IN

Looking for Python Expertise with minimum 6+ years of experience with having below must have skills : .Experience in automating business processes using Python. Integrate bots with databases (SQL, Pos...Show more

Last updated: 10 days ago • Promoted

Senior Developer - ODI

KPI Partners • Kolkata, IN

Mandatory Skill : ODI, OBIEE, DWH, Python Programming, SQL.Design and develop ETL processes using Oracle Data Integrator to facilitate seamless data integration between various sources and targets....Show more

Last updated: 30+ days ago • Promoted

Lead UX Engineer / UI Developer (Java + Golang)

Publicis Sapient • Kolkata, IN

Last updated: 28 days ago • Promoted

PySpark Data Engineer

EXTRAGIG • Kolkata, IN

Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role. Execute creative software and data solutions, including des...Show more

Last updated: 30+ days ago • Promoted

Endur Developer

Techvy Corp • Kolkata, IN

We are actively looking for an experienced.You will play a critical role in designing, developing, and maintaining solutions on the Openlink Endur platform. This is a high-impact role that requires ...Show more

Last updated: 7 days ago • Promoted

Azure Data Lead / Architect

Tech Mahindra • Kolkata, IN

Role : Azure Data Lead / architect.Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault". Experience in "GIT / Jenkins / Azure DevOps".Show more

Last updated: 1 day ago • Promoted

Automation Developer

Indsafri • Kolkata, IN

Job Role : Automation Developer.Exp Required : Atleast 5 to 8 Years of relevant work experience in Java with Spring boot, Python programming language with LangChain. Notice Period : Immediate to 30 day...Show more

Last updated: 1 day ago • Promoted

Data Integration Developer (Level 2)

Blutic • Kolkata, IN

Data Integration Developer (Level 2).ETL processes, reports, and database solutions using.This role requires solid technical skills to implement solutions, optimize code, and collaborate effectivel...Show more

Last updated: 30+ days ago • Promoted

Backend Developer

Assima • Kolkata, IN

Assima is a worldwide leader in training, assistance and software adoption for Fortune 500 companies.Our patented technology is trusted by 15 of the top 20 banks, major international organizations ...Show more

Last updated: 13 days ago • Promoted

Tech Lead –.Net / Python & AI

Skillvera • Kolkata, IN

Technical Skills & Stack Requirements : .API development, and service orchestration.AWS or Azure cloud architecture.Bedrock, Lambda, ECS / EKS, Step Functions, S3, and SageMaker and Azure equivalents.U...Show more

Last updated: 17 hours ago • Promoted • New!

Edifec Developer

NR Consulting • Kolkata, IN

Location – Bangalore / HYD / Noida (Remote option available).Edifecs Transaction Manager (TM).Edifecs Healthcare Transaction Repository (HTR). SQL and RDBMS (Oracle, MySQL, SQL Server).Groovy or JavaScr...Show more

Last updated: 14 days ago • Promoted

Pyspark Developer

Tata Consultancy Services • Kolkata, West Bengal, India

TCS is Hiring Pyspark Developer For Chennai, Hyderabad, Kolkata location Experience : 6 - 10 years Mode of interview : Virtual Location : Chennai, Hyderabad, Kolkata JOB DESCRIPTION : Must hav...Show more

Last updated: 28 days ago • Promoted

Lead Systems Architect – AI Agent Orchestration (Python / Golang)

Phinite.ai • Kolkata, IN

AI Agent Orchestration Platform.A "DevOps platform for AI Agents" that standardizes and accelerates AI deployments across the enterprise. We’re growing fast and we’re looking for a.AI core of our pl...Show more

Last updated: 8 days ago • Promoted

Golang Backend Developer

Mithril Defense • Kolkata, IN

We are Hiring : Golang Backend Developer.Join Us in Shaping the Future of Drone Technology!.US-headquartered security company. The backend app is designed with a.These services are containerized and ...Show more

Last updated: 30+ days ago • Promoted

Full Stack Developer – Power Platform & Embedded Analytics

Omugen • Kolkata, IN

Omugen is a management consulting firm specializing in cost containment and revenue growth through automation and data analytics. We help government and private sector clients turn operational data ...Show more

Last updated: 4 days ago • Promoted

Backend Python Engineer

Turing • Kolkata, IN

We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and ...Show more

Last updated: 1 day ago • Promoted