Talent.com
paypay india
Data Engineerpaypay india • Gurgaon / Gurugram, Gurugram, India
Data Engineer

Data Engineer

paypay india • Gurgaon / Gurugram, Gurugram, India
28 days ago
Job description

Job Description

PayPay India is looking for a Data Engineer to work on our payment system to deliver the best payment experience for our customers. This platform is vital to support our increasing business demands. The Data Pipeline team is tasked with creating, deploying, and managing this platform, utilizing leading technologies like Databricks, Delta Lake, Spark, PySpark, Scala, and the AWS suite.

We are actively seeking skilled Data Engineers to join our team and contribute to scaling our platform across the organization.

Main Responsibilities

  • Create and manage robust data ingestion pipelines leveraging Databricks, Airflow, Kafka, and Terraform.
  • Ensure high performance, reliability, and efficiency by optimizing large-scale data pipelines.
  • Develop data processing workflows using Databricks, Delta Lake, and Spark technologies.
  • Maintain and improve the Data Lakehouse, utilizing Unity Catalog for efficient data management and discovery.
  • Construct automation, frameworks, and enhanced tools to streamline data engineering workflows.
  • Collaborate across teams to facilitate smooth data flow and integration.
  • Enforce best practices in observability, data governance, security, and regulatory compliance

Qualifications

  • Minimum 7 years as a Data Engineer or similar role.
  • Hands-on experience with Databricks, Delta Lake, Spark, and Scala.
  • Proven ability to design, build, and operate Data Lakes or Data Warehouses.
  • Proficiency with Data Orchestration tools (Airflow, Dagster, Prefect).
  • Familiarity with Change Data Capture tools (Canal, Debezium, Maxwell).
  • Strong command of at least one primary language (Scala, Python, etc.) and SQL.
  • Experience with data catalog and metadata management (Unity Catalog, Lakeformation).
  • Experience in Infrastructure as Code (IaC) using Terraform.
  • Excellent problem-solving and debugging abilities for complex data challenges.
  • Strong communication and collaboration skills.
  • Capability to make informed decisions, learn quickly, and consider complex technical contexts.
  • Leverage AI/LLM-based tools in daily workflows (e.g., code development, reviews, testing, debugging, documentation), while ensuring human oversight, judgment, and accountability drive the final product.


Skills Required
maxwell , Spark, Scala, Kafka, Terraform, Pyspark, Sql, Airflow, Aws, Databricks
Create a job alert for this search

Data Engineer • Gurgaon / Gurugram, Gurugram, India

Similar jobs

Data Engineer (Palantir Foundry)

edarigurgaon, haryana, in

Data Engineer- Palantir Foundry.United Arab Emirates, which is one of the largest companies in the region.This position is a contract role with an initial duration of.We are looking for a passionat... Show more

 • Promoted

Data Engineer

InterEx Groupgurugram, uttar pradesh, in

Azure Data Engineer (Contract) – INDIA – Fully Remote – 6 Months.This is a hands-on role focused on building reliable data foundations that enable reporting, modelling and business insights.Ingest ... Show more

 • Promoted

Senior Data Engineer

Programmers.iogurgaon, haryana, in

Senior Data Engineer (Snowflake & Matillion).The ideal candidate must be comfortable handling.Core Technical Responsibilities.CTEs, subqueries, window functions, analytical functions.Query refactor... Show more

 • Promoted

Staff Data Engineer

ANSR Summit Consultinggurgaon, India

Participate in the entire data pipeline lifecycle, focusing on building data lakes, data warehouses and related processes.Contribute to the design and documentation of our data lake platform.Partne... Show more

 • Promoted

AWS Data Engineer

Mindfire Solutionsgurgaon, haryana, in

We are seeking a skilled Data Engineer to architect, build, and optimise scalable data platforms on cloud infrastructure.The role involves close collaboration with cross-functional teams to deliver... Show more

 • Promoted

Python Engineer (Data/ML)

Gleantapgurugram, uttar pradesh, in

Gleantap is an intelligent customer experience platform designed for fitness and wellness clubs, enabling businesses to harness data to run effective sales and marketing campaigns.By integrating co... Show more

 • Promoted

Data Engineer

PropStreamgurgaon, haryana, in

We are looking for a hands-on, senior Databricks Architect to design, build, and govern our Lakehouse data platform from the ground up.You will own the end-to-end architecture of our data infrastru... Show more

 • Promoted

Senior Azure Data Engineer (ADF, Databricks, PySpark)

HTC Global Servicesgurugram, uttar pradesh, in

Exciting Opportunity Alert! 🌟 HTC Global Services is hiring Senior Azure Data Engineer (ADF, Databricks, PySpark) for one of our premium projects.The ideal candidate should have hands-on expertise... Show more

 • Promoted

Data Engineer

Digilegurgaon, haryana, in

As a key member of the QTC, you will play a pivotal role in migrating data from diverse sources and applications, developing solutions, validating systems, and addressing various challenges in ente... Show more

 • Promoted

Data Engineer

Experion Technologiesgurgaon, haryana, in

We are seeking a highly skilled Senior Data Engineer (Contractor) to design, build, and optimize scalable data platforms and pipelines.This role will play a critical part in developing modern data ... Show more

 • Promoted

Senior Data Engineer

Information Tech Consultantsgurgaon, haryana, in

Big Data (with AWS Certification) SME.Masters or Ph D in Statistics, Mathematics, Computer Science, or another quantitative field.Fluent English (written/spoken).Experience Developing Machine Learn... Show more

 • Promoted

Gen Ai Engineer

CventGurgaon, Republic Of India, IN

Job description About the role: Looking for an experienced Gen AI Engineer (7-8 years) with strong expertise in Python, SQL, and Tableau to support our Sales & Marketing teams.The ideal candidate w... Show more

 • Promoted

Aws Cloud Engineer

CventGurgaon, Republic Of India, IN

Job description In This Role, You Will: Design, develop, and manage databases on the AWS cloud platform Develop and maintain automation scripts or jobs to perform routine database tasks such as pro... Show more

 • Promoted

Data Engineer

Innodata India Private Limitedgurgaon, haryana, in

Design and implement data-driven solutions on GCP including BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Looker/BI.Build ETL scripts using SQL and Python to extract, clean, and transform structu... Show more