Talent.com
Advanced PySpark

Advanced PySpark

TEKNIKOZranchi, jharkhand, in
12 hours ago
Job description

Greetings from Teknikoz

Experience : 9+Years

Roles and Responsibilities

Advanced PySpark (Expert Level - Required)

  • Mastery of DataFrame APIs and Spark SQL
  • Performance tuning : broadcast joins, caching strategies, shuffle reduction
  • Handling skewed data and optimizing wide transformations
  • Writing scalable, testable PySpark code with modular design

Databricks Expertise (Expert Level - Required)

  • Cluster sizing, autoscaling, and spot instance optimization
  • Job orchestration using Workflows with retries, alerts, and dependencies
  • Delta Lake :
  • OPTIMIZE with Z-Ordering
  • MERGE operations and schema evolution
  • Time travel and versioning
  • Use of Unity Catalog for data governance and access control
  • Monitoring via Databricks metrics and audit logs

    • PostgreSQL (Required)

  • Query profiling and execution plan analysis
  • Indexing strategies for analytical workloads
  • Table partitioning and parallel query execution
    • Create a job alert for this search

    Pyspark • ranchi, jharkhand, in

    Related jobs
    • Promoted
    • New!
    Contract Role - 6 months to 1 year - Senior Data Engineer - Python, AWS, Building Data Pipelines

    Contract Role - 6 months to 1 year - Senior Data Engineer - Python, AWS, Building Data Pipelines

    CareerXperts Consultingranchi, jharkhand, in
    Our client is looking for a talented experienced software development consultants, specializing in Agile Delivery.A place where you are a polyglot, working alongside the client,.A world where you a...Show moreLast updated: 20 hours ago
    • Promoted
    Senior Engineer

    Senior Engineer

    Brillioranchi, jharkhand, in
    Senior Python Developer( Contract to Hire).Logstash alternatives, custom ETL pipelines.AWS, GCP, Azure) for log retrieval and monitoring automation. Experience with streaming data frameworks (Kafka,...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    9NEXUSranchi, jharkhand, in
    Job Title : Azure Data Engineer.We are seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data solutions in a cloud environment. The role involves building high-perf...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGranchi, jharkhand, in
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 20 hours ago
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPranchi, jharkhand, in
    Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Python Developer_ Exp : 7+ Years

    Lead Python Developer_ Exp : 7+ Years

    Atyeti Incranchi, jharkhand, in
    Strong hands-on experience in Python.Strong experience on Django / Flask framework development.Solid understanding of OOP, REST APIs, and microservices architecture. Exposure to SQL / NoSQL databases f...Show moreLast updated: 10 days ago
    • Promoted
    AEM Engineer

    AEM Engineer

    Insight Globalranchi, jharkhand, in
    Adobe Experience Manager (AEM).The team is now expanding AEM capabilities beyond web content into.This is a hands-on development role within a fast-moving team focused on building and optimizing cu...Show moreLast updated: 2 days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Sympera AIranchi, jharkhand, in
    Join a well-funded fintech startup, led by a successful serial fintech entrepreneur.We aim to revolutionize f inancial services with our advanced LLM-based platform. This is a unique opportunity to ...Show moreLast updated: 4 days ago
    • Promoted
    Senior Engineer - Software (Python)

    Senior Engineer - Software (Python)

    Pramanaranchi, jharkhand, in
    Cambridge, MA (USA), with R&D and manufacturing sites in Bangalore (India), Rochester (MN, USA) and Toronto (Canada).Pramana was established in 2021 as a spin-off from Nference.Pramana’s vision is ...Show moreLast updated: 19 days ago
    • Promoted
    Senior Python Engineer

    Senior Python Engineer

    Acorn Globusranchi, jharkhand, in
    This is a full-time remote role for a Python Developer at Acorn Globus.The Python Developer will be responsible for back-end web development, software development, object-oriented programming (OOP)...Show moreLast updated: 19 days ago
    • Promoted
    Senior Python Developer

    Senior Python Developer

    Aarav Solutionsranchi, jharkhand, in
    Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show moreLast updated: 6 days ago
    • Promoted
    Senior Python Developer

    Senior Python Developer

    Cactus Communicationsranchi, jharkhand, in
    You will be a part of Cactus Labs which is the R&D Cell of Cactus Communications.Cactus Labs is a high impact cell that works to solve complex technical and business problems that help keep us stra...Show moreLast updated: 19 days ago
    • Promoted
    senior Python Developer

    senior Python Developer

    TIGI HRranchi, jharkhand, in
    Deep hands-on experience with Python.Strong expertise in SQL & NoSQL databases : MongoDB, DynamoDB, PostgreSQL, ClickHouse. TypeScript, and JavaScript (ES6+).Proven experience in building microservic...Show moreLast updated: 9 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Veraxionranchi, jharkhand, in
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 20 hours ago
    • Promoted
    Lead Software Engineer - Python (Storage)

    Lead Software Engineer - Python (Storage)

    DDNranchi, jharkhand, in
    This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a globa...Show moreLast updated: 11 days ago
    • Promoted
    Senior Python Backend Developer (AI, Cloud & CI / CD)Agentic AI Engineer

    Senior Python Backend Developer (AI, Cloud & CI / CD)Agentic AI Engineer

    GenNow.AIranchi, jharkhand, in
    Senior Python Backend Developer (4–8 years of experience).Python (FastAPI, Flask, or Django).Deploy and manage backend services on. GitHub Actions, GitLab CI, or Jenkins.Containerize applications us...Show moreLast updated: 3 days ago
    • Promoted
    Senior Python Developer

    Senior Python Developer

    Skedara Technologyranchi, jharkhand, in
    ETL and data integration pipelines.This ideal candidate will be working with data from diverse sources, transforming it efficiently, and ensuring seamless downstream delivery to analytics and repor...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticsranchi, jharkhand, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 19 days ago