Talent.com
Advanced PySpark

Advanced PySpark

TEKNIKOZjaipur, rajasthan, in
21 hours ago
Job description

Greetings from Teknikoz

Experience : 9+Years

Roles and Responsibilities

Advanced PySpark (Expert Level - Required)

  • Mastery of DataFrame APIs and Spark SQL
  • Performance tuning : broadcast joins, caching strategies, shuffle reduction
  • Handling skewed data and optimizing wide transformations
  • Writing scalable, testable PySpark code with modular design

Databricks Expertise (Expert Level - Required)

  • Cluster sizing, autoscaling, and spot instance optimization
  • Job orchestration using Workflows with retries, alerts, and dependencies
  • Delta Lake :
  • OPTIMIZE with Z-Ordering
  • MERGE operations and schema evolution
  • Time travel and versioning
  • Use of Unity Catalog for data governance and access control
  • Monitoring via Databricks metrics and audit logs

    • PostgreSQL (Required)

  • Query profiling and execution plan analysis
  • Indexing strategies for analytical workloads
  • Table partitioning and parallel query execution
    • Create a job alert for this search

    Pyspark • jaipur, rajasthan, in

    Related jobs
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPJaipur, IN
    Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionJaipur, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 1 day ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    K&K Talents - IndiaJaipur, IN
    This position is with one of our.Title : Principal Data Engineer.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune. Employment Type : Full-time Permanent.GCP or AWS, Spark, Pyspa...Show moreLast updated: 11 days ago
    • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Diligente TechnologiesJaipur, IN
    Two rounds ( each ~ 30 to 45 mins, also includes coding ).On daily basis, 4 : 30 PM-1 : 30 AM IST.May get extended in case of prod issues. Big Data : Scala, Databricks, Spark SQL, Spark Streaming, Python...Show moreLast updated: 25 days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Sympera AIJaipur, IN
    Join a well-funded fintech startup, led by a successful serial fintech entrepreneur.We aim to revolutionize f inancial services with our advanced LLM-based platform. This is a unique opportunity to ...Show moreLast updated: 4 days ago
    • Promoted
    AEM Engineer

    AEM Engineer

    Insight GlobalJaipur, IN
    Adobe Experience Manager (AEM).The team is now expanding AEM capabilities beyond web content into.This is a hands-on development role within a fast-moving team focused on building and optimizing cu...Show moreLast updated: 3 days ago
    • Promoted
    Senior Analytics Support Engineer (GA4 | GTM | Looker | Tableau | SQL | AWS)

    Senior Analytics Support Engineer (GA4 | GTM | Looker | Tableau | SQL | AWS)

    Sky Systems, Inc. (SkySys)Jaipur, IN
    Senior Analytics Support Engineer.Full-Time Contract (40hrs / week).Hybrid (2x days onsite) in Bangalore, India.We’re looking for a skilled Analytics Support Engineer experienced in.GA4, GTM, Looker,...Show moreLast updated: 1 day ago
    • Promoted
    Lead Software Engineer - Python (Storage)

    Lead Software Engineer - Python (Storage)

    DDNJaipur, IN
    This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a globa...Show moreLast updated: 11 days ago
    • Promoted
    Senior Engineer - Software (Python)

    Senior Engineer - Software (Python)

    PramanaJaipur, IN
    Cambridge, MA (USA), with R&D and manufacturing sites in Bangalore (India), Rochester (MN, USA) and Toronto (Canada).Pramana was established in 2021 as a spin-off from Nference.Pramana’s vision is ...Show moreLast updated: 30+ days ago
    • Promoted
    Applications Engineer

    Applications Engineer

    Sikich IndiaJaipur, IN
    Sikich India is seeking an Applications Engineer who will be responsible for the design, development, and continuous improvement of Oracle Cloud applications and related systems.This role works und...Show moreLast updated: 20 days ago
    • Promoted
    • New!
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    SyntasaJaipur, IN
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show moreLast updated: 2 hours ago
    • Promoted
    Maintenance Engineer

    Maintenance Engineer

    Golcha AssociatedBagru, Rajasthan, India
    Responsible routine equipment inspections, preventive maintenance, and troubleshooting to repair machinery and systems.Diagnose faults, oversee maintenance tasks, manage spare parts, ensure complia...Show moreLast updated: 11 days ago
    • Promoted
    Senior Python Engineer

    Senior Python Engineer

    PICWA.ioJaipur, IN
    For an Australian ASX listed MedTech company.We're looking for a Python Engineer with 10+ years of experience and expertise in Flask. Years of Python, particularly Flask Framework experience .Servic...Show moreLast updated: 1 day ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGJaipur, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 1 day ago
    • Promoted
    Python Software Architect

    Python Software Architect

    ConcentrixJaipur, IN
    A new breed of tech company — Human-centered.We create game-changing solutions across the enterprise, that help brands grow across the world and into the future. We are trusted by clients across all...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    Senior AppDynamics Observability SME

    Senior AppDynamics Observability SME

    Dexian IndiaJaipur, IN
    Position Title : Senior AppDynamics Observability SME.IT operations, system administration, or engineering.Ansible, Jenkins, Terraform, Python to develop configuration, deployment, and orchestration...Show moreLast updated: 2 hours ago
    • Promoted
    Python Automation Engineer

    Python Automation Engineer

    XpertDox India Pvt LtdJaipur, IN
    Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM). Familiarity with Windows and Linux fundam...Show moreLast updated: 11 days ago
    • Promoted
    Senior Python Engineer

    Senior Python Engineer

    Acorn GlobusJaipur, IN
    This is a full-time remote role for a Python Developer at Acorn Globus.The Python Developer will be responsible for back-end web development, software development, object-oriented programming (OOP)...Show moreLast updated: 25 days ago