Talent.com
Advanced PySpark

Advanced PySpark

TEKNIKOZkanpur, uttar pradesh, in
1 day ago
Job description

Greetings from Teknikoz

Experience : 9+Years

Roles and Responsibilities

Advanced PySpark (Expert Level - Required)

  • Mastery of DataFrame APIs and Spark SQL
  • Performance tuning : broadcast joins, caching strategies, shuffle reduction
  • Handling skewed data and optimizing wide transformations
  • Writing scalable, testable PySpark code with modular design

Databricks Expertise (Expert Level - Required)

  • Cluster sizing, autoscaling, and spot instance optimization
  • Job orchestration using Workflows with retries, alerts, and dependencies
  • Delta Lake :
  • OPTIMIZE with Z-Ordering
  • MERGE operations and schema evolution
  • Time travel and versioning
  • Use of Unity Catalog for data governance and access control
  • Monitoring via Databricks metrics and audit logs

    • PostgreSQL (Required)

  • Query profiling and execution plan analysis
  • Indexing strategies for analytical workloads
  • Table partitioning and parallel query execution
    • Create a job alert for this search

    Pyspark • kanpur, uttar pradesh, in

    Related jobs
    • Promoted
    • New!
    Senior AppDynamics Observability SME

    Senior AppDynamics Observability SME

    Dexian IndiaKanpur, IN
    Position Title : Senior AppDynamics Observability SME.IT operations, system administration, or engineering.Ansible, Jenkins, Terraform, Python to develop configuration, deployment, and orchestration...Show moreLast updated: 16 hours ago
    • Promoted
    Lead Software Engineer - Python (Storage)

    Lead Software Engineer - Python (Storage)

    DDNKanpur, IN
    This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a globa...Show moreLast updated: 12 days ago
    • Promoted
    Senior Python Engineer

    Senior Python Engineer

    PICWA.ioKanpur, IN
    For an Australian ASX listed MedTech company.We're looking for a Python Engineer with 10+ years of experience and expertise in Flask. Years of Python, particularly Flask Framework experience .Servic...Show moreLast updated: 1 day ago
    • Promoted
    Senior Engineer

    Senior Engineer

    Brilliokanpur, uttar pradesh, in
    Senior Python Developer( Contract to Hire).Logstash alternatives, custom ETL pipelines.AWS, GCP, Azure) for log retrieval and monitoring automation. Experience with streaming data frameworks (Kafka,...Show moreLast updated: 12 days ago
    • Promoted
    Senior Python Developer

    Senior Python Developer

    Aarav Solutionskanpur, uttar pradesh, in
    Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show moreLast updated: 7 days ago
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPKanpur, IN
    Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    SyntasaKanpur, IN
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show moreLast updated: 16 hours ago
    • Promoted
    Senior Python Engineer

    Senior Python Engineer

    Acorn GlobusKanpur, IN
    This is a full-time remote role for a Python Developer at Acorn Globus.The Python Developer will be responsible for back-end web development, software development, object-oriented programming (OOP)...Show moreLast updated: 26 days ago
    • Promoted
    Contract Role - 6 months to 1 year - Senior Data Engineer - Python, AWS, Building Data Pipelines

    Contract Role - 6 months to 1 year - Senior Data Engineer - Python, AWS, Building Data Pipelines

    CareerXperts Consultingkanpur, uttar pradesh, in
    Our client is looking for a talented experienced software development consultants, specializing in Agile Delivery.A place where you are a polyglot, working alongside the client,.A world where you a...Show moreLast updated: 1 day ago
    • Promoted
    AEM Engineer

    AEM Engineer

    Insight GlobalKanpur, IN
    Adobe Experience Manager (AEM).The team is now expanding AEM capabilities beyond web content into.This is a hands-on development role within a fast-moving team focused on building and optimizing cu...Show moreLast updated: 3 days ago
    • Promoted
    Senior Engineer - Software (Python)

    Senior Engineer - Software (Python)

    PramanaKanpur, IN
    Cambridge, MA (USA), with R&D and manufacturing sites in Bangalore (India), Rochester (MN, USA) and Toronto (Canada).Pramana was established in 2021 as a spin-off from Nference.Pramana’s vision is ...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    K&K Talents - IndiaKanpur, IN
    This position is with one of our.Title : Principal Data Engineer.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune. Employment Type : Full-time Permanent.GCP or AWS, Spark, Pyspa...Show moreLast updated: 12 days ago
    • Promoted
    Python Automation Engineer

    Python Automation Engineer

    XpertDox India Pvt LtdKanpur, IN
    Strong Python programming skills with at least two years of hands-on experience in the automation of tasks & GUI (using Selenium or other known shadow DOM). Familiarity with Windows and Linux fundam...Show moreLast updated: 12 days ago
    • Promoted
    Sap Advanced Business Application Programming Developer

    Sap Advanced Business Application Programming Developer

    DroisysKanpur, IN
    Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agil...Show moreLast updated: 26 days ago
    • Promoted
    Senior Analytics Support Engineer (GA4 | GTM | Looker | Tableau | SQL | AWS)

    Senior Analytics Support Engineer (GA4 | GTM | Looker | Tableau | SQL | AWS)

    Sky Systems, Inc. (SkySys)Kanpur, IN
    Senior Analytics Support Engineer.Full-Time Contract (40hrs / week).Hybrid (2x days onsite) in Bangalore, India.We’re looking for a skilled Analytics Support Engineer experienced in.GA4, GTM, Looker,...Show moreLast updated: 2 days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Sympera AIKanpur, IN
    Join a well-funded fintech startup, led by a successful serial fintech entrepreneur.We aim to revolutionize f inancial services with our advanced LLM-based platform. This is a unique opportunity to ...Show moreLast updated: 5 days ago
    • Promoted
    Senior Software Engineer - Python

    Senior Software Engineer - Python

    PICWA IndiaKanpur, IN
    For an Australian ASX listed MedTech company.We're looking for a Python Engineer with 10+ years of experience and expertise in Flask. Years of Python, particularly Flask Framework experience .Servic...Show moreLast updated: 2 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGKanpur, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 2 days ago