Talent.com
Databricks Engineer - ETL / PySpark

Databricks Engineer - ETL / PySpark

Talent VelocityPune
11 days ago
Job description

Description :

Location Pune & Nagpur

Experience 5-7 Years

Employment Type Full-Time

Job Summary :

We are seeking an experienced Data Engineer with strong hands-on expertise in Databricks on any cloud platform (AWS, Azure, or GCP), along with proven skills in SQL, Python, and PySpark. The ideal candidate will have a solid background in database design, data processing, and building scalable data pipelines in a cloud-based environment.

Key Responsibilities :

  • Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark
  • Work with structured and semi-structured data across various cloud platforms (AWS, Azure, or GCP)
  • Write optimized and complex SQL queries for data extraction and transformation
  • Implement data ingestion from various sources into the data lake / warehouse
  • Collaborate with data analysts, business stakeholders, and other engineering teams to understand requirements and deliver solutions
  • Monitor and improve the performance of existing data pipelines
  • Ensure data quality, security, and governance across the data lifecycle

Required Skills & Qualifications :

  • 57 years of professional experience in Data Engineering or related roles
  • Strong experience with Databricks on any cloud platform (AWS, Azure, or GCP)
  • Proficiency in SQL, Python, and PySpark
  • Solid understanding of database structures, data modeling, and data warehousing concepts
  • Experience with cloud data services and storage solutions
  • Familiarity with CI / CD practices and version control tools like Git
  • Excellent problem-solving and communication skills
  • Good to Have :

  • Exposure to Delta Lake, Lakehouse architecture, or MLflow
  • Knowledge of Apache Airflow or other workflow orchestration tools
  • Experience in performance tuning and job optimization in Spark environments
  • (ref : hirist.tech)

    Create a job alert for this search

    Engineer • Pune

    Related jobs
    • Promoted
    Big Data Engineer

    Big Data Engineer

    CoforgePune, Maharashtra, India
    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills : - AWS, Spark & Scala.Experience Required : 3 to 6 Years. Job Locations : Pune, Hyderabad, Greater Noida Only.For queri...Show moreLast updated: 19 days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Information TechnologyPune
    Big Data Engineer Key Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets.C...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Big Data Engineer - PySpark / Scala

    Senior Big Data Engineer - PySpark / Scala

    Consulting PanditsPune
    Exciting Job Opportunity in Pune! Are you an experienced Senior Big Data Engineer with over 5 years of expertise? We have a fantastic opportunity waiting for you!<...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Solution Architect

    Databricks Solution Architect

    InspireXTPune
    Description : About InspireXT : InspireXT is on a mission to build the most trusted supply chains in the world.Our Connected I...Show moreLast updated: 28 days ago
    • Promoted
    Tableau Developer

    Tableau Developer

    Persistent SystemsPune, Maharashtra, India
    About Position We are seeking a skilled Tableau Developer to design, develop, and maintain interactive dashboards and reports that transform complex data into meaningful business insights.The idea...Show moreLast updated: 16 days ago
    • Promoted
    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Tata Consultancy ServicesPune, Maharashtra, India
    Relevant Experience (in Yrs) : .Hyderabad, Pune, Chennai, Bangalore, Noida.Technical / Functional Skills Must Have Experience in : . Hands on experience in Spark, Scala and Pyspark.Should be proficient i...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    AscendionPune, Maharashtra, India
    Job Title : Senior Data Engineer Experience : 3+ years Location : Gurgaon / Pune / Bangalore Skills : PySpark, SQL, Databricks, AWS. Role Summary : We are looking for 3–4 experienced Databricks Devel...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    WorkiFicientPune
    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and...Show moreLast updated: 30+ days ago
    • Promoted
    Python & Power BI Developer

    Python & Power BI Developer

    AllianzPune
    Python and PowerBI Developer We are seeking a talented and experienced Python and PowerBI Developer to join our Automation Chapter. The ideal candidate will have a min...Show moreLast updated: 30+ days ago
    • Promoted
    Reveille Technologies - Big Data Engineer

    Reveille Technologies - Big Data Engineer

    Reveille TechnologiesPune
    Description : We are looking for highly skilled and motivated Big Data Engineers / Leads to join our team and drive the development of our next-generation data plat...Show moreLast updated: 28 days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    Tata Consultancy Servicespune, India
    Skills : Azure Databricks, Pyspark, ADLS, ADF.Responsibility of / Expectations from the Role : .Designing and building Databricks data pipelines is required. Experience in transforming the data using A...Show moreLast updated: 13 days ago
    • Promoted
    Softpath Technologies - Senior Big Data Engineer - Hive & Unix Scripting

    Softpath Technologies - Senior Big Data Engineer - Hive & Unix Scripting

    Softpath Technologies LLCPune
    Description : Job Title : Senior Big Data Engineer Hive & Unix Scripting Location : P...Show moreLast updated: 4 days ago
    • Promoted
    Big Data Engineer - Spark / Scala

    Big Data Engineer - Spark / Scala

    Leinex ConsultingPune
    Role & responsibilities : - Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders < / p&...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    Persistent SystemsPune, Maharashtra, India
    We are seeking data bricks engineer with hands on experience in Power BI, python, spark and data bricks.Job Type : Full Time Employment. Strong hands-on experience with.Familiarity with cloud platfor...Show moreLast updated: 17 days ago
    • Promoted
    2892- Databricks Engineer

    2892- Databricks Engineer

    EXLPune, Maharashtra, India
    We are seeking a highly skilled.The ideal candidate will have strong expertise in designing, developing, and optimizing large-scale data pipelines and solutions using Databricks, Spark, and cloud p...Show moreLast updated: 19 days ago
    • Promoted
    GCP Data Engineer (GCP Services (DataProc, Big Query, Composer) (Scala and PySpark))

    GCP Data Engineer (GCP Services (DataProc, Big Query, Composer) (Scala and PySpark))

    Tata Consultancy ServicesPune, Maharashtra, India
    Greetings from TATA Consultancy Services.GCP Services (DataProc, Big Query, Composer) Good knowledge of Spark (Scala and PySpark)). Pls find the Job Description below.Data Engineer will be responsib...Show moreLast updated: 19 days ago
    • Promoted
    Lead Big Data Engineer - Spark

    Lead Big Data Engineer - Spark

    QUALYS SECURITY TECHSERVICES PRIVATE LIMITEDPune
    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.Description : We are seeking a talented Lead Big ...Show moreLast updated: 30+ days ago
    • Promoted
    Tableau Developer

    Tableau Developer

    ConfidentialPune, Maharashtra, India
    Job Title : Tableau Developer Experience : 6 Years Location : Pune Immediate Joiner Preferred Job Overview : We are seeking an experienced Tableau Developer with 6 years of expertise in data visua...Show moreLast updated: 20 days ago