Talent.com
This job offer is not available in your country.
Databricks Engineer - ETL / Data Warehousing

Databricks Engineer - ETL / Data Warehousing

Aiprus Software Private LimitedPune
26 days ago
Job description

Shift 1pm to 10pm / 3 pm to 12 am

Key Responsibilities :

  • Design, develop, and optimize data pipelines and ETL workflows using Databricks.
  • Implement scalable data integration solutions for large datasets across diverse data sources.
  • Build and maintain data architectures for real-time and batch processing.
  • Collaborate with data scientists, analysts, and stakeholders to ensure the delivery of high-quality data solutions.
  • Monitor, troubleshoot, and optimize data workflows for performance and cost-efficiency.
  • Ensure data governance, security, and compliance in all processes.

Qualifications :

  • Should have very clear understanding of Data Lake / Data Warehouse / Lakehouse Concepts
  • strong background in data engineering practices, cloud platforms, big data technologies and big data processing frameworks.
  • Strong hands-on experience with Databricks, including Spark, Delta Lake
  • 3+ Year Hands-on experience on Spark is mandatory using Databricks, Azure / AWS and associated data services.
  • 3+ Years Hands-on experience in SQL, Unix & advanced Unix Shell Scripting, Kafka
  • Expertise in Python / Java / Scala
  • Experience in GIT, SVN, Build Tools like Ant, Maven etc., CI / CD pipelines
  • Hands on file transfer mechanism (NDM, sFTP etc)
  • Knowledge of Schedulers like airflow, TWS etc.
  • Strong problem-solving skills and the ability to work in an agile environment.
  • Educational Background :

  • Bachelors or Masters degree in Computer Science, Engineering, or a related field.
  • (ref : hirist.tech)

    Create a job alert for this search

    Engineer Warehousing • Pune

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Bits In Glasspune, maharashtra, in
    Senior Data Engineer / ETL Engineer.As a Senior Data Engineer / ETL Engineer, you will be instrumental in designing, developing, and optimizing data processing systems that support our organization...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    Principal Software Engineer - Data Engineer

    Principal Software Engineer - Data Engineer

    Accion LabsMore, India
    We are a team of Engineers, Designers, Thinkers, Product Managers, Problem solvers and more.We are bound by our commitment to help teams succeed with our culture of learning & innovation.We seek so...Show moreLast updated: 2 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Talent Worxpune, India
    We are looking for an experienced and talented Data Engineer- Databricks to join our growing data engineering team.Role : Data Engineer- Databricks. Job Type : Full Time Employment.Design and maintain...Show moreLast updated: 2 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Netlinkpune, India
    Design, develop, and maintain efficient and scalable data pipelines using Python, PySpark, and Databricks on AWS.Work closely with data scientists, analysts, and other engineers to ensure smooth da...Show moreLast updated: 2 hours ago
    • Promoted
    • New!
    Data Engineer with GCP, Databricks & PySpark Expertise

    Data Engineer with GCP, Databricks & PySpark Expertise

    SynechronHinjawadi, India
    Synechron is seeking a skilled Data Engineer experienced in Google Cloud Platform (GCP), Databricks, PySpark, and SQL.In this role, you will design, develop, and maintain scalable data pipelines an...Show moreLast updated: 2 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubespune, maharashtra, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    ETL LEAD with IBM DataStage experienced

    ETL LEAD with IBM DataStage experienced

    IntraEdgepune, maharashtra, in
    ETL Developer – DataStage, AWS, Snowflake.We are looking for a talented and motivated ETL Developer / Senior Developer.You will work on building scalable and efficient data pipelines using.IBM Data...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Pune, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago
    • Promoted
    • New!
    Data ETL Engineer

    Data ETL Engineer

    IDT Corporationpune, India
    IDT () is a communications and financial services company founded in 1990 and headquartered in New Jersey, US.Today it is an industry leader in prepaid communication and payment services and one of...Show moreLast updated: 2 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsPune, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 8 days ago
    • Promoted
    ETL Developer

    ETL Developer

    Pinnacle Group, Inc.Pune, IN
    PTR Global is a leader in providing innovative workforce solutions, dedicated to optimizing talent acquisition and management processes. Our commitment to excellence has earned us the trust of busin...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    ALIQAN Technologiespune, India
    Responsible for designing, developing, and maintaining data pipelines and ETL processes.Databricks and Azure Data Factory. Good experience in using SQL, Python and Spark within Databricks notebooks ...Show moreLast updated: 2 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Aumni Techworkspune, India
    We are looking for an experienced Data Engineer with 3 to 5 years of experience to join our team and contribute to building scalable, reliable, and high-performing data pipelines.The ideal candidat...Show moreLast updated: 2 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalPune, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Axiom Software Solutions Limitedpune, India
    Establish technical designs to meet requirements aligned with architectural and data standards.Optimize ETL / data pipelines balancing performance, functionality, and operational requirements.Fine-tu...Show moreLast updated: 2 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Screen Magic Mobile Media Pvt Ltdpune, India
    Job Title : Data Engineer – Workflow Automation & Analytics.We are seeking a technically strong and highly analytical Data Engineer to join our onsite team. This role demands hands-on expertise in wo...Show moreLast updated: 2 hours ago
    • Promoted
    • New!
    Senior Data Engineer (Snowflake)

    Senior Data Engineer (Snowflake)

    Crazy Solutionspune, India
    Senior Data Engineer (Snowflake).Agivant is seeking a talented and passionate.In this role, you will play a key part in building and scaling our data infrastructure, enabling data-driven decision-m...Show moreLast updated: 2 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIPune, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago