Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

ThoughtFocusBengaluru, Karnataka, India
30+ days ago
Job description

Looking for Immediate joiners only

Shift time : 1 : 00 PM to 10 : 00 PM

Location : Bangalore

Skills : Python, pyspark, Databricks

Exp : 5+ Years

Job Summary :

The Data Engineer responsible for implementing and managing the operational aspects of cloud-native and hybrid data platform solutions built with Azure Databricks. They ensure the efficient and effective functioning of the Azure Databricks environment, including monitoring and troubleshooting data pipelines, managing data storage and access, and optimizing performance. They work closely with data engineers, data scientists, and other stakeholders to understand data requirements, design solutions, and implement data integration and transformation processes.

Key Responsibilities :

  • Provide expertise and ownership of Azure Databricks development tasks within the scrum team.
  • Interact effectively with clients and leadership and can adapt communication for the appropriate audience.
  • Read and comprehend software requirements, assisting with development of agile user stores and tasks.
  • Assist with troubleshooting configuration and performance issues.
  • Assist with Azure Databricks deployments, testing, configuration, and installation.
  • Ensure security is a priority and understand the various areas where security vulnerabilities arise with database technologies.
  • Ensure database resiliency, and disaster recovery capabilities.

Required Skills & Qualifications :

  • 4+ years proven experience working with Azure Databricks Analytics database capabilities, specifically Azure Databricks and other relational database technologies supported in Azure.
  • 5+ years proven experience with Azure Data Lake Storage Gen 2, Azure Databricks, Azure Data Explorer, Azure Event Hubs, Spark Pools, Python, PySpark, SQL, Azure Landing Zone, Azure Networking Services, Microsoft EntraID.
  • 5+ years proven experience with Azure geo-redundancy, HA / failover technologies.
  • 5+ years proven experience designing and implementing data pipelines using Azure Databricks for data cleaning, transformation, and loading into Data Lakehouse.
  • 5+ years proven experience with Infrastructure as Code (IaC) tools such as Terraform.
  • 5+ years proven experience with programming languages such as Python, PySpark and data constructs such as JSON or XML.
  • Create a job alert for this search

    Data Engineer • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    Data Engineer 2

    Data Engineer 2

    YubiBangalore Urban, Karnataka, India
    As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EVERSANABengaluru, Karnataka, India
    At EVERSANA, we are proud to be certified as a Great Place to Work across the globe.We’re fueled by our vision to create a healthier world. How? Our global team of more than 7,000 employees is commi...Show moreLast updated: 30+ days ago
    • Promoted
    2904 - Data Engineer

    2904 - Data Engineer

    EXLBengaluru, Karnataka, India
    Role : 4-7 years hands on experience in software development.Strong in algorithms and data structures, knowledge of Object-oriented design, Design Patterns Multi-threaded programming Strong troubles...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    StraiveBengaluru, IN
    Data Engineer will be responsible for designing, developing, and maintaining data pipelines and architectures that support the organization's analytics and reporting needs.The ideal candidate will ...Show moreLast updated: 8 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    CoffeeBeansBengaluru, India
    Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of del...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VRIZEBengaluru, India
    This role is responsible for developing, maintaining and optimizing data pipelines, delivering data timely to our cross-functional teams and support reporting and analytics.The Engineer will work c...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseBangalore, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    SelectorBengaluru, Karnataka, India
    Selector is building an operational intelligence platform for digital infrastructure.AI / ML-based analytics approach, the platform provides actionable multi-dimensional. It enables operations teams t...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    V2Softhosur, tamil nadu, in
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    NAF Technology Indiahosur, tamil nadu, in
    Do you love a Challenge? Are you Passionate about technology? Are you customer obsessed? Looking to innovate? Join NAF Tech! New American Funding (NAF) is a mortgage lender offering an array of loa...Show moreLast updated: 7 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsBangalore, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    One Tapp ConsultingBengaluru, Karnataka, India
    Design and Development : Design, build, and maintain robust, scalable, and optimized ETL / ELT data.Python and standard data warehousing principles. Data Platform Management : Implement and manage data ...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Magma ConsultancyBengaluru, IN
    Part-time (20–25 hours per week).The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers,...Show moreLast updated: 8 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    AcqueonBengaluru, Karnataka, India
    About the Job We are building a Customer Data Platform (CDP) designed to unlock the full potential of customer experience (CX) across our products and services. This role offers the opportunity t...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA Globalhosur, tamil nadu, in
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    MareanaBengaluru, Karnataka, India
    Data Engineer Bangalore / Full-Time Job Description Mareana is looking for experienced Data Engineer with a strong development background using, RDMS, graph database and NoSQL platforms.This rol...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesBengaluru, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    SapaadBengaluru, IN
    Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering.F&B businesses across 40+ countries. Driven by a passionate team of developers, designers, a...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXBengaluru, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsBangalore, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 24 days ago