Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

ThoughtFocusBengaluru, Karnataka, India
30+ days ago
Job description

Looking for Immediate joiners only

Shift time : 1 : 00 PM to 10 : 00 PM

Location : Bangalore

Skills : Python, pyspark, Databricks

Exp : 5+ Years

Job Summary :

The Data Engineer responsible for implementing and managing the operational aspects of cloud-native and hybrid data platform solutions built with Azure Databricks. They ensure the efficient and effective functioning of the Azure Databricks environment, including monitoring and troubleshooting data pipelines, managing data storage and access, and optimizing performance. They work closely with data engineers, data scientists, and other stakeholders to understand data requirements, design solutions, and implement data integration and transformation processes.

Key Responsibilities :

  • Provide expertise and ownership of Azure Databricks development tasks within the scrum team.
  • Interact effectively with clients and leadership and can adapt communication for the appropriate audience.
  • Read and comprehend software requirements, assisting with development of agile user stores and tasks.
  • Assist with troubleshooting configuration and performance issues.
  • Assist with Azure Databricks deployments, testing, configuration, and installation.
  • Ensure security is a priority and understand the various areas where security vulnerabilities arise with database technologies.
  • Ensure database resiliency, and disaster recovery capabilities.

Required Skills & Qualifications :

  • 4+ years proven experience working with Azure Databricks Analytics database capabilities, specifically Azure Databricks and other relational database technologies supported in Azure.
  • 5+ years proven experience with Azure Data Lake Storage Gen 2, Azure Databricks, Azure Data Explorer, Azure Event Hubs, Spark Pools, Python, PySpark, SQL, Azure Landing Zone, Azure Networking Services, Microsoft EntraID.
  • 5+ years proven experience with Azure geo-redundancy, HA / failover technologies.
  • 5+ years proven experience designing and implementing data pipelines using Azure Databricks for data cleaning, transformation, and loading into Data Lakehouse.
  • 5+ years proven experience with Infrastructure as Code (IaC) tools such as Terraform.
  • 5+ years proven experience with programming languages such as Python, PySpark and data constructs such as JSON or XML.
  • Create a job alert for this search

    Data Engineer • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    EVERSANABengaluru, Karnataka, India
    At EVERSANA, we are proud to be certified as a Great Place to Work across the globe.We’re fueled by our vision to create a healthier world. How? Our global team of more than 7,000 employees is commi...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Xebiahosur, tamil nadu, in
    We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week). Data Engineering with 4+ years team leadership...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TELUS Digital AI Data SolutionsBengaluru, Karnataka, India
    TELUS Digital (TD) Experience partners with the world’s most innovative brands, from tech startups to industry leaders in fintech, gaming, healthcare, and more. We empower businesses to scale and re...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXhosur, tamil nadu, in
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubeshosur, tamil nadu, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    VRIZEBengaluru, India
    This role is responsible for developing, maintaining and optimizing data pipelines, delivering data timely to our cross-functional teams and support reporting and analytics.The Engineer will work c...Show moreLast updated: 1 hour ago
    • Promoted
    Data Engineer

    Data Engineer

    SelectorBengaluru, Karnataka, India
    About Us Selector is building an operational intelligence platform for digital infrastructure.By adopting an AI / ML-based analytics approach, the platform provides actionable multi-dimens...Show moreLast updated: 17 days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreeshosur, tamil nadu, in
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 27 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsBengaluru, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 9 days ago
    • Promoted
    Rocket UniData Engineer

    Rocket UniData Engineer

    Mitra AIhosur, tamil nadu, in
    The ideal candidate will have a deep understanding of UniData and UniVerse environments, with a proven track record in developing, maintaining, and optimizing complex legacy systems.Design, develop...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kline + CompanyBangalore, IN
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Everisehosur, tamil nadu, in
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 Companyhosur, tamil nadu, in
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CEShosur, tamil nadu, in
    As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Net Zero Insightshosur, tamil nadu, in
    Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide.Our cuttin...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer 2

    Data Engineer 2

    YubiBangalore Urban, Karnataka, India
    As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgehosur, tamil nadu, in
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.hosur, tamil nadu, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalbangalore, karnataka, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgehosur, tamil nadu, in
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 27 days ago