Talent.com
This job offer is not available in your country.
Lead Data Engineer

Lead Data Engineer

ConfidentialHyderabad / Secunderabad, Telangana
21 days ago
Job description

Responsibilities

  • Active contributor to cost optimization of platforms and services.
  • Manage and scale Azure Data Platforms to support new product launches and drive Platform Stability and Observability across data products.
  • Build and own the automation and monitoring frameworks that captures metrics and operational KPIs for Data Platforms for cost and performance.
  • Responsible for implementing best practices around systems integration, security, performance and Platform management.
  • Empower the business by creating value through the increased adoption of data, data science and business intelligence landscape.
  • Collaborate with internal clients (data science and product teams) to drive solutioning and POC discussions.
  • Evolve the architectural capabilities and maturity of the data platform by engaging with enterprise architects and strategic internal and external partners.
  • Develop and optimize procedures to 'production Alize' data science models.
  • Define and manage SLAs for Platforms and processes running in production.
  • Support large-scale experimentation done by data scientists.
  • Prototype new approaches and build solutions at scale.
  • Research in state-of-the-art methodologies.
  • Create documentation for learnings and knowledge transfer.
  • Create and audit reusable packages or libraries.

Qualifications

  • 8+ years of overall technology experience that includes at least 4+ years of hands-on software development, Program management, and data engineering
  • 4+ years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools.
  • 4+ years of experience in Databricks optimization and performance tuning
  • Experience in managing multiple teams and coordinating with different stakeholders to implement the vision of the team.
  • Fluent with Azure cloud services. Azure Certification is a plus.
  • Experience with integration of multi cloud services with on-premises technologies.
  • Experience with data modeling, data warehousing, and building high-volume ETL / ELT pipelines.
  • Experience building / operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
  • Experience with at least one MPP database technology such as Redshift, Synapse or SnowFlake.
  • Experience with version control systems like Github and deployment & CI tools.
  • Experience with Azure Data Factory, Azure Databricks.
  • Experience with Statistical / ML techniques is a plus.
  • Experience with building solutions in the retail or in the supply chain space is a plus
  • Understanding of metadata management, data lineage, and data glossaries is a plus.
  • Working knowledge of agile development, including DevOps and DataOps concepts.
  • Familiarity with business intelligence tools (such as PowerBI).
  • Skills Required

    Agile Development, data engineering , Azure Data, Power Bi, Software Developement, Devops, Azure Databricks

    Create a job alert for this search

    Lead Data Engineer • Hyderabad / Secunderabad, Telangana

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    EgenHyderabad, Telangana, India
    Lead Data Engineer – Python & GCP.We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data enginee...Show moreLast updated: 30+ days ago
    • Promoted
    ZettaMine - Data Engineer - ETL / Azure

    ZettaMine - Data Engineer - ETL / Azure

    ZettaMine Labs Pvt LtdHyderabad
    Role Overview : ZettaMine is seeking a skilled and experienced Data Engineer to design, build, and maintain robust data pipelines and infrastructure on the Azure pla...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Saras Analyticshyderabad, telangana, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer Team Lead

    Data Engineer Team Lead

    SGIhyderabad, telangana, in
    To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Enterprise Mindshyderabad, telangana, in
    We’re Hiring : Data Engineer Lead at Enterprise Minds.Hiring #DataEngineer #Cloud #Azure #AWS #GCP #HyderabadJobs #EnterpriseMinds #Careers]. Lead end-to-end design & deployment of.Collaborate with p...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer - ETL

    Data Engineer - ETL

    TalescopeHyderabad
    About the Role : We are looking for a highly experienced and hands-on Data Engineer (AdTech) to lead our analytics team. This role is ideal for some...Show moreLast updated: 13 days ago
    • Promoted
    Lead Data Engineer [T500-20180]

    Lead Data Engineer [T500-20180]

    Inspirehyderabad, telangana, in
    Inspire Brands is disrupting the restaurant industry through digital transformation and operational efficiencies.The company’s technology hub, Inspire Brands Hyderabad Support Center, India, will l...Show moreLast updated: 18 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Fission Labshyderabad, telangana, in
    Role : Lead Data Engineer (With Salesforce exposure).Location : Hyderabad (3 days from office).Headquartered in Sunnyvale, with offices in Dallas & Hyderabad, Fission Labs is a leading software devel...Show moreLast updated: 4 days ago
    • Promoted
    Data Architect / Data Modeler

    Data Architect / Data Modeler

    INUMELLAS CONSULTANCY SERVICES PRIVATE LIMITEDHyderabad,Bangalore,Chennai
    Role - Data Architect / Data Modeler Exp - 12 to 16 Yrs Locations - Chennai, Hyderabad, Bengaluru, Delhi, Pun...Show moreLast updated: 21 days ago
    • Promoted
    Lead Data Engineer- GCP

    Lead Data Engineer- GCP

    EgenHyderabad, Telangana, India
    We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team.The ideal candidate will...Show moreLast updated: 21 days ago
    • New!
    Lead Data Engineer

    Lead Data Engineer

    Talent WorxHyderabad, TS, IN
    Quick Apply
    Billion revenue with year-on-year growth of 22% and client retention rate of 120%.Our services include network analytics, payment integrity and optimization, provider credentialing, and provider en...Show moreLast updated: 7 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    QualiZealhyderabad, telangana, in
    We are seeking an experienced ETL Developer with 10+ years of expertise in SQL development and database architecture.The ideal candidate should have strong experience in ETL processes, data modelin...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer-Solution Architecture

    Lead Data Engineer-Solution Architecture

    ChubbHyderabad, Telangana, India
    Chubb is a world leader in insurance.With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental heal...Show moreLast updated: 23 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsHyderabad, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 8 days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesHyderabad, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainHyderabad, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incsecunderabad, telangana, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Coforgehyderabad, telangana, in
    ETL, Azure data factory, Azure Data Bricks, Data Modelling.The ideal candidate will design and maintain scalable data pipelines, ensure data quality and compliance, and support analytics through ro...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgehyderabad, telangana, in
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC ServicesHyderabad, India
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 30+ days ago