Talent.com
No longer accepting applications
Azure Data Lead Engineer

Azure Data Lead Engineer

Persistent Systemstirunelveli, tamil nadu, in
2 days ago
Job description

About Position :

We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team.

  • Role : Azure Data Lead Engineer
  • Location : Pune / Bangalore
  • Experience : 8 to 10 years
  • Job Type : Full Time Employment

What You'll Do :

  • Design and implement complex, scalable data pipelines for ingestion, processing, and transformation using Azure Databricks technologies.
  • Collaborate with Architects, Data Analysts, and Business Analysts to understand data requirements and develop efficient workflows.
  • Develop and manage data storage solutions including Azure SQL Database, Data Lake, and Blob Storage.
  • Leverage Azure Data Factory and other cloud-native tools to build and maintain ETL processes.
  • Conduct unit testing and ensure quality of data pipelines; mentor junior engineers and review their deliverables.
  • Monitor pipeline performance, troubleshoot issues, and provide regular status updates.
  • Optimise data workflows for performance and cost-efficiency; implement automation to reduce manual effort.
  • Expertise You'll Bring :

  • Around 8+ years of experience in Databricks and Azure cloud Data migration
  • Experience on migrating and re-modeling large enterprise data from legacy warehouse to Lakehouse (Delta Lake) on MS Fabric or Databricks.
  • Strong Data Engineering Skills : Proficiency in data extraction, transformation, and loading (ETL) processes, data modeling, and database management.
  • Also experience around setting up pipelines in Notebooks and ADF, setting up monitoring and alert notifications.
  • Experience with Data Lake Technologies : MS Fabric, Azure, Databricks, Python, Orchestration tool like Apache Airflow or Azure Data Factory, Azure Synapse along with stored procedures, Azure data lake storage.
  • Data Integration Knowledge : Familiarity with data integration techniques, including batch processing, streaming, and real-time data ingestion, auto-loader, change data capture, creation of fact and dimension tables.
  • Programming Skills : Proficiency in PySQL, SQL, Python, Pyspark for data manipulation and transformation.
  • Collaboration and Communication : Strong interpersonal skills to collaborate effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders.
  • Benefits :

  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
  • Values-Driven, People-Centric & Inclusive Work Environment :

    Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

  • We support hybrid work and flexible hours to fit diverse lifestyles.
  • Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
  • If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
  • Let’s unleash your full potential at Persistent - persistent.com / careers

    “Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

    Create a job alert for this search

    Azure Data Engineer • tirunelveli, tamil nadu, in

    Related jobs
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy ServicesThoothukudi, IN
    TCS is Hiring for Azure Data Engineer • •.Desired Experience : 10- 12 Years.Notice Period : Immediate to 15 days.Primary Skills : Microsoft SQL, Pyspark, Azure Synapse Analytics.Secondary Skills : Azure ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Azure Databricks Specialist

    Azure Databricks Specialist

    KPI PartnersThoothukudi, IN
    KPI Partners are seeking highly skilled and experienced Senior Data Engineers to join our dynamic team at KPI, working on challenging and multi-year data transformation projects for our clients.Thi...Show moreLast updated: less than 1 hour ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Thoothukudi, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    SystemBenderThoothukudi, IN
    Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Tata Consultancy ServicesThoothukudi, IN
    Job Title : Senior Azure Data Engineer.Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL. Good Knowledge of Data Brick lakehouse and Azure ...Show moreLast updated: 6 hours ago
    • Promoted
    Azure Databricks

    Azure Databricks

    Kumaran SystemsThoothukudi, IN
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Azure Data Engineer-Technical Lead

    Azure Data Engineer-Technical Lead

    SigmoidThoothukudi, IN
    Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience. We are looking for a detailed oriented self-starter to assist our eng...Show moreLast updated: 6 hours ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Wall Street Consulting Services LLCThoothukudi, IN
    Job Title : Azure Data Engineer.Location : Onsite in Rayadurgam, Hyderabad.We are seeking an experienced Azure Data Engineer Architect with hands-on expertise in designing and implementing scalable d...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    GSPANN Technologies, IncThoothukudi, IN
    Headquartered in California, U.GSPANN provides consulting and IT services to global clients.We help clients transform how they deliver business value by helping them optimize their IT capabilities,...Show moreLast updated: 6 hours ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersThoothukudi, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 2 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    People Prime WorldwideThoothukudi, IN
    Azure Data Lake Storage (Gen1 / Gen2).Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    TEKsystems Global Services in IndiaThoothukudi, IN
    Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    Capgemini InventThoothukudi, IN
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show moreLast updated: 6 hours ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tech MahindraThoothukudi, IN
    Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault".Experience in "GIT / Jenkins / Azure DevOps".Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Alp Consulting Ltd.Thoothukudi, IN
    Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroThoothukudi, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Azure Data Engineer - Full remote - contractor in USD

    Senior Azure Data Engineer - Full remote - contractor in USD

    All European CareersThoothukudi, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    LEAD DATA ENGINEER

    LEAD DATA ENGINEER

    Prophecy TechnologiesThoothukudi, IN
    We’re Hiring : LEAD DATA ENGINEER.Notice Period : Immediate to 30 Days.Design, build, and optimize scalable data pipelines on Azure Data Lake, Azure Databricks, and Azure Synapse.Develop ETL / ELT work...Show moreLast updated: 6 hours ago