Talent.com
No longer accepting applications
Senior Data Engineer

Senior Data Engineer

People Prime WorldwideHyderabad, IN
30+ days ago
Job description

We are seeking a highly skilled Senior Data Engineer with deep expertise in

Microsoft Azure data ecosystem to design, develop, and maintain scalable data

pipelines and architectures. The ideal candidate will play a key role in building robust

data solutions that support advanced analytics, BI, and AI workloads across the

organization. This role involves working with cross-functional teams — data scientists,

analysts, and business stakeholders — to ensure high-quality, secure, and performant

data delivery.

Total experience : 8 to 10 years

Key Responsibilities :

1. Data Architecture & Pipeline Development

  • Design, develop, and maintain data ingestion, transformation, and storage

pipelines using Azure Data Factory, Azure Databricks, and Synapse Analytics.

  • Build end-to-end ETL / ELT workflows from diverse sources such as APIs, on-prem
  • databases, SaaS applications, and data lakes.

  • Implement data modeling (star schema, snowflake, data vault, etc.) for analytical
  • and operational data stores.

  • Manage data ingestion frameworks for both batch and streaming (real-time) use
  • cases using Azure Event Hubs / Azure Stream Analytics / Kafka.

    2. Data Management & Governance

  • Ensure data quality, consistency, and integrity across all environments.
  • Implement and enforce data governance standards, including metadata
  • management, lineage tracking, and data cataloging (e.g., Azure Purview).

  • Manage security, compliance, and access controls using Azure Active Directory
  • (AAD) and RBAC principles.

  • Automate data validation, auditing, and monitoring workflows using modern
  • DevOps practices.

    3. Cloud & DevOps Integration

  • Manage and optimize Azure Data Lake Storage (ADLS Gen2) for cost and
  • performance.

  • Leverage Infrastructure as Code (IaC) tools such as Terraform, Bicep, or ARM
  • templates for environment provisioning.

  • Implement CI / CD pipelines for data workflows using Azure DevOps / GitHub
  • Actions.

  • Optimize compute and storage costs while maintaining scalability and resilience.
  • 4. Collaboration & Leadership

  • Partner with data scientists, BI developers, and product teams to deliver reliable
  • data solutions.

  • Mentor junior data engineers on best practices, coding standards, and Azure
  • services.

  • Participate in architectural reviews and contribute to data platform design
  • decisions.

  • Communicate technical insights and trade-offs to non-technical stakeholders
  • effectively.

    Required Skills :

    Core Azure Services :

  • Azure Data Factory (ADF) – pipeline orchestration, triggers, linked services,
  • integration runtime.

  • Azure Databricks – PySpark, Delta Lake, notebooks, job orchestration.
  • Azure Synapse Analytics – dedicated and serverless SQL pools, data modeling,
  • query optimization.

  • Azure Data Lake Storage (ADLS Gen2) – hierarchical namespace, lifecycle
  • management.

  • Azure Functions / Logic Apps – event-driven data workflows.
  • Azure Event Hubs / Kafka / Stream Analytics – real-time data ingestion.
  • Programming & Tools :

    Strong in Python or Scala for data transformations.

    Proficient in SQL (T-SQL, Spark SQL, or Synapse SQL).

    Experience with PySpark for distributed data processing.

    Knowledge of Git, CI / CD, and DevOps best practices.

    Familiarity with Power BI integration or other reporting tools is a plus.Data Architecture & Modeling :

  • Expertise in data warehouse design, data lakehouse architecture, and data
  • pipelines.

  • Understanding of data partitioning, indexing, and query optimization
  • techniques.

  • Experience with dimensional modeling, slowly changing dimensions, and fact
  • tables.

    Other :

  • Experience with API-based data ingestion and RESTful integrations.
  • Exposure to machine learning data pipelines or feature stores is a plus.
  • Familiarity with cost optimization and performance tuning in Azure.
  • Soft Skills

    Excellent analytical and problem-solving abilities.

    Strong communication and documentation skills.

    Ability to work in an agile, fast-paced environment.

    Proven experience collaborating in cross-functional teams.

    Self-driven with a passion for data engineering and cloud technologies.

    Create a job alert for this search

    Senior Data Engineer • Hyderabad, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh IncHyderabad, Telangana, India
    Data Engineer (Contract-to-Hire | Remote) Experience Level : 6+ Years Location : Remote Contract Type : Full-Time / Fixed-Term Contract (12 months, extendable based on performance) Notice : Immedia...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Coffeee.ioSecunderabad, Telangana, India
    Job Title : Lead Data Engineer – SnapLogic Location : Remote Experience : 8+ years (with 3+ years in SnapLogic ETL) Employment Type : Full-time Role Overview : We are seeking a Lead Data Engineer – ...Show moreLast updated: 14 hours ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    ConfidentialDelhi, Hyderabad / Secunderabad, Telangana
    Response Informatics is looking for AWS Data Engineer to join our dynamic team and embark on a rewarding career journey.Liaising with coworkers and clients to elucidate the requirements for each ta...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    AIQUHyderabad, IN
    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable. The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer - Snowflake / AWS

    Senior Data Engineer - Snowflake / AWS

    ResourcetreeHyderabad
    About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLHyderabad, Telangana, India
    The role involves building and optimizing ETL / ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI / ML, and business intelligence use cases.AWS (S...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras AnalyticsHyderabad, Telangana, India
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    People Prime WorldwideHyderabad, Telangana, India
    We are seeking a highly skilled Senior Data Engineer with deep expertise in.Microsoft Azure data ecosystem to design, develop, and maintain scalable data. The ideal candidate will play a key role in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyhyderabad, telangana, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Manuh TechnologiesHyderabad, IN
    Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability. Troubleshoot and resolve data-relat...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIHyderabad, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladesecunderabad, telangana, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Greystarhyderabad, telangana, in
    We are looking for a strong Data Architect to join our engineering team, focusing on leveraging Azure SQL, Cosmos DB and DataBricks to meet our growing data demands. As a Data Leader in the Apex org...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ConfidentialDelhi, Hyderabad / Secunderabad, Telangana
    Works on problems of moderate to large scope where analysis of situations or data requires a review of a variety of factors. Exercises judgment within defined procedures and practices to determine a...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Engineer, Data Engineering

    Staff Engineer, Data Engineering

    ConfidentialPune, Hyderabad / Secunderabad, Telangana
    The Data Engineering team builds and optimizes systems spanning data ingestion, processing, storage optimization and more. We work closely with engineers and the product team to build highly scalabl...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Analytics Engineer

    Senior Data Analytics Engineer

    ConfidentialHyderabad / Secunderabad, Telangana, Pune, Chennai
    Minimum Experience, Behaviors and Education Requirements.Bachelors or masters degree in computer science, Engineering, or a related field. Data Engineer, preferably in a global organization.Proficie...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer TPC

    Data Engineer TPC

    ConfidentialDelhi, Hyderabad / Secunderabad, Telangana
    Response Informatics is looking for Data Engineer TPC to join our dynamic team and embark on a rewarding career journey.Liaising with coworkers and clients to elucidate the requirements for each ta...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIHyderabad, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 20 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Nityo InfotechHyderabad, Telangana, India
    Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes Experience - 5 Years Mode- Remote Required Qualifications - Minimum 5 years of experience in Data Engineering or Infra...Show moreLast updated: 21 hours ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    ConfidentialHyderabad / Secunderabad, Telangana, Chennai
    Azure Data Solutions Development : .Design, develop, and maintain scalable and efficient data solutions primarily leveraging. Build robust ETL / ELT data pipelines using Azure services, ensuring data qu...Show moreLast updated: 30+ days ago