Talent.com
Senior Data Pipeline Engineer

Senior Data Pipeline Engineer

SutherlandRepublic Of India, IN
21 hours ago
Job description

Location : Bangalore | Hyderabad | Chennai | Mumbai

If interested please reach out to me with your updated resume @priti.kumari@sutherlandglobal.com

Senior Data Engineer

About the Job : We’re transforming how we work by harnessing the power of AI, data, and digital innovation to accelerate the discovery and development of life-saving therapies. Our vision is to embed artificial intelligence and advanced analytics across every stage of our scientific and operational workflows—empowering our teams with smarter tools, seamless data, and actionable insights to deliver client-centric services and solutions that better serve our customers and, ultimately, improve patients’ lives.

As a Senior Data Engineer within our Enterprise Data and Analytics team, you’ll be at the forefront of a company-wide digital transformation. We’re looking for a forward-thinking engineer who brings deep technical expertise and a passion for building scalable, AI-ready data platforms. In this role, you’ll architect and implement modern data solutions that power intelligent applications, streamline operations, and deliver measurable business value. You’ll work closely with cross-functional teams to design robust pipelines, integrate diverse data sources, and enable advanced analytics and generative AI capabilities. This is a unique opportunity to shape the future of data engineering and help unlock the full potential of data to drive innovation in the life sciences.

Key Responsibilities :

  • Design, develop, and maintain scalable data pipelines and ETL processes using Azure Data Factory, Azure Data Bricks, and other Azure services.
  • Implement and optimize data storage solutions using Azure Data Lake, Azure SQL Database, and Delta Lake to support analytics and reporting needs.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality, reliable datasets.
  • Ensure data security, compliance, and governance by applying best practices, role-based access control (RBAC), and encryption.
  • Monitor and troubleshoot data workflows, ensuring performance, reliability, and cost-efficiency across Azure cloud environments.
  • Automate data integration and transformation tasks using Azure Functions, Logic Apps, and scripting languages like Python.
  • Mentor junior engineers and foster a collaborative team environment.

Essential Qualifications :

  • Bachelor’s degree in computer engineering, Computer Science, or a related discipline
  • 7+ years of experience in ETL design, development, and performance tuning using the Microsoft Stack in a multi-dimensional data warehousing environment.
  • 7+ years of advanced SQL programming expertise (PL / SQL, T-SQL)
  • 5+ years of experience in Enterprise Data & Analytics solution architecture
  • 3+ years of experience in Python Programming
  • 3+ years of hands-on experience with Azure, especially for data-heavy / analytics applications leveraging relational and NoSQL databases, Data Warehousing, and Big Data solutions.
  • 3+ years of experience with key Azure services : Azure Data Factory, Data Lake Gen2, Analysis Services, Databricks, Blob Storage, SQL Database, Cosmos DB, App Service, Logic Apps, and Functions
  • 2+ years of experience designing data models aligning with business requirements and analytics needs.
  • 2+ years of experience defining and implementing data security standards, including encryption, auditing, and monitoring.
  • Strong analytical skills and a passion for intellectual curiosity
  • Preferred Skills :

  • Familiarity with DevOps processes (CI / CD) and infrastructure as code
  • Knowledge of Master Data Management (MDM) and Data Quality tools
  • Experience developing REST APIs using Java Spring Boot, Python
  • Experience building and supporting AL / ML software solutions
  • Familiarity with stream-processing systems (e.G., Event Hubs, Storm, Spark-Streaming)
  • Experience with API integrations (RESTful, SOAP) for both internal and external systems to enhance data flow and automation.
  • Experience working in Agile environments, familiarity with Agile tools like Jira or Azure DevOps.
  • Experience in data and analytics within the Life Sciences industry is a plus.
  • Create a job alert for this search

    Senior Data Engineer • Republic Of India, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasNagpur, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 1 day ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsIndia, India
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Guidanz IncNagpur, IN
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsnagpur, maharashtra, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    AIMLEAPIndia, India
    Senior Data Engineer – ETL & Pipeline Development.Remote (Work from Home) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.Pandas, Airflow, o...Show moreLast updated: 20 hours ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladenagpur, maharashtra, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Masteknagpur, maharashtra, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivenagpur, maharashtra, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticsnagpur, maharashtra, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroNagpur, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyNagpur, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyantNagpur, IN
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 12 days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    Dexian Indianagpur, maharashtra, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Conagpur, maharashtra, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Veraxionnagpur, maharashtra, in
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AINagpur, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labsnagpur, maharashtra, in
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreenagpur, maharashtra, in
    We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago