Talent.com
This job offer is not available in your country.
Senior Data Engineer

Senior Data Engineer

Cynosure Corporate SolutionsChennai, Tamil Nadu, India
3 days ago
Job description

Key Responsibilities :

  • Design develop and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.
  • Build scalable and automated MLOps pipelines for model training validation and deployment using AWS SageMaker and related services.
  • Implement and manage Infrastructure as Code (IaC) using Terraform for AWS provisioning and maintenance.
  • Collaborate with ML Data Science and DevOps teams to ensure reliable and efficient model deployment workflows.
  • Optimize data storage and retrieval strategies for both structured and unstructured large-scale datasets.
  • Integrate and transform data from multiple sources into data lakes and data warehouses.
  • Monitor troubleshoot and improve performance of cloud-native data systems in a fast-paced production setup.
  • Ensure compliance with data governance privacy and security standards across all data operations.
  • Document data engineering workflows and architectural decisions for transparency and maintainability.

Requirements

  • 5 Years of experience as Data Engineer or in similar role
  • Proven experience in building data pipelines and streaming applications using Apache Kafka and Apache Flink.
  • Strong ETL development skills with deep understanding of data modeling and data architecture in large-scale environments.
  • Hands-on experience with AWS services including SageMaker S3 Glue Lambda and CloudFormation or Terraform.
  • Proficiency in Python and SQL; knowledge of Java is a plus especially for streaming use cases.
  • Strong grasp of MLOps best practices including model versioning monitoring and CI / CD for ML pipelines.
  • Deep knowledge of IaC tools particularly Terraform for automating cloud infrastructure.
  • Excellent analytical and problem-solving abilities especially with regard to data processing and deployment issues.
  • Agile mindset with experience working in fast-paced iterative development environments.
  • Strong communication and team collaboration skills.
  • Apache Kafka, Apache Flink,AWS SageMaker, Terraform, MLOPs, Python, Pyspark

    Education

    Bachelor s degree

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Employment Type : Full Time

    Experience : years

    Vacancy : 1

    Monthly Salary Salary : 120000 - 120000

    Create a job alert for this search

    Senior Data Engineer • Chennai, Tamil Nadu, India

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Incedo Inc.Chennai, Tamil Nadu, India
    Required Skills and Experience : .Strong hands-on experience with.API Gateway configuration, and monitoring.KMS, tokenization, IAM policies). Work mode- Hyd, 4days wfo in a week.Show moreLast updated: 12 days ago
    Senior Data Engineer

    Senior Data Engineer

    Grid DynamicsChennai, Tamil Nadu, India
    We are seeking a skilled Data Engineer with over 6+ years of experience to design, build, and maintain scalable data pipelines and perform advanced data analysis to support business intelligence an...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    LTIMindtreeChennai, Tamil Nadu, India
    Are you looking for a new career challenge? With LTIMindtree, are you ready to embark on a data-driven career? Working for global leading manufacturing client for providing an engaging product expe...Show moreLast updated: 17 days ago
    Senior Data Engineer

    Senior Data Engineer

    BlackStone eITIN
    Remote
    Quick Apply
    BlackStone eIT is on the lookout for a.In this role, you will be responsible for the design, development, and optimization of our data infrastructure. You'll play a crucial part in supporting data a...Show moreLast updated: 30+ days ago
    • Promoted
    Senior GCP Data Engineer

    Senior GCP Data Engineer

    GetronicsChennai, Tamil Nadu, India
    We have multiple opportunities for.Data Analytics team is seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance / expand team capabilities.They will wor...Show moreLast updated: 10 days ago
    Senior Data Engineer

    Senior Data Engineer

    Saaki Argus & Averil ConsultingChennai, Tamil Nadu, India
    Quick Apply
    Hiring Senior Data Engineer for an IT Product Company.Minimum 4+Yrs of Relevant Experience.Mandatory Skills : Strong expertise in Python ( Class methods), OOPS in Python, SQL , Databricks , AWS or A...Show moreLast updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    Cynosure Corporate SolutionsChennai, TN, in
    Quick Apply
    Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.Build scalable and automated MLOps pipelines for model training, validation, and ...Show moreLast updated: 6 days ago
    Senior Data Engineer

    Senior Data Engineer

    Forbes AdvisorChennai, India
    We are hiring a Senior Data Engineer to help design and scale the infrastructure behind our analytics performance marketing and experimentation platforms. This role is ideal for someone who thrives ...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Warehouse Engineer

    Senior Data Warehouse Engineer

    Asian HiresChennai, IN
    POSITION REPORTS TO : Senior Manager Application Development.DEPARTMENT : Information Technology.POSITION LOCATION : INDIA (REMOTE). COMPANY BUDGET : 18,00,000 - 23,00,000.We are seeking a highly skille...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Azure

    Senior Data Engineer - Azure

    INSIGHT INDChennai
    Senior Data Engineer-Azure Years of Experience : 5 Job location : Chennai J...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Agilisium ConsultingChennai, Tamil Nadu, India
    Data Integration and Transformation.Automation and Workflow Management.Life sciences / Pharma (Added advantage).Show moreLast updated: 23 days ago
    Senior Data Engineer

    Senior Data Engineer

    Ideas2IT TechnologiesChennai, Tamil Nadu, India
    As a Data Engineer, you'll build and maintain data pipelines and architectures.Responsibilities include optimizing databases and ETL processes, using Python or SQL,and collaborating with data teams...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer- AWS

    Senior Data Engineer- AWS

    YASH TechnologiesChennai, Tamil Nadu, India
    Primary skillsets : AWS, Pyspark, SQL, Databricks, Python.Secondary skillset- Any ETL Tool, Github, DevOPs(CI-CD).Degree in computer science, engineering, or similar fields.Mandatory Skill Set : Pyth...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ViasatChennai, Tamil Nadu, India
    At Viasat, we’re on a mission to deliver connections with the capacity to change the world.For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries arou...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Cimpress IndiaChennai, IN
    At Cimpress Technology, we are dedicated to crafting cutting-edge, world-class software solutions that power our mass customization businesses, serving a vast customer base of over 17 million indiv...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgeChennai, IN
    BrightEdge is a leading enterprise SEO and content performance platform trusted by over 1,500 global brands including Microsoft, Adobe, and Marriott. What makes BrightEdge special is our innovative ...Show moreLast updated: 23 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Chennai, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    LogitechChennai
    Logitech is the Sweet Spot for people who want their actions to have a positive global impact while having the flexibility to do it in their own way.Job Description : ...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DautomChennai, IN
    Java, MapReduce, Hive, and Spark jobs.HDFS, Pig, Hive, HBase, Sqoop, Flume.Analyze source data integrity and ensure accurate data ingestion. Build dashboards and BI solutions using best practices.Co...Show moreLast updated: 1 day ago
    Senior Python Data Engineer

    Senior Python Data Engineer

    Dexian IndiaChennai, Tamil Nadu, India
    Python Data Engineer – (6 to 12 Years Experience) in Python, Pyspark,.Data warehousing, Data pipeline design.Work location : Bangalore or Chennai. Design and develop data pipelines and ETL processes....Show moreLast updated: 1 day ago