Talent.com
Data Engineer
Data EngineerBayOne Solutions • Trivandrum, Kerala, India
Data Engineer

Data Engineer

BayOne Solutions • Trivandrum, Kerala, India
30+ days ago
Job description

The Opportunity :

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end services, ensuring seamless integration within a microservices environment. You'll be responsible for building robust data solutions and crafting the APIs and services that power the customer experience. This role demands a strong understanding of microservices principles, data engineering best practices, back-end development, and experience with building scalable solutions.

Responsibilities :

  • Lead the design, development, and deployment of data engineering solutions and back-end services within a microservices environment.
  • Architect and implement scalable data pipelines for ingestion, processing, and storage of data from various sources, ensuring data quality and reliability.
  • Design, code, configure, test, debug, deploy, document, and maintain both data pipelines and back-end web service applications using a variety of software development toolkits, testing / verification applications and other tools, while adhering to specific development best practices and quality standards.
  • Work closely with solution engineers and architects to develop technical design specifications from which programs will be written or configured, with a strong focus on microservices integration for both data and application components.
  • Validate that proposed back-end services and data solutions align with both the architectural design and the business needs, ensuring seamless integration within the existing microservices environment.
  • Responsible for troubleshooting and issue analysis across the back-end stack, including data pipelines, microservices, and APIs, as well as coding, testing, and implementing software enhancements.
  • Implement and maintain data governance and API governance policies and standards across the microservices landscape.
  • Collaborate with cross-functional teams to define data requirements, design APIs, and deliver data-driven services.
  • Available to support / unblock planned deployments during off hours.
  • Contribute to the evolution of our data and application architecture, with a focus on microservices best practices, data engineering principles, and emerging technologies.
  • Lead and mentor other engineers, fostering a culture of innovation and collaboration across both data engineering and back-end development.

We are excited about you if you have experience with the following technologies :

  • Git, CI / CD, Jenkins, ArgoCD
  • Scala / Java, SQL / SparkSQL, Python
  • Apache Spark, Databricks, Apache Storm
  • Cosmos DB, Redis,
  • Maven, Gradle Build Tools
  • Kafka Ecosystem, Kafka Streams library, Kafka Avro Schemas
  • Cosmos DB, Redis Cache and Redis Insight Tool
  • Grafana, Grafana Loki Logging
  • Restful API Design Patterns, Swagger Documentation
  • Experience with markup languages such as JSON and YAML
  • Proven experience designing and implementing microservices architectures.
  • Strong understanding of data modeling, data warehousing, and ETL processes.
  • Experience with containerization technologies such as Docker and Kubernetes.
  • Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data engineering and back-end services.
  • Experience with Node.js.
  • Familiarity with Rust is a plus.

    Create a job alert for this search

    Data Engineer • Trivandrum, Kerala, India

    Related jobs
    Data Engineer

    Data Engineer

    EXL • Trivandrum, Kerala, India
    Title : AWS DE Experience : 6+ years Notice : Immediate to 15 days Role Overview : • The person will be part of the EDP Data Platform (EDP) team for a major Insurance client. He / She will work with dif...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Aceolution • Trivandrum, Kerala, India
    Job Title : Data Engineer – Python Expert(Freelance Role) Location : Remote / Hybrid Employment Type : Contract / Freelance Role Summary We are looking for a seasoned Senior Data Engineer to archit...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Confidential • Trivandrum, Kerala, India
    Skillset Required • 7+ years of experience in software development, with a strong foundation in distributed systems, cloud-native architectures, and data platforms. Expertise in big data technologie...Show more
    Last updated: 11 hours ago • Promoted • New!
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • Trivandrum, Kerala, India
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 11 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Trivandrum, Kerala, India
    Job Title : Data Engineer Experience : 5–9 years Location : [Remote] Job Summary : We are looking for a skilled Data Engineer with strong expertise in Python, PySpark, AWS services (Glue, Lambda)...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Ironbook AI • Trivandrum, Kerala, India
    Role Summary We are looking for a Senior Data Engineer to design, build, and optimize high-performance data pipelines and data systems. The ideal candidate will have strong experience with cloud p...Show more
    Last updated: 11 hours ago • Promoted • New!
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Trivandrum, Kerala, India
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    ShimentoX Technologies • Trivandrum, Kerala, India
    Data Engineer (Strong with Building data connectors) Location : Remote Key Skills : Python, Data Connectors, Metadata, API Integration-Rest / GraphQL Job Description : 1. Must have proven background in...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer (Snowflake + Databricks)

    Data Engineer (Snowflake + Databricks)

    MyRemoteTeam Inc • Trivandrum, Kerala, India
    About Us MyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operati...Show more
    Last updated: 11 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    MyRemoteTeam Inc • Trivandrum, Kerala, India
    About Us MyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operati...Show more
    Last updated: 11 hours ago • Promoted • New!
    GCP Data Engineer

    GCP Data Engineer

    Adastra • Trivandrum, Kerala, India
    Job Description We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQue...Show more
    Last updated: 17 days ago • Promoted
    Data Engineer ( Databricks Specialist)

    Data Engineer ( Databricks Specialist)

    mindcurv • Cochin, Coimbatore, Trivandrum, IN
    Quick Apply
    About Mindcurv (Part of Accenture Song) We help our customers rethink their digital business, experiences, and technology to navigate the new digital reality. We do this by designing sustainable and...Show more
    Last updated: 30+ days ago
    PySpark Data Engineer

    PySpark Data Engineer

    EXTRAGIG • Trivandrum, Kerala, India
    Contract Assistant – Data Engineer Support (Remote, EST Hours) Start Date : Sept 10, 2025 ⏳ Duration : 6 months (extendable) Pay : $1,000 / month Work Hours : 8 : 00 AM – 5 : 30 PM EST We’re looking for...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyati • Trivandrum, Kerala, India
    Senior Data Engineer Job Title : Senior Data Engineer Location : Remote / Willing to Travel Job Type : Full-time Experience Level : 8+ years About the Role : We are seeking a highly skilled Senior ...Show more
    Last updated: 16 days ago • Promoted
    AI Data Engineer

    AI Data Engineer

    Turing • Trivandrum, Kerala, India
    Role Overview : We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Randstad Enterprise • Trivandrum, Kerala, India
    Role : Data Engineer Location : Remote Shift Timing : 2 : 00 Pm - 11 : 00 Pm Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ) Must have skillset : GCP - 2 yea...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Ironbook AI • Trivandrum, Kerala, India
    We are seeking an experienced and driven Lead Data Engineer to spearhead the design and development of a modern, cloud-native data warehouse on AWS. This role is critical to building a scalable, sec...Show more
    Last updated: 11 hours ago • Promoted • New!
    Azure Data Engineer

    Azure Data Engineer

    Paritas Recruitment • Trivandrum, Kerala, India
    Azure Data Engineer - 6 Month+ Rolling Contract Market Day Rate on offer Remote - (Sunday to Thursday working days) Location : Remote - 1 Week per quarter in Qatar Paritas is working with a glob...Show more
    Last updated: 1 day ago • Promoted