Talent.com
Data Engineer
Data EngineerBayOne Solutions • guwahati, assam, in
Data Engineer

Data Engineer

BayOne Solutions • guwahati, assam, in
6 days ago
Job description

The Opportunity :

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end services, ensuring seamless integration within a microservices environment. You'll be responsible for building robust data solutions and crafting the APIs and services that power the customer experience. This role demands a strong understanding of microservices principles, data engineering best practices, back-end development, and experience with building scalable solutions.

Responsibilities :

  • Lead the design, development, and deployment of data engineering solutions and back-end services within a microservices environment.
  • Architect and implement scalable data pipelines for ingestion, processing, and storage of data from various sources, ensuring data quality and reliability.
  • Design, code, configure, test, debug, deploy, document, and maintain both data pipelines and back-end web service applications using a variety of software development toolkits, testing / verification applications and other tools, while adhering to specific development best practices and quality standards.
  • Work closely with solution engineers and architects to develop technical design specifications from which programs will be written or configured, with a strong focus on microservices integration for both data and application components.
  • Validate that proposed back-end services and data solutions align with both the architectural design and the business needs, ensuring seamless integration within the existing microservices environment.
  • Responsible for troubleshooting and issue analysis across the back-end stack, including data pipelines, microservices, and APIs, as well as coding, testing, and implementing software enhancements.
  • Implement and maintain data governance and API governance policies and standards across the microservices landscape.
  • Collaborate with cross-functional teams to define data requirements, design APIs, and deliver data-driven services.
  • Available to support / unblock planned deployments during off hours.
  • Contribute to the evolution of our data and application architecture, with a focus on microservices best practices, data engineering principles, and emerging technologies.
  • Lead and mentor other engineers, fostering a culture of innovation and collaboration across both data engineering and back-end development.

We are excited about you if you have experience with the following technologies :

  • Git, CI / CD, Jenkins, ArgoCD
  • Scala / Java, SQL / SparkSQL, Python
  • Apache Spark, Databricks, Apache Storm
  • Cosmos DB, Redis,
  • Maven, Gradle Build Tools
  • Kafka Ecosystem, Kafka Streams library, Kafka Avro Schemas
  • Cosmos DB, Redis Cache and Redis Insight Tool
  • Grafana, Grafana Loki Logging
  • Restful API Design Patterns, Swagger Documentation
  • Experience with markup languages such as JSON and YAML
  • Proven experience designing and implementing microservices architectures.
  • Strong understanding of data modeling, data warehousing, and ETL processes.
  • Experience with containerization technologies such as Docker and Kubernetes.
  • Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data engineering and back-end services.
  • Experience with Node.js.
  • Familiarity with Rust is a plus.

    Create a job alert for this search

    Data Engineer • guwahati, assam, in

    Related jobs
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • guwahati, assam, in
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 1 day ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • guwahati, assam, in
    Interview Date : Weekend Virtual Drive 15-Nov-25.Extensive coding experience (3+ years) including Python / Pyspark (1 years +). Experience developing in Azure with key data technologies (e.ADLS, ADF, A...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpress • guwahati, assam, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show more
    Last updated: 20 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Xsell Resources • guwahati, assam, in
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show more
    Last updated: 19 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    People Prime Worldwide • guwahati, assam, in
    Data Engineer (L4) – Python & AWS.We are looking for a Senior Data Engineer with strong expertise in.You will design and build scalable data pipelines, manage cloud-based data platforms, ensure dat...Show more
    Last updated: 6 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    TIGI HR • guwahati, assam, in
    The ideal candidate will have hands-on experience with.Develop, optimize, and maintain robust data pipelines using.Design and implement efficient data integration and transformation strategies.Ensu...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • guwahati, assam, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more
    Last updated: 28 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Teamware Solutions • guwahati, assam, in
    Greetings From Teamware Solutions.We’re Hiring – Azure Data Engineer | 6–8 Years Experience 🚀.We are looking for a highly skilled. Azure Data Factory, PySpark, and Databricks.Chennai / Bangalore / ...Show more
    Last updated: 6 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Kissht • guwahati, assam, in
    We are looking for a highly motivated and passionate Junior Data Engineer to join our growing data team.This role is perfect for fresh graduates or early-career professionals who have strong analyt...Show more
    Last updated: 6 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    System Soft Technologies • guwahati, assam, in
    Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
    Last updated: 6 hours ago • Promoted • New!
    Principal Data Engineer

    Principal Data Engineer

    CodeMyMobile • guwahati, assam, in
    Experience Required - 7 to 10 Years.Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect!.Email your ...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Engineer-Databricks Expert (Part-Time)

    Senior Data Engineer-Databricks Expert (Part-Time)

    Saradysol Tech Ventures Private Limited • guwahati, assam, in
    Senior Data Engineer – Databricks Expert (Part-Time Contractor).We are looking for a highly experienced Data Engineer with deep expertise in Databricks to join us as a part-time contractor.You will...Show more
    Last updated: 6 hours ago • Promoted • New!
    Data Engineer – AWS

    Data Engineer – AWS

    Recruin • guwahati, assam, in
    Design, develop, and maintain data pipelines using AWS services such as Glue, Lambda, Step Functions, EMR, Kinesis, and S3. Build and optimize data warehouses and data lakes on AWS (Redshift, Lake F...Show more
    Last updated: 6 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Persistent Systems • guwahati, assam, in
    We are looking for a Data Engineer with Python AWS experience.Job Type : Full Time Employment.Understand the domain for which the entities are being created. Understand the entity creation process fr...Show more
    Last updated: 10 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Algonomy • guwahati, assam, in
    Lead / Principal Software Engineer.At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will cons...Show more
    Last updated: 6 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltd • guwahati, assam, in
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    K&K Talents • guwahati, assam, in
    This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai. Tableau | ETL / ELT | SQL | Python | Snow...Show more
    Last updated: 1 day ago • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Live Connections • guwahati, assam, in
    Role - Snowflake Data Engineer.Required Notice Period - Immediate Joiner.To apply, connect with Abhishek via abhishek.Show more
    Last updated: 10 days ago • Promoted