Talent.com
Data Engineer
Data EngineerBayOne Solutions • kolkata, west bengal, in
Data Engineer

Data Engineer

BayOne Solutions • kolkata, west bengal, in
9 days ago
Job description

The Opportunity :

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end services, ensuring seamless integration within a microservices environment. You'll be responsible for building robust data solutions and crafting the APIs and services that power the customer experience. This role demands a strong understanding of microservices principles, data engineering best practices, back-end development, and experience with building scalable solutions.

Responsibilities :

  • Lead the design, development, and deployment of data engineering solutions and back-end services within a microservices environment.
  • Architect and implement scalable data pipelines for ingestion, processing, and storage of data from various sources, ensuring data quality and reliability.
  • Design, code, configure, test, debug, deploy, document, and maintain both data pipelines and back-end web service applications using a variety of software development toolkits, testing / verification applications and other tools, while adhering to specific development best practices and quality standards.
  • Work closely with solution engineers and architects to develop technical design specifications from which programs will be written or configured, with a strong focus on microservices integration for both data and application components.
  • Validate that proposed back-end services and data solutions align with both the architectural design and the business needs, ensuring seamless integration within the existing microservices environment.
  • Responsible for troubleshooting and issue analysis across the back-end stack, including data pipelines, microservices, and APIs, as well as coding, testing, and implementing software enhancements.
  • Implement and maintain data governance and API governance policies and standards across the microservices landscape.
  • Collaborate with cross-functional teams to define data requirements, design APIs, and deliver data-driven services.
  • Available to support / unblock planned deployments during off hours.
  • Contribute to the evolution of our data and application architecture, with a focus on microservices best practices, data engineering principles, and emerging technologies.
  • Lead and mentor other engineers, fostering a culture of innovation and collaboration across both data engineering and back-end development.

We are excited about you if you have experience with the following technologies :

  • Git, CI / CD, Jenkins, ArgoCD
  • Scala / Java, SQL / SparkSQL, Python
  • Apache Spark, Databricks, Apache Storm
  • Cosmos DB, Redis,
  • Maven, Gradle Build Tools
  • Kafka Ecosystem, Kafka Streams library, Kafka Avro Schemas
  • Cosmos DB, Redis Cache and Redis Insight Tool
  • Grafana, Grafana Loki Logging
  • Restful API Design Patterns, Swagger Documentation
  • Experience with markup languages such as JSON and YAML
  • Proven experience designing and implementing microservices architectures.
  • Strong understanding of data modeling, data warehousing, and ETL processes.
  • Experience with containerization technologies such as Docker and Kubernetes.
  • Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data engineering and back-end services.
  • Experience with Node.js.
  • Familiarity with Rust is a plus.

    Create a job alert for this search

    Data Engineer • kolkata, west bengal, in

    Related jobs
    Software Engineer

    Software Engineer

    LTIMindtree • kolkata, west bengal, in
    LTIMINDTREE hiring for ServiceNow Developer- UI Builder.Location : PAN INDIA (LTIM Locations).Preferred Immediate-0 to 30 days joiners. If interested please share your updated profile to ajayr.Servic...Show more
    Last updated: 30+ days ago • Promoted
    Engineering Lead

    Engineering Lead

    Altellect • kolkata, west bengal, in
    Koramangala, Bangalore | 5 Days WFO.Altellect is building the next generation of intelligent, high-growth, product-led ventures — and we’re looking for leaders who can help us shape the future.We a...Show more
    Last updated: 3 hours ago • Promoted • New!
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • kolkata, west bengal, in
    Job Title : Azure Data Engineer.Required Skillset : Azure Databricks, Pyspark, SQL, ADF, Data Lake.Azure Databricks, Pyspark, SQL, ADF. Responsibility of / Expectations from the Role : .Analyzing and tr...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Programmers.io • kolkata, west bengal, in
    We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show more
    Last updated: 30+ days ago • Promoted
    Data Analyst / Business Analyst

    Data Analyst / Business Analyst

    ACL Digital • kolkata, west bengal, in
    Claims, Member, Provider, Encounter).Skilled in SQL and BI tools (Tableau, Power BI); capable of translating business needs into data and reporting requirements.Show more
    Last updated: 14 days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Programmers.io • kolkata, west bengal, in
    Job Title : Senior Full Stack Developer (Laravel + Vue).We are seeking highly skilled Senior Full Stack Developers with 7–10 years of experience in Laravel and modern frontend frameworks (Vue.The ca...Show more
    Last updated: 13 days ago • Promoted
    Application Support Engineer / Full Stack Support Engineer - Remote Work

    Application Support Engineer / Full Stack Support Engineer - Remote Work

    techolution • kolkata, west bengal, in
    Remote
    Sev1 / Sev2) and contributing to application development.This hybrid role requires strong expertise in Python, TypeScript, AWS services, CI / CD pipelines, and monitoring tools.The ideal candidate shou...Show more
    Last updated: 3 hours ago • Promoted • New!
    Machine Learning Engineer

    Machine Learning Engineer

    Recro • kolkata, west bengal, in
    What would you be doing / Expected from this role?.Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.Drive the archite...Show more
    Last updated: 30+ days ago • Promoted
    Technology Analyst and Writer

    Technology Analyst and Writer

    Zamun • kolkata, west bengal, in
    This role specializes in managing research projects from start to finish, using advanced pipelines with multiple AI agents to deliver deep insights on technology and innovation.The successful candi...Show more
    Last updated: 3 hours ago • Promoted • New!
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • kolkata, west bengal, in
    We offer a vibrant and collaborative work environment, cutting-edge tools and technologies, and ample opportunities for professional growth. Job Title : Azure Data Architect.Experience required : 15+ ...Show more
    Last updated: 16 days ago • Promoted
    Lead Electrical Engineer

    Lead Electrical Engineer

    Reliance Industries Limited • kolkata, west bengal, in
    To lead and oversee all electrical works for the AI / Data Center project, ensuring the development of high-performance, resilient, and energy-efficient electrical infrastructure to support advanced ...Show more
    Last updated: 15 days ago • Promoted
    Senior Java Software Engineer

    Senior Java Software Engineer

    ACL Digital • kolkata, west bengal, in
    We are looking Remotly for Senior Java Developer for permanent role.Experience : 5 Years to 8 Years.Notice Period : Immediate(Next Day joiner only). We are seeking a highly skilled and experienced.The...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Insight Global • kolkata, west bengal, in
    Contract with Insight Global Client.React, React Native, TypeScript.React, React Native, and TypeScript.Deploy containerized solutions using. Ensure high-quality deliverables through.CI / CD pipelines...Show more
    Last updated: 30+ days ago • Promoted
    Mobil Uygulama Geliştirici

    Mobil Uygulama Geliştirici

    oanakademi • kolkata, west bengal, in
    We are looking for an experienced.The ideal candidate has strong expertise in building.UI / UX principles, and the ability to work collaboratively with designers and backend developers.Develop and ma...Show more
    Last updated: 3 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Tata Consultancy Services • kolkata, west bengal, in
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Data Analyst

    Data Analyst

    Nonrel Technologies • kolkata, west bengal, in
    Nonrel Technologies is a leading IT software company dedicated to transforming businesses through innovative, scalable, and secure software solutions. We specialize in custom software development, c...Show more
    Last updated: 3 hours ago • Promoted • New!
    Senior System Engineer

    Senior System Engineer

    ZoofyTechX • kolkata, west bengal, in
    IT solutions partner helping businesses bridge the gap between their goals and the right technology.We support organizations in identifying, integrating, and managing solutions across hardware, sof...Show more
    Last updated: 3 hours ago • Promoted • New!
    Business Analytics Fellowship Associate

    Business Analytics Fellowship Associate

    HEProAI • kolkata, west bengal, in
    Business Analytics Fellowship Associate.The Business Analytics Fellowship Associate will participate in a structured, project-based learning program designed to build foundational and intermediate ...Show more
    Last updated: 3 hours ago • Promoted • New!