Talent.com
Data Engineer
Data EngineerBayOne Solutions • kolkata, west bengal, in
Data Engineer

Data Engineer

BayOne Solutions • kolkata, west bengal, in
10 days ago
Job description

The Opportunity :

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end services, ensuring seamless integration within a microservices environment. You'll be responsible for building robust data solutions and crafting the APIs and services that power the customer experience. This role demands a strong understanding of microservices principles, data engineering best practices, back-end development, and experience with building scalable solutions.

Responsibilities :

  • Lead the design, development, and deployment of data engineering solutions and back-end services within a microservices environment.
  • Architect and implement scalable data pipelines for ingestion, processing, and storage of data from various sources, ensuring data quality and reliability.
  • Design, code, configure, test, debug, deploy, document, and maintain both data pipelines and back-end web service applications using a variety of software development toolkits, testing / verification applications and other tools, while adhering to specific development best practices and quality standards.
  • Work closely with solution engineers and architects to develop technical design specifications from which programs will be written or configured, with a strong focus on microservices integration for both data and application components.
  • Validate that proposed back-end services and data solutions align with both the architectural design and the business needs, ensuring seamless integration within the existing microservices environment.
  • Responsible for troubleshooting and issue analysis across the back-end stack, including data pipelines, microservices, and APIs, as well as coding, testing, and implementing software enhancements.
  • Implement and maintain data governance and API governance policies and standards across the microservices landscape.
  • Collaborate with cross-functional teams to define data requirements, design APIs, and deliver data-driven services.
  • Available to support / unblock planned deployments during off hours.
  • Contribute to the evolution of our data and application architecture, with a focus on microservices best practices, data engineering principles, and emerging technologies.
  • Lead and mentor other engineers, fostering a culture of innovation and collaboration across both data engineering and back-end development.

We are excited about you if you have experience with the following technologies :

  • Git, CI / CD, Jenkins, ArgoCD
  • Scala / Java, SQL / SparkSQL, Python
  • Apache Spark, Databricks, Apache Storm
  • Cosmos DB, Redis,
  • Maven, Gradle Build Tools
  • Kafka Ecosystem, Kafka Streams library, Kafka Avro Schemas
  • Cosmos DB, Redis Cache and Redis Insight Tool
  • Grafana, Grafana Loki Logging
  • Restful API Design Patterns, Swagger Documentation
  • Experience with markup languages such as JSON and YAML
  • Proven experience designing and implementing microservices architectures.
  • Strong understanding of data modeling, data warehousing, and ETL processes.
  • Experience with containerization technologies such as Docker and Kubernetes.
  • Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data engineering and back-end services.
  • Experience with Node.js.
  • Familiarity with Rust is a plus.

    Create a job alert for this search

    Data Engineer • kolkata, west bengal, in

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • kolkata, west bengal, in
    Primesoft Enterprise IT Services Pvt.As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learnin...Show more
    Last updated: 30+ days ago • Promoted
    Principal QA Engineer (Cypress)

    Principal QA Engineer (Cypress)

    CES • kolkata, west bengal, in
    Design, develop, and maintain robust testing strategies and automation platforms.Author and execute functional test cases and automation scripts for complex features. Define and implement automation...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • kolkata, west bengal, in
    Job Title : Azure Data Engineer.Required Skillset : Azure Databricks, Pyspark, SQL, ADF, Data Lake.Azure Databricks, Pyspark, SQL, ADF. Responsibility of / Expectations from the Role : .Analyzing and tr...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    Peak Trust Global Real Estate • kolkata, west bengal, in
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Software Engineer

    Senior Software Engineer

    Programmers.io • kolkata, west bengal, in
    We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • kolkata, west bengal, in
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 16 days ago • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Recro • kolkata, west bengal, in
    Job Description : AI / ML Engineer (3D Geometry & Manufacturing).We are seeking an exceptionally talented and entrepreneurial. Design for Manufacturability (DFM).If you are passionate about leveraging ...Show more
    Last updated: 30+ days ago • Promoted
    Python Developer

    Python Developer

    TekXera • kolkata, west bengal, in
    Senior Python Engineer – Service Implementation.India | Pakistan | Nigeria | Kenya | Egypt | Ghana | Bangladesh | Turkey | Mexico. Full-Time Contract (9 Months, Extendable).San Francisco–based AI re...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Java AWS Engineer

    Senior Java AWS Engineer

    Applicantz • kolkata, west bengal, in
    THIS IS A LONG TERM CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER.Candidate should be very good in Java and Spring. Must worked on complex system and ready to onboard quickly....Show more
    Last updated: 24 days ago • Promoted
    Architect

    Architect

    Veltris • kolkata, west bengal, in
    AI Architect - Telecom & Networking.Routing, Switching / SD-WAN / Provider Edge).ML Algorithms; Graph Neural Networks, Time-series Forecasting Algorithms (ARIMA, LSTM…). ML / DL libraries (PyTorch, Te...Show more
    Last updated: 9 hours ago • Promoted • New!
    Lead Full-Stack + AI Engineer (Founding Team)

    Lead Full-Stack + AI Engineer (Founding Team)

    Grovio AI • kolkata, west bengal, in
    We’re building an autonomous, multi-agent AI OS that plans, executes, and optimizes marketing across modern digital ecosystems. Think : an AI that acts like a virtual CMO — planning, writing, analyz...Show more
    Last updated: 1 hour ago • Promoted • New!
    Full Stack Engineer

    Full Stack Engineer

    AideWiser SolTek • kolkata, west bengal, in
    AWS (EC2, Lambda, S3, RDS, DynamoDB, etc.Design, develop, and maintain backend services using.Net Core / MVC and frontend components using React. Build and scale backend systems on AWS cloud infrastru...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer Intern

    AI Engineer Intern

    Qureal AI • kolkata, west bengal, in
    Hiring : AI Engineer Intern (Remote + Paid).We are looking for a dedicated AI Engineer Intern.This role offers a real opportunity to transition into a full-time position based on performance.PPO / F...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Analyst (Remote)

    Data Analyst (Remote)

    Generative Futures • kolkata, west bengal, in
    Remote
    We’re looking for an experienced Data Analyst to join an exciting US-based startup with excellent funding.This position will be fully remote, with flexibility around the timezone worked.In this rol...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer

    Data Engineer

    Grantify • kolkata, west bengal, in
    Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirat...Show more
    Last updated: 9 hours ago • Promoted • New!
    Full Stack Engineer

    Full Stack Engineer

    Insight Global • kolkata, west bengal, in
    Contract with Insight Global Client.React, React Native, TypeScript.React, React Native, and TypeScript.Deploy containerized solutions using. Ensure high-quality deliverables through.CI / CD pipelines...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • kolkata, west bengal, in
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    Leading MNC • kolkata, west bengal, in
    Looking for a Freelance Data Engineer to join a team of rockstar developers.The candidate should have a minimum of 8+ yrs. If you're looking for freelance / part time opportunity (along with your day...Show more
    Last updated: 13 days ago • Promoted