Talent.com
Data Engineer

Data Engineer

BayOne Solutionsindore, madhya pradesh, in
3 days ago
Job description

The Opportunity :

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end services, ensuring seamless integration within a microservices environment. You'll be responsible for building robust data solutions and crafting the APIs and services that power the customer experience. This role demands a strong understanding of microservices principles, data engineering best practices, back-end development, and experience with building scalable solutions.

Responsibilities :

  • Lead the design, development, and deployment of data engineering solutions and back-end services within a microservices environment.
  • Architect and implement scalable data pipelines for ingestion, processing, and storage of data from various sources, ensuring data quality and reliability.
  • Design, code, configure, test, debug, deploy, document, and maintain both data pipelines and back-end web service applications using a variety of software development toolkits, testing / verification applications and other tools, while adhering to specific development best practices and quality standards.
  • Work closely with solution engineers and architects to develop technical design specifications from which programs will be written or configured, with a strong focus on microservices integration for both data and application components.
  • Validate that proposed back-end services and data solutions align with both the architectural design and the business needs, ensuring seamless integration within the existing microservices environment.
  • Responsible for troubleshooting and issue analysis across the back-end stack, including data pipelines, microservices, and APIs, as well as coding, testing, and implementing software enhancements.
  • Implement and maintain data governance and API governance policies and standards across the microservices landscape.
  • Collaborate with cross-functional teams to define data requirements, design APIs, and deliver data-driven services.
  • Available to support / unblock planned deployments during off hours.
  • Contribute to the evolution of our data and application architecture, with a focus on microservices best practices, data engineering principles, and emerging technologies.
  • Lead and mentor other engineers, fostering a culture of innovation and collaboration across both data engineering and back-end development.

We are excited about you if you have experience with the following technologies :

  • Git, CI / CD, Jenkins, ArgoCD
  • Scala / Java, SQL / SparkSQL, Python
  • Apache Spark, Databricks, Apache Storm
  • Cosmos DB, Redis,
  • Maven, Gradle Build Tools
  • Kafka Ecosystem, Kafka Streams library, Kafka Avro Schemas
  • Cosmos DB, Redis Cache and Redis Insight Tool
  • Grafana, Grafana Loki Logging
  • Restful API Design Patterns, Swagger Documentation
  • Experience with markup languages such as JSON and YAML
  • Proven experience designing and implementing microservices architectures.
  • Strong understanding of data modeling, data warehousing, and ETL processes.
  • Experience with containerization technologies such as Docker and Kubernetes.
  • Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data engineering and back-end services.
  • Experience with Node.js.
  • Familiarity with Rust is a plus.

    Create a job alert for this search

    Data Engineer • indore, madhya pradesh, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    LanceSoft, Inc.indore, madhya pradesh, in
    This team is looking to hire a motivated Sr.Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve vario...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Digitalzoneindore, madhya pradesh, in
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 17 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Xsell Resourcesindore, madhya pradesh, in
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show moreLast updated: 16 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicesindore, madhya pradesh, in
    TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show moreLast updated: 25 days ago
    • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limitedindore, madhya pradesh, in
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 3 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Servicesindore, madhya pradesh, in
    TCS is Hiring for Azure Data Engineer.Primary : Azure Data Factory (ADF), Azure Databricks (ADB).Secondary : SSIS (SQL Server Integration Services). Strong expertise in Azure Data Engineering & ETL Co...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    TTC Groupindore, madhya pradesh, in
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Alp Consulting Ltd.indore, madhya pradesh, in
    Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Adastraindore, madhya pradesh, in
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    COVET IT INCindore, madhya pradesh, in
    Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc. We are seeking a highly skilled AWS Data Engine...Show moreLast updated: less than 1 hour ago
    • Promoted
    Freelance Data Quality Engineer

    Freelance Data Quality Engineer

    Leading MNCindore, madhya pradesh, in
    Freelance Data Quality Engineer.The candidate should have a minimum of 8+ yrs.If you're looking for freelance / part time opportunity (along with your day job) & a chance to work with the top 0.You ...Show moreLast updated: 17 days ago
    • Promoted
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    TuringIndore, Madhya Pradesh, India
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer / Architect - Snowflake

    Senior Data Engineer / Architect - Snowflake

    Aezion, Incindore, madhya pradesh, in
    We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show moreLast updated: 1 day ago
    • Promoted
    ETL & Tableau Data Engineer

    ETL & Tableau Data Engineer

    Magma Consultancyindore, madhya pradesh, in
    ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltdindore, madhya pradesh, in
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Jaipur Livingindore, madhya pradesh, in
    At Jaipur Living, we blend time-honored craftsmanship with modern design to create luxurious rugs and home decor.Headquartered in Acworth, Georgia, we serve global customers with a mission-driven a...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior Data Engineer- Freelance

    Senior Data Engineer- Freelance

    Quapton AI Solutionsindore, madhya pradesh, in
    Quapton AI Solutions is an innovative tech startup dedicated to providing advanced IT services within the field of artificial intelligence. We aim to empower businesses with tailored AI-driven solut...Show moreLast updated: less than 1 hour ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    HNR Techindore, madhya pradesh, in
    We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show moreLast updated: 10 days ago