Talent.com
Data Engineer
Data EngineerBayOne Solutions • Ghaziabad, IN
Data Engineer

Data Engineer

BayOne Solutions • Ghaziabad, IN
30+ days ago
Job description

The Opportunity :

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end services, ensuring seamless integration within a microservices environment. You'll be responsible for building robust data solutions and crafting the APIs and services that power the customer experience. This role demands a strong understanding of microservices principles, data engineering best practices, back-end development, and experience with building scalable solutions.

Responsibilities :

  • Lead the design, development, and deployment of data engineering solutions and back-end services within a microservices environment.
  • Architect and implement scalable data pipelines for ingestion, processing, and storage of data from various sources, ensuring data quality and reliability.
  • Design, code, configure, test, debug, deploy, document, and maintain both data pipelines and back-end web service applications using a variety of software development toolkits, testing / verification applications and other tools, while adhering to specific development best practices and quality standards.
  • Work closely with solution engineers and architects to develop technical design specifications from which programs will be written or configured, with a strong focus on microservices integration for both data and application components.
  • Validate that proposed back-end services and data solutions align with both the architectural design and the business needs, ensuring seamless integration within the existing microservices environment.
  • Responsible for troubleshooting and issue analysis across the back-end stack, including data pipelines, microservices, and APIs, as well as coding, testing, and implementing software enhancements.
  • Implement and maintain data governance and API governance policies and standards across the microservices landscape.
  • Collaborate with cross-functional teams to define data requirements, design APIs, and deliver data-driven services.
  • Available to support / unblock planned deployments during off hours.
  • Contribute to the evolution of our data and application architecture, with a focus on microservices best practices, data engineering principles, and emerging technologies.
  • Lead and mentor other engineers, fostering a culture of innovation and collaboration across both data engineering and back-end development.

We are excited about you if you have experience with the following technologies :

  • Git, CI / CD, Jenkins, ArgoCD
  • Scala / Java, SQL / SparkSQL, Python
  • Apache Spark, Databricks, Apache Storm
  • Cosmos DB, Redis,
  • Maven, Gradle Build Tools
  • Kafka Ecosystem, Kafka Streams library, Kafka Avro Schemas
  • Cosmos DB, Redis Cache and Redis Insight Tool
  • Grafana, Grafana Loki Logging
  • Restful API Design Patterns, Swagger Documentation
  • Experience with markup languages such as JSON and YAML
  • Proven experience designing and implementing microservices architectures.
  • Strong understanding of data modeling, data warehousing, and ETL processes.
  • Experience with containerization technologies such as Docker and Kubernetes.
  • Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data engineering and back-end services.
  • Experience with Node.js.
  • Familiarity with Rust is a plus.

    Create a job alert for this search

    Data Engineer • Ghaziabad, IN

    Related jobs
    Data Engineer

    Data Engineer

    Recro • Delhi, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Baazi Games • New Delhi, Delhi, India
    Reports To : Engineering Manager – Data Platform.The Data Engineer III will lead the design and optimization of Baazi’s large-scale data platform. You’ll architect end-to-end data solutions, mentor j...Show more
    Last updated: 13 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    MakeMyTrip • Gurugram, Haryana, India
    At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltd • Delhi, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
    Last updated: 5 days ago • Promoted
    Data Engineer

    Data Engineer

    GMG • Gurugram, Haryana, India
    GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors.Its vision is to inspir...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    Grassdoor • Delhi, IN
    At Grassdoor Logistics Technologies, we are redefining the landscape of Cannabis commerce by.Unified Operations Center which provides seamless, technology-driven solutions.Our platform is built to ...Show more
    Last updated: 18 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    NAB • Gurugram, Haryana, India
    Proficient in executing ETL processes between data environments.Proficient at coding in SQL (additional knowledge in Python and R is highly regarded). Proficient at creating analytics related docume...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    Movate • Gurugram, Haryana, India
    Develop data mapping specifications and transformation rules.Perform data cleansing, validation, and reconciliation activities. Create and execute data conversion scripts and processes.Document data...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Delhi, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Terra Technology Circle Consulting Private Limited • Gurugram, Haryana, India
    We are seeking a highly skilled and motivated.In this role, you will design, build, and optimize scalable data pipelines and architectures to support analytics, machine learning, and business intel...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Meerut, IN
    Role : Databricks Senior Developer.Required Technical Skill Set : Databricks, Spark and Data Migration experience.Desired Competencies (Technical / Behavioral Competency). Databricks, Spark and Data M...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Amway • Gurugram, Haryana, India
    The Data Platform team is responsible for the Global Data Platform built on Google Cloud Platform (GCP) technology.This platform, called the Analytics Capability Ecosystem (ACE), is focused on prov...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Azilen Technologies • Gurugram, Haryana, India
    Manage and create design schema, SQL query tuning, and code review.Min 4+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH development.D...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Delhi, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer

    Data Engineer

    Randstad Enterprise • Meerut, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    KKR • Gurugram, Haryana, India
    KKR aims to generate attractive investment returns by following a patient and disciplined investment approach, employing world-class people, and supporting growth in its portfolio companies and com...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    TBO.COM • Gurugram, Haryana, India
    TBO is a global platform that aims to simplify all buying and selling travel needs of travel partners across the world.The proprietary technology platform aims to simplify the demands of the comple...Show more
    Last updated: 1 day ago • Promoted
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • Meerut, IN
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 2 days ago • Promoted