Talent.com
Data Engineer

Data Engineer

BayOne SolutionsHyderabad, IN
30+ days ago
Job description

The Opportunity :

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end services, ensuring seamless integration within a microservices environment. You'll be responsible for building robust data solutions and crafting the APIs and services that power the customer experience. This role demands a strong understanding of microservices principles, data engineering best practices, back-end development, and experience with building scalable solutions.

Responsibilities :

  • Lead the design, development, and deployment of data engineering solutions and back-end services within a microservices environment.
  • Architect and implement scalable data pipelines for ingestion, processing, and storage of data from various sources, ensuring data quality and reliability.
  • Design, code, configure, test, debug, deploy, document, and maintain both data pipelines and back-end web service applications using a variety of software development toolkits, testing / verification applications and other tools, while adhering to specific development best practices and quality standards.
  • Work closely with solution engineers and architects to develop technical design specifications from which programs will be written or configured, with a strong focus on microservices integration for both data and application components.
  • Validate that proposed back-end services and data solutions align with both the architectural design and the business needs, ensuring seamless integration within the existing microservices environment.
  • Responsible for troubleshooting and issue analysis across the back-end stack, including data pipelines, microservices, and APIs, as well as coding, testing, and implementing software enhancements.
  • Implement and maintain data governance and API governance policies and standards across the microservices landscape.
  • Collaborate with cross-functional teams to define data requirements, design APIs, and deliver data-driven services.
  • Available to support / unblock planned deployments during off hours.
  • Contribute to the evolution of our data and application architecture, with a focus on microservices best practices, data engineering principles, and emerging technologies.
  • Lead and mentor other engineers, fostering a culture of innovation and collaboration across both data engineering and back-end development.

We are excited about you if you have experience with the following technologies :

  • Git, CI / CD, Jenkins, ArgoCD
  • Scala / Java, SQL / SparkSQL, Python
  • Apache Spark, Databricks, Apache Storm
  • Cosmos DB, Redis,
  • Maven, Gradle Build Tools
  • Kafka Ecosystem, Kafka Streams library, Kafka Avro Schemas
  • Cosmos DB, Redis Cache and Redis Insight Tool
  • Grafana, Grafana Loki Logging
  • Restful API Design Patterns, Swagger Documentation
  • Experience with markup languages such as JSON and YAML
  • Proven experience designing and implementing microservices architectures.
  • Strong understanding of data modeling, data warehousing, and ETL processes.
  • Experience with containerization technologies such as Docker and Kubernetes.
  • Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data engineering and back-end services.
  • Experience with Node.js.
  • Familiarity with Rust is a plus.

    Create a job alert for this search

    Data Engineer • Hyderabad, IN

    Related jobs
    • Promoted
    Data Engineer – Databricks Platform

    Data Engineer – Databricks Platform

    Amicon Hub ServicesHyderabad, Telangana, India
    Delta Lake, Spark, PySpark, SQL).SQL Server, MongoDB, InfluxDB).Kafka, Azure Event Hubs, or similar).Excellent problem-solving skills and the ability to work in a fast-paced environment.Familiar wi...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer (OnPrem)

    Data Engineer (OnPrem)

    BlendHyderabad, Telangana, India
    Senior Data Engineers / Data Engineers.Python / Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client.This role is part o...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneHyderabad, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroHyderabad, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    NexionPro ServicesHyderabad, IN
    PySpark-based data processing workflows.Collaborate with data architects, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.Optimi...Show moreLast updated: 11 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India
    Job Summary : Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The i...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    OWOWHyderabad, IN
    Data Engineer – AI-Powered Marketing Personalization Platform.AI-powered marketing personalization platform (V2.You’ll design and implement a robust multi-database infrastructure that enables real-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeHyderabad, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    HCLTechHyderabad, Telangana, India
    Currently Hiring for "Azure Data Engineer”.Chennai / Hyderabad / Bangalore / Pune / Noida.Interested candidate please share below details along with update resume. Interested candidate please drop mail t...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer - Snowflake

    Data Engineer - Snowflake

    Prudent Technologies and Consulting, Inc.hyderabad, telangana, in
    We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipelines, integrating ...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    JRD SystemsHyderabad, Telangana, India
    The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica. This role will lead the design and delivery of.Databricks (PySpark, ...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior Data Engineer / Architect - Snowflake

    Senior Data Engineer / Architect - Snowflake

    Aezion, Incsecunderabad, telangana, in
    We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show moreLast updated: 5 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    EgenHyderabad, India
    We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team.The ideal candidate will...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Prudent Technologies and Consulting, Inc.Hyderabad, Republic Of India, IN
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (Onprem)

    Data Engineer (Onprem)

    BlendHyderabad, Republic Of India, IN
    Senior Data Engineers / Data Engineers.Python / Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client.This role is part o...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalHyderabad, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    StraiveHyderabad, Telangana, India
    Key Responsibilities : • Design, build and maintain scalable batch and (optionally) streaming data pipelines using Apache Spark 3. Scala, Python & SQL • Implement core ETL / ELT logic in Scala and Py...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer (Remote)

    Data Engineer (Remote)

    QAAgility Technologieshyderabad, telangana, in
    Remote
    The ideal candidate will be responsible for designing, developing, and maintaining robust data pipelines that support key business functions across the supply chain domain.This role requires strong...Show moreLast updated: 5 hours ago