Talent.com
Data Engineer

Data Engineer

BayOne Solutionssrikakulam, andhra pradesh, in
4 days ago
Job description

The Opportunity :

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end services, ensuring seamless integration within a microservices environment. You'll be responsible for building robust data solutions and crafting the APIs and services that power the customer experience. This role demands a strong understanding of microservices principles, data engineering best practices, back-end development, and experience with building scalable solutions.

Responsibilities :

  • Lead the design, development, and deployment of data engineering solutions and back-end services within a microservices environment.
  • Architect and implement scalable data pipelines for ingestion, processing, and storage of data from various sources, ensuring data quality and reliability.
  • Design, code, configure, test, debug, deploy, document, and maintain both data pipelines and back-end web service applications using a variety of software development toolkits, testing / verification applications and other tools, while adhering to specific development best practices and quality standards.
  • Work closely with solution engineers and architects to develop technical design specifications from which programs will be written or configured, with a strong focus on microservices integration for both data and application components.
  • Validate that proposed back-end services and data solutions align with both the architectural design and the business needs, ensuring seamless integration within the existing microservices environment.
  • Responsible for troubleshooting and issue analysis across the back-end stack, including data pipelines, microservices, and APIs, as well as coding, testing, and implementing software enhancements.
  • Implement and maintain data governance and API governance policies and standards across the microservices landscape.
  • Collaborate with cross-functional teams to define data requirements, design APIs, and deliver data-driven services.
  • Available to support / unblock planned deployments during off hours.
  • Contribute to the evolution of our data and application architecture, with a focus on microservices best practices, data engineering principles, and emerging technologies.
  • Lead and mentor other engineers, fostering a culture of innovation and collaboration across both data engineering and back-end development.

We are excited about you if you have experience with the following technologies :

  • Git, CI / CD, Jenkins, ArgoCD
  • Scala / Java, SQL / SparkSQL, Python
  • Apache Spark, Databricks, Apache Storm
  • Cosmos DB, Redis,
  • Maven, Gradle Build Tools
  • Kafka Ecosystem, Kafka Streams library, Kafka Avro Schemas
  • Cosmos DB, Redis Cache and Redis Insight Tool
  • Grafana, Grafana Loki Logging
  • Restful API Design Patterns, Swagger Documentation
  • Experience with markup languages such as JSON and YAML
  • Proven experience designing and implementing microservices architectures.
  • Strong understanding of data modeling, data warehousing, and ETL processes.
  • Experience with containerization technologies such as Docker and Kubernetes.
  • Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data engineering and back-end services.
  • Experience with Node.js.
  • Familiarity with Rust is a plus.

    Create a job alert for this search

    Data Engineer • srikakulam, andhra pradesh, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Servicessrikakulam, andhra pradesh, in
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connectionssrikakulam, andhra pradesh, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    TTC Groupsrikakulam, andhra pradesh, in
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Cosrikakulam, andhra pradesh, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 18 days ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    COVET IT INCsrikakulam, andhra pradesh, in
    Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc. We are seeking a highly skilled AWS Data Engine...Show moreLast updated: 18 hours ago
    • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limitedsrikakulam, andhra pradesh, in
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    Data Engineer – CDP

    Data Engineer – CDP

    Integers.Aisrikakulam, andhra pradesh, in
    Job Description : Data Engineer – CDP.Data Engineer with strong CDP expertise.The ideal candidate will have hands-on experience working with Customer Data Platforms—specifically Real-Time CDP and Sa...Show moreLast updated: 6 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltdsrikakulam, andhra pradesh, in
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 1 day ago
    • Promoted
    ETL & Tableau Data Engineer

    ETL & Tableau Data Engineer

    Magma Consultancysrikakulam, andhra pradesh, in
    ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Masteksrikakulam, India
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 15 days ago
    • Promoted
    Aws Data Engineer

    Aws Data Engineer

    Tata Consultancy ServicesChicacole, Republic Of India, IN
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 26 days ago
    • Promoted
    • New!
    Aws Data Engineer

    Aws Data Engineer

    COVET IT INCChicacole, Republic Of India, IN
    Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc. We are seeking a highly skilled AWS Data Engine...Show moreLast updated: 13 hours ago
    • Promoted
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turingsrikakulam, andhra pradesh, in
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show moreLast updated: 16 days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    HNR Techsrikakulam, andhra pradesh, in
    We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlancesrikakulam, India
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 1 day ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careerssrikakulam, andhra pradesh, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    LanceSoft, Inc.srikakulam, andhra pradesh, in
    This team is looking to hire a motivated Sr.Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve vario...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Senior Data Engineer- Freelance

    Senior Data Engineer- Freelance

    Quapton AI Solutionssrikakulam, andhra pradesh, in
    Quapton AI Solutions is an innovative tech startup dedicated to providing advanced IT services within the field of artificial intelligence. We aim to empower businesses with tailored AI-driven solut...Show moreLast updated: 18 hours ago