Talent.com
This job offer is not available in your country.
Cloud Data Engineer

Cloud Data Engineer

LemongrassBengaluru, IN
30+ days ago
Job description

About Lemongrass

Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.

We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.

Key Responsibilities :

Design and Development :

  • Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
  • Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
  • Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
  • Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
  • Develop and optimize data processing jobs using Spark Scala.

Data Integration and Management :

  • Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Perform data extraction from SAP or ERP systems when necessary.
  • Performance Optimization :

  • Monitor and optimize the performance of data pipelines and ETL processes.
  • Implement best practices for data management, including data governance, security, and compliance.
  • Collaboration and Communication :

  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Collaborate with cross-functional teams to design and implement data solutions that meet business needs.
  • Documentation and Maintenance :

  • Document technical solutions, processes, and workflows.
  • Maintain and troubleshoot existing ETL pipelines and data integrations.
  • Qualifications

    Education :

  • Bachelor’s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus.
  • Experience :

  • 7+ years of experience as a Data Engineer or in a similar role.
  • Proven experience with cloud platforms : AWS, Azure, and GCP.
  • Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
  • Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
  • Experience in building and managing data lakes and data warehouses.
  • Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
  • Experience with data extraction from SAP or ERP systems is a plus.
  • Strong experience with Spark and Scala for data processing.
  • Skills :

  • Strong programming skills in Python, Java, or Scala.
  • Proficient in SQL and query optimization techniques.
  • Familiarity with data modeling, ETL / ELT processes, and data warehousing concepts.
  • Knowledge of data governance, security, and compliance best practices.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Preferred Qualifications :

  • Experience with other data tools and technologies such as Apache Spark, or Hadoop.
  • Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified : Azure Data Engineer Associate).
  • Experience with CI / CD pipelines and DevOps practices for data engineering
  • Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law.
  • What we offer in return :

  • Remote Working : Lemongrass always has been and always will offer 100% remote work
  • Flexibility : Work where and when you like most of the time
  • Training : A subscription to A Cloud Guru and generous budget for taking certifications and other resources you’ll find helpful
  • State of the art tech : An opportunity to learn and run the latest industry standard tools
  • Team : Colleagues who will challenge you giving the chance to learn from them and them from you
  • Lemongrass Consulting is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics

    Create a job alert for this search

    Cloud Data Engineer • Bengaluru, IN

    Related jobs
    • Promoted
    Cloud Engineer

    Cloud Engineer

    MastekBengaluru, Karnataka, India
    Software Development & Design : Design, develop, test, and deploy scalable software solutions.Write clean, maintainable, and efficient code following best practices. Participate in code reviews and pr...Show moreLast updated: 9 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    EXLBangalore, IN
    We're looking for a highly skilled and experienced Cloud AI Engineer to join our dynamic team.In this role, you'll be instrumental in designing, developing, and deploying cutting-edge artificial in...Show moreLast updated: 2 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Mindtreehosur, tamil nadu, in
    Show moreLast updated: 20 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IGT Solutionshosur, tamil nadu, in
    Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 26 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Tech MahindraBengaluru, Karnataka, India
    Design, deploy, and manage scalable cloud infrastructure on AWS.Build and maintain containerized environments using Docker and Kubernetes. Automate infrastructure provisioning and configuration usin...Show moreLast updated: 25 days ago
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    Lemongrassbangalore, karnataka, in
    Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show moreLast updated: 22 days ago
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    Proglitehosur, tamil nadu, in
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 9 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Innova ESIBengaluru, Karnataka, India
    About the Company We are a leading technology company focused on delivering innovative solutions to our clients.Our mission is to empower businesses through cutting-edge technology and exceptional...Show moreLast updated: 2 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Impetusbangalore, karnataka, in
    We are looking for an experienced Data Engineer / Technical Lead.Snowflake and dbt (data build tool).Data Warehousing, Data Modeling, and Data Engineering. The ideal candidate will have hands-on exp...Show moreLast updated: 28 days ago
    • Promoted
    Engineer

    Engineer

    Alp Consulting Ltd.hosur, tamil nadu, in
    As a GCP Data Engineer, you will be responsible for designing, building, and maintaining scalable data processing systems on. You will collaborate with cross-functional teams to ensure data is acces...Show moreLast updated: 21 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Alp Consulting Ltd.Bengaluru, Karnataka, India
    Bachelor’s degree in Computer Science, Information Systems, or a related field.Show moreLast updated: 17 days ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USAhosur, tamil nadu, in
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 6 days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Intuitive.Cloudhosur, tamil nadu, in
    With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 7 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    RAVSoft Solutions Inc.hosur, tamil nadu, in
    Job Title : Mid-Level AWS Cloud Engineer (AWS Lambda + TypeScript).You will be responsible for building scalable, secure, and high-performance backend systems and infrastructure that power our core ...Show moreLast updated: 9 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    NAM Info Incbanashankari, karnataka, in
    We have an immediate need for AWS Data Engineers all 5 Days Onsite at Office from 2nd stage Banashankari, Bengaluru location and need someone to start Immediate Joiners only NO ONE MONTH NOTICE.Rol...Show moreLast updated: 9 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Smarshbangalore, karnataka, in
    Smarsh is the leader in communications compliance, archiving, and analytics.We provide compliance across the broadest set of communications channels with insights on what’s being captured.Smarsh cu...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    ValueMomentumbangalore, karnataka, in
    We are seeking a highly skilled.You will work closely with development, operations, and security teams to ensure continuous delivery, high availability, and optimal performance of our applications....Show moreLast updated: 9 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Strobes Security, Inc.hosur, tamil nadu, in
    We are looking for a Mid-level Cloud Engineer with hands-on expertise in designing, automating, and operating production-grade cloud infrastructure. This role requires a strong background in AWS ser...Show moreLast updated: 28 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data Solutionshosur, tamil nadu, in
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.hosur, tamil nadu, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 27 days ago