Talent.com
Cloud Data Engineer
Cloud Data EngineerLemongrass • Prayagraj(Allahabad), IN
Cloud Data Engineer

Cloud Data Engineer

Lemongrass • Prayagraj(Allahabad), IN
30+ days ago
Job description

About Lemongrass

Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.

We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.

Key Responsibilities :

Design and Development :

  • Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
  • Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
  • Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
  • Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
  • Develop and optimize data processing jobs using Spark Scala.

Data Integration and Management :

  • Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Perform data extraction from SAP or ERP systems when necessary.
  • Performance Optimization :

  • Monitor and optimize the performance of data pipelines and ETL processes.
  • Implement best practices for data management, including data governance, security, and compliance.
  • Collaboration and Communication :

  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Collaborate with cross-functional teams to design and implement data solutions that meet business needs.
  • Documentation and Maintenance :

  • Document technical solutions, processes, and workflows.
  • Maintain and troubleshoot existing ETL pipelines and data integrations.
  • Qualifications

    Education :

  • Bachelor’s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus.
  • Experience :

  • 7+ years of experience as a Data Engineer or in a similar role.
  • Proven experience with cloud platforms : AWS, Azure, and GCP.
  • Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
  • Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
  • Experience in building and managing data lakes and data warehouses.
  • Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
  • Experience with data extraction from SAP or ERP systems is a plus.
  • Strong experience with Spark and Scala for data processing.
  • Skills :

  • Strong programming skills in Python, Java, or Scala.
  • Proficient in SQL and query optimization techniques.
  • Familiarity with data modeling, ETL / ELT processes, and data warehousing concepts.
  • Knowledge of data governance, security, and compliance best practices.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Preferred Qualifications :

  • Experience with other data tools and technologies such as Apache Spark, or Hadoop.
  • Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified : Azure Data Engineer Associate).
  • Experience with CI / CD pipelines and DevOps practices for data engineering
  • Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law.
  • What we offer in return :

  • Remote Working : Lemongrass always has been and always will offer 100% remote work
  • Flexibility : Work where and when you like most of the time
  • Training : A subscription to A Cloud Guru and generous budget for taking certifications and other resources you’ll find helpful
  • State of the art tech : An opportunity to learn and run the latest industry standard tools
  • Team : Colleagues who will challenge you giving the chance to learn from them and them from you
  • Lemongrass Consulting is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics

    Create a job alert for this search

    Cloud Data Engineer • Prayagraj(Allahabad), IN

    Related jobs
    Cloud Engineer

    Cloud Engineer

    Insight Global • Prayagraj(Allahabad), IN
    Senior Cloud Ops Engineer Azure (Infrastructure & Operations).We are seeking a highly skilled and experienced Senior Cloud Ops Engineer to join our client's Infrastructure & Operations team.The suc...Show more
    Last updated: 30+ days ago • Promoted
    Azure Cloud Engineer

    Azure Cloud Engineer

    Deloitte • Prayagraj(Allahabad), IN
    India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realize your potential amongst cutting edge leaders, and organizations ...Show more
    Last updated: 5 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Recro • Prayagraj(Allahabad), IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    GoML • Prayagraj(Allahabad), IN
    At goML, we design and build cutting-edge Generative AI, AI / ML, and Data Engineering solutions that help businesses unlock the full potential of their data, drive intelligent automation, and create...Show more
    Last updated: 19 hours ago • Promoted • New!
    •AWS Data Engineer •

    •AWS Data Engineer •

    Accenture • AU
    Combine the best of your ingenuity and Cloud technologies to build a better world and manage clients towards change.Join us and do extraordinary things. Accenture is a global professional services c...Show more
    Last updated: 30+ days ago
    Principal Cloud Data Engineer

    Principal Cloud Data Engineer

    Centorrino Technologies • AU
    Remote
    Quick Apply
    Join Centorrino Technologies : Innovate, Grow, and Thrive with Us!.At Centorrino Technologies (CT), we’re more than just tech—we’re a community that goes beyond expectations.We’ve been recognised as...Show more
    Last updated: 30+ days ago
    Data Engineer

    Data Engineer

    IntraEdge • Prayagraj(Allahabad), IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Engineer

    Databricks Engineer

    Accenture • AU
    Databricks Data Engineer Consultant.You’ll work on cutting-edge cloud and hybrid data projects, developing scalable pipelines and transforming raw data into meaningful insights.You’ll be hands-on f...Show more
    Last updated: 30+ days ago
    AWS Cloud Engineer

    AWS Cloud Engineer

    Proglite • Prayagraj(Allahabad), IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Prayagraj(Allahabad), IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer - Infinite Consulting

    Lead Data Engineer - Infinite Consulting

    Infinite Consulting • AU
    Australian Citizens with current Baseline Clearance.Infinite Consulting is seeking.This is a July start for a 12 month initial contract – 2x6 months further extensions possible based on funding and...Show more
    Last updated: 30+ days ago
    •AWS Cloud Engineer •

    •AWS Cloud Engineer •

    Accenture • AU
    We work with one shared purpose : to deliver on the promise of technology and human ingenuity.Every day, more than 791,000 of us help our stakeholders continuously reinvent.Together, we drive positi...Show more
    Last updated: 30+ days ago
    Data Engineer

    Data Engineer

    Digitalzone • Prayagraj(Allahabad), IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 22 days ago • Promoted
    Senior Cloud Platform Engineer

    Senior Cloud Platform Engineer

    Onset Group • AU
    Senior Cloud Platform Engineer.Somewhere between quantum physics and cloud engineering sits a platform that keeps the impossible running. This team builds the backbone for a new generation of comput...Show more
    Last updated: 30+ days ago
    Azure Cloud Engineer

    Azure Cloud Engineer

    Accenture • AU
    Develop, deploy, and manage Azure PaaS and SaaS solutions, ensuring they meet the highest standards of reliability, security, and performance. Utilize Azure DevOps practices to automate and streamli...Show more
    Last updated: 23 days ago
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltd • Prayagraj(Allahabad), IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
    Last updated: 6 days ago • Promoted
    Staff Cloud Platform Engineer

    Staff Cloud Platform Engineer

    Onset Group • AU
    At the edge of quantum computing and cloud architecture, this team builds the infrastructure that keeps it all running.Their systems power GPU-accelerated workloads, real-time modeling, and researc...Show more
    Last updated: 16 days ago
    Senior Data Engineer & Cloud Data Platform Trainer

    Senior Data Engineer & Cloud Data Platform Trainer

    360DigiTMG • Prayagraj(Allahabad), IN
    DigiTMG is a pioneering EdTech organization known for upskilling professionals in Data Science, AI, and emerging technologies through industry-aligned certification programs.With Hyderabad as its m...Show more
    Last updated: 5 hours ago • Promoted • New!