Talent.com
This job offer is not available in your country.
Cloud Data Engineer

Cloud Data Engineer

LemongrassPrayagraj(Allahabad), IN
30+ days ago
Job description

About Lemongrass

Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.

We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.

Key Responsibilities :

Design and Development :

  • Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
  • Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
  • Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
  • Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
  • Develop and optimize data processing jobs using Spark Scala.

Data Integration and Management :

  • Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Perform data extraction from SAP or ERP systems when necessary.
  • Performance Optimization :

  • Monitor and optimize the performance of data pipelines and ETL processes.
  • Implement best practices for data management, including data governance, security, and compliance.
  • Collaboration and Communication :

  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Collaborate with cross-functional teams to design and implement data solutions that meet business needs.
  • Documentation and Maintenance :

  • Document technical solutions, processes, and workflows.
  • Maintain and troubleshoot existing ETL pipelines and data integrations.
  • Qualifications

    Education :

  • Bachelor’s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus.
  • Experience :

  • 7+ years of experience as a Data Engineer or in a similar role.
  • Proven experience with cloud platforms : AWS, Azure, and GCP.
  • Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
  • Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
  • Experience in building and managing data lakes and data warehouses.
  • Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
  • Experience with data extraction from SAP or ERP systems is a plus.
  • Strong experience with Spark and Scala for data processing.
  • Skills :

  • Strong programming skills in Python, Java, or Scala.
  • Proficient in SQL and query optimization techniques.
  • Familiarity with data modeling, ETL / ELT processes, and data warehousing concepts.
  • Knowledge of data governance, security, and compliance best practices.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Preferred Qualifications :

  • Experience with other data tools and technologies such as Apache Spark, or Hadoop.
  • Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified : Azure Data Engineer Associate).
  • Experience with CI / CD pipelines and DevOps practices for data engineering
  • Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law.
  • What we offer in return :

  • Remote Working : Lemongrass always has been and always will offer 100% remote work
  • Flexibility : Work where and when you like most of the time
  • Training : A subscription to A Cloud Guru and generous budget for taking certifications and other resources you’ll find helpful
  • State of the art tech : An opportunity to learn and run the latest industry standard tools
  • Team : Colleagues who will challenge you giving the chance to learn from them and them from you
  • Lemongrass Consulting is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics

    Create a job alert for this search

    Cloud Data Engineer • Prayagraj(Allahabad), IN

    Related jobs
    Senior Cloud Data Engineer - Manager

    Senior Cloud Data Engineer - Manager

    State StreetINDIA
    Role Summary & Role Description.Chief Data Office (CDO) - Global Technology Solutions at State Street has a mandate to govern and report on data health across the enterprise.CDO is rolling out mult...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud DevOps Engineer

    Cloud DevOps Engineer

    Merge ITPrayagraj(Allahabad), IN
    Our enterprise-level client in India has an immediate need to add several Cloud DevOps Engineers to the team on a hybrid basis in major tech hubs including : Bengaluru / Bangalore, Hyderabad, Chenna...Show moreLast updated: 1 day ago
    Partner Engineer, Data Management, Google Cloud

    Partner Engineer, Data Management, Google Cloud

    Google India Pvt LtdINDIA
    Partner Engineer, Data Management, Google Cloud.So Paulo, State of So Paulo, Brazil.Bachelor's degree or equivalent practical experience. Experience architecting solutions for data transformation, m...Show moreLast updated: 30+ days ago
    GCP Data Engineer (Cloud Solutions and Data Processing)

    GCP Data Engineer (Cloud Solutions and Data Processing)

    SYNECHRONINDIA
    Strong understanding of other technology platforms such as mobile, cloud, IoT, and blockchain.Knowledge of software development life cycle (SDLC) and Agile methodologies. Work closely with cross-fun...Show moreLast updated: 30+ days ago
    SENIOR CLOUD ENGINEER - AWS

    SENIOR CLOUD ENGINEER - AWS

    Cbus SuperAU
    Shape the future of digital member experiences in Cbus.Work for a leading industry Super Fund!.Collaborative & supportive hybrid working environment. Created by workers, for workers, Cbus Super ...Show moreLast updated: 8 days ago
    Software Engineer - Cloud Authentication

    Software Engineer - Cloud Authentication

    Octopus DeployAU
    Octopus Deploy sets the standard for Continuous Delivery, empowering software teams to deliver value in an agile way.Over 4,000 organizations globally – including Ubisoft, ASOS, Xero, Stack Overfl...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DevfiPrayagraj(Allahabad), IN
    Our client is looking for a Senior Data Engineer with Strong Python and AWS.I thought this might catch your interest.Client is looking for someone who is willing to work in US Eastern Time zone - N...Show moreLast updated: 13 days ago
    Azure Cloud Data Engineer

    Azure Cloud Data Engineer

    UBSINDIA
    At UBS, we embrace flexible ways of working when the role permits.We offer different working arrangements like part-time, job-sharing and hybrid (office and home) working.Our purpose-led culture an...Show moreLast updated: 30+ days ago
    Cloud & Data Security Engineer - Senior Security Engineer

    Cloud & Data Security Engineer - Senior Security Engineer

    PaytmINDIA
    Information Security - Cloud and Data Security Engineer.Paytm Payments Services Limited houses the Paytm payment gateway business which enables thousands of online merchants to offer world class fr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    LuxoftPrayagraj(Allahabad), IN
    At least 7 years of experience in development in Data specific projects.Must have working knowledge of streaming data Kafka Framework (kSQL / Mirror Maker etc). Strong programming skills in at least o...Show moreLast updated: 1 day ago
    • Promoted
    GCP Cloud Engineer / Lead GCP Engineer

    GCP Cloud Engineer / Lead GCP Engineer

    Jigya Software ServicesPrayagraj(Allahabad), IN
    Job Title : Senior GCP Cloud Engineer / Lead.Type : Full-Time with NTT Data India Services.A role that requires good understanding in cloud-based Infrastructure and application hosting, designing and d...Show moreLast updated: 1 day ago
    Senior Cloud Engineer

    Senior Cloud Engineer

    ShiftCareAU
    ShiftCare’s innovative software is a market leader which helps Australian & American disability support providers, in-home aged carers and allied health professionals, streamline the way they w...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    Redwolf + RoschAU
    A forward-thinking organisation undergoing rapid digital transformation is seeking a talented.With a strong focus on modern cloud platforms and data-led decision making, this business is investing ...Show moreLast updated: 3 days ago
    • Promoted
    Senior Cloud Engineer (AWS)

    Senior Cloud Engineer (AWS)

    Datapel SystemsPrayagraj(Allahabad), IN
    The Senior Cloud Engineer (AWS) will be responsible for developing, maintaining, optimising and supporting the cloud infrastructure that supports Datapel’s Warehouse Management System (WMS) and rel...Show moreLast updated: 1 day ago
    CLOUD ENGINEER

    CLOUD ENGINEER

    CyberCXAU
    We protect and defend our customers and communities by providing the most comprehensive range of cyber security professional services in the region. With more than 1,400 team members across Australi...Show moreLast updated: 13 days ago
    • Promoted
    Big Data Cloud Engineer - AWS

    Big Data Cloud Engineer - AWS

    NagarroPrayagraj(Allahabad), IN
    Work from Anywhere (Pune / Bengaluru / Chennai / Hyderabad / Kolkata / Mumbai / Indore / Ahmedabad / Jaipur / Noida / Patna / Gurgaon / Lucknow / Dehradun / Chandigarh). Spark, Python / Scala, AWS (G...Show moreLast updated: 1 day ago
    •AWS Cloud Engineer •

    •AWS Cloud Engineer •

    AccentureAU
    We work with one shared purpose : to deliver on the promise of technology and human ingenuity.Every day, more than 775,000 of us help our stakeholders continuously reinvent.Together, we drive positi...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    DhyatiPrayagraj(Allahabad), IN
    Cloud Lead Engineer – Azure & SOC 2 Compliance.We are seeking a highly skilled.You will also work cross-functionally to ensure that the deployed applications meet. Lead the deployment, configuration...Show moreLast updated: 1 day ago