Talent.com
Cloud Data Engineer

Cloud Data Engineer

Lemongrasskurnool, andhra pradesh, in
30+ days ago
Job description

About Lemongrass

Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.

We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.

Key Responsibilities :

Design and Development :

  • Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
  • Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
  • Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
  • Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
  • Develop and optimize data processing jobs using Spark Scala.

Data Integration and Management :

  • Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Perform data extraction from SAP or ERP systems when necessary.
  • Performance Optimization :

  • Monitor and optimize the performance of data pipelines and ETL processes.
  • Implement best practices for data management, including data governance, security, and compliance.
  • Collaboration and Communication :

  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Collaborate with cross-functional teams to design and implement data solutions that meet business needs.
  • Documentation and Maintenance :

  • Document technical solutions, processes, and workflows.
  • Maintain and troubleshoot existing ETL pipelines and data integrations.
  • Qualifications

    Education :

  • Bachelor’s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus.
  • Experience :

  • 7+ years of experience as a Data Engineer or in a similar role.
  • Proven experience with cloud platforms : AWS, Azure, and GCP.
  • Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
  • Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
  • Experience in building and managing data lakes and data warehouses.
  • Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
  • Experience with data extraction from SAP or ERP systems is a plus.
  • Strong experience with Spark and Scala for data processing.
  • Skills :

  • Strong programming skills in Python, Java, or Scala.
  • Proficient in SQL and query optimization techniques.
  • Familiarity with data modeling, ETL / ELT processes, and data warehousing concepts.
  • Knowledge of data governance, security, and compliance best practices.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Preferred Qualifications :

  • Experience with other data tools and technologies such as Apache Spark, or Hadoop.
  • Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified : Azure Data Engineer Associate).
  • Experience with CI / CD pipelines and DevOps practices for data engineering
  • Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law.
  • What we offer in return :

  • Remote Working : Lemongrass always has been and always will offer 100% remote work
  • Flexibility : Work where and when you like most of the time
  • Training : A subscription to A Cloud Guru and generous budget for taking certifications and other resources you’ll find helpful
  • State of the art tech : An opportunity to learn and run the latest industry standard tools
  • Team : Colleagues who will challenge you giving the chance to learn from them and them from you
  • Lemongrass Consulting is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics

    Create a job alert for this search

    Cloud Data Engineer • kurnool, andhra pradesh, in

    Related jobs
    • Promoted
    Azure Cloud Data Engineer

    Azure Cloud Data Engineer

    IntelebeeKurnool, IN
    Data Factory, Synapse, and Databricks.Python, PySpark, and Advanced SQL.Lakehouse / Medallion architecture.Customer Interaction & Technical Documentation. Interact with clients and business stakehol...Show moreLast updated: 15 days ago
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    ProgliteKurnool, IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticskurnool, andhra pradesh, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticskurnool, andhra pradesh, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    Lead - Cloud Reliability Engineer

    Lead - Cloud Reliability Engineer

    Searce Inckurnool, andhra pradesh, in
    The ‘process-first’ AI-native modern tech consultancy that's rewriting the rules.As an engineering-led consultancy, we are dedicated to relentlessly improving the real business outcomes.Our solvers...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Cloud Data Engineer

    Cloud Data Engineer

    LatentBridgekurnool, andhra pradesh, in
    Job Title : Cloud Data Engineer (Kubernetes / Trino).Location : India(Pune / Bangalore / Bhopal / Remote).Technical evaluation – focused on. Azure infrastructure knowledge.Best practices in operations and ...Show moreLast updated: 20 hours ago
    • Promoted
    Data Engineer – Azure & AWS

    Data Engineer – Azure & AWS

    Yoda TechKurnool, IN
    We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 9 days ago
    • Promoted
    • New!
    Snowflake Data Engineer

    Snowflake Data Engineer

    Newpage SolutionsKurnool, IN
    Location : Remote | Type : Contract.Newpage Solutions is a global digital health innovation company helping people live longer, healthier lives. We partner with life sciences organizations—including p...Show moreLast updated: 21 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Dexian Indiakurnool, andhra pradesh, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 20 hours ago
    • Promoted
    • New!
    Cloud Engineer

    Cloud Engineer

    SysTechCorp Inckurnool, andhra pradesh, in
    Experience in AWS cloud – Lambda based microservices.GitHub CICD experience (GitHub Actions is a plus).Go & Python programming language. Experience in building & managing CICD pipelines for Kubernet...Show moreLast updated: 19 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroKurnool, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladekurnool, andhra pradesh, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Cloud Engineer

    Cloud Engineer

    Gunpowder InnovationsKurnool, IN
    Gunpowder Innovations is a technology-first company building high-performance applications in fintech and health tech.Our engineering team is passionate about solving complex problems at scale, del...Show moreLast updated: 21 hours ago
    • Promoted
    • New!
    Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

    Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

    All European Careerskurnool, andhra pradesh, in
    Remote
    For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of...Show moreLast updated: 20 hours ago
    • Promoted
    • New!
    Cloud Engineer

    Cloud Engineer

    ACL Digitalkurnool, andhra pradesh, in
    You’ll win us over if you have : .Deep expertise in AWS Cloud Services and IaC (CloudFormation).A solid understanding of CI / CD and DevOps principles. Manage and optimize AWS services including S3, Dyn...Show moreLast updated: 19 hours ago
    • Promoted
    • New!
    Azure Snowflake Data Engineer

    Azure Snowflake Data Engineer

    LTIMindtreekurnool, andhra pradesh, in
    Design, develop, and maintain scalable data pipelines using.Collaborate with cross-functional teams to gather requirements and deliver data solutions. Ensure data quality, integrity, and security ac...Show moreLast updated: 19 hours ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    VML Enterprise SolutionsKurnool, IN
    Type of position : Contract- 6 months.We are looking for talented developers with experience developing complex Cloud AWS serverless applications to join an exciting client project as part of our ex...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    DigitalzoneKurnool, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 21 hours ago