Talent.com
Cloud Data Engineer
Cloud Data EngineerLemongrass • Chennai, IN
Cloud Data Engineer

Cloud Data Engineer

Lemongrass • Chennai, IN
30+ days ago
Job description

About Lemongrass

Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.

We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.

Key Responsibilities :

Design and Development :

  • Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
  • Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
  • Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
  • Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
  • Develop and optimize data processing jobs using Spark Scala.

Data Integration and Management :

  • Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Perform data extraction from SAP or ERP systems when necessary.
  • Performance Optimization :

  • Monitor and optimize the performance of data pipelines and ETL processes.
  • Implement best practices for data management, including data governance, security, and compliance.
  • Collaboration and Communication :

  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Collaborate with cross-functional teams to design and implement data solutions that meet business needs.
  • Documentation and Maintenance :

  • Document technical solutions, processes, and workflows.
  • Maintain and troubleshoot existing ETL pipelines and data integrations.
  • Qualifications

    Education :

  • Bachelor’s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus.
  • Experience :

  • 7+ years of experience as a Data Engineer or in a similar role.
  • Proven experience with cloud platforms : AWS, Azure, and GCP.
  • Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
  • Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
  • Experience in building and managing data lakes and data warehouses.
  • Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
  • Experience with data extraction from SAP or ERP systems is a plus.
  • Strong experience with Spark and Scala for data processing.
  • Skills :

  • Strong programming skills in Python, Java, or Scala.
  • Proficient in SQL and query optimization techniques.
  • Familiarity with data modeling, ETL / ELT processes, and data warehousing concepts.
  • Knowledge of data governance, security, and compliance best practices.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Preferred Qualifications :

  • Experience with other data tools and technologies such as Apache Spark, or Hadoop.
  • Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified : Azure Data Engineer Associate).
  • Experience with CI / CD pipelines and DevOps practices for data engineering
  • Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law.
  • What we offer in return :

  • Remote Working : Lemongrass always has been and always will offer 100% remote work
  • Flexibility : Work where and when you like most of the time
  • Training : A subscription to A Cloud Guru and generous budget for taking certifications and other resources you’ll find helpful
  • State of the art tech : An opportunity to learn and run the latest industry standard tools
  • Team : Colleagues who will challenge you giving the chance to learn from them and them from you
  • Lemongrass Consulting is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics

    Create a job alert for this search

    Cloud Data Engineer • Chennai, IN

    Related jobs
    Data Engineer

    Data Engineer

    TerraGiG • Chennai, IN
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Grantify • Chennai, IN
    Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirat...Show more
    Last updated: 2 days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    TaskUs • Chennai, Tamil Nadu, India
    TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies helping its clients represent protect and grow their brands.Leveragi...Show more
    Last updated: 20 days ago • Promoted
    Cloud - Snowflake, AWS

    Cloud - Snowflake, AWS

    Saaki Argus & Averil Consulting • Chennai, Tamil Nadu, India
    Quick Apply
    Cloud Data Engineer - Snowflake, AWS.Encourage applications from all qualified candidates, especially women who are returning to the workforce after a career break (up to 4 years).Develop and imple...Show more
    Last updated: 30+ days ago
    PLM Data & Analytics Cloud Engineer

    PLM Data & Analytics Cloud Engineer

    Ford Motor • Chennai, Tamil Nadu, India
    As a Senior Data Engineer you will leverage your deep knowledge of GCP and your experience with cloud migration to build and maintain scalable secure and reliable Data solutions.You will collaborat...Show more
    Last updated: 22 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastek • Chennai, Tamil Nadu, India
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show more
    Last updated: 26 days ago • Promoted
    Senior Cloud IAM Engineer (AWS / Okta)

    Senior Cloud IAM Engineer (AWS / Okta)

    Vertex Agility • Chennai, IN
    Senior Cloud IAM Engineer (AWS / Okta) – Remote.Vertex Agility | Agile On-Demand Solutions.Are you passionate about identity management and cloud security? Vertex Agility is looking for a Senior Cl...Show more
    Last updated: 26 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VXI Global Solutions • Chennai, IN
    We are seeking talented and motivated Data Engineers to join our dynamic team and contribute to our mission of harnessing the power of data to drive growth and success. As a Data Engineer at VXI Glo...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Spend Optimization Engineer

    Cloud Spend Optimization Engineer

    Abacus.AI • Chennai, IN
    We’re seeking an engineer with expertise in optimizing AWS cloud costs.In this role, you’ll drive cost efficiency across our infrastructure by analyzing usage, automating optimizations, and guiding...Show more
    Last updated: 30+ days ago • Promoted
    Senior Cloud Data Engineer

    Senior Cloud Data Engineer

    BMW TechWorks India • Chennai, Tamil Nadu, India
    You will design develop and optimize large-scale data pipelines.You will take ownership of critical components of the data architecture ensuring performance security and compliance.Design and imple...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer-Aws

    Data Engineer-Aws

    Saaki Argus & Averil Consulting • Chennai, Tamil Nadu, India
    Quick Apply
    Design, develop, and maintain scalable data pipelines using.Work with large datasets to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.Build automa...Show more
    Last updated: 30+ days ago
    Data Engineer

    Data Engineer

    Insight Global • Chennai, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    Proglite • Chennai, IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    loanDNA • Chennai, Tamil Nadu, India
    We are seeking an experienced Snowflake Developer with a minimum of 5 years of hands-on experience in Snowflake development, integration, migration, and deployment. The ideal candidate will be respo...Show more
    Last updated: 23 days ago • Promoted
    Cloud Engineer - Full Remote (Global Cloud-Native Projects)

    Cloud Engineer - Full Remote (Global Cloud-Native Projects)

    SkillsCapital • Chennai, IN
    Remote
    These long-term, fully remote freelance roles are ideal for engineers with strong hands-on experience in AWS, Azure, or Google Cloud who want to build scalable, secure, high-performance cloud solut...Show more
    Last updated: 1 day ago • Promoted
    Cloud Engineer

    Cloud Engineer

    Tata Consultancy Services • Chennai, Tamil Nadu, India
    TCS is hiring for AWS Connect Senior Engineer.Location : Chennai, Bangalore, Kolkata.Overall experience in AWS Cloud Technologies. Proficient in Amazon Lex, Deep understanding of Lex features, capabi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)

    Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)

    SkillsCapital • Chennai, IN
    Remote
    These fully remote, long-term freelance roles are ideal for engineers who can build scalable data pipelines, work with modern cloud-native data stacks, and support large-scale enterprise data initi...Show more
    Last updated: 1 day ago • Promoted
    AWS Senior Data Engineer

    AWS Senior Data Engineer

    Tata Consultancy Services • Chennai, Tamil Nadu, India
    TCS is Hiring of AWS Senior Data Engineer.Overall experience in AWS Cloud Technologies.Proficient in Amazon Lex, Deep understanding of Lex features, capabilities, and limitations, AWS Ecosystem Kno...Show more
    Last updated: 14 days ago • Promoted