Cloud Data Engineer

LemongrassGuntur, IN

30+ days ago

Job description

About Lemongrass

Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.

We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.

Key Responsibilities :

Design and Development :

Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
Develop and optimize data processing jobs using Spark Scala.

Data Integration and Management :

Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.

Ensure data quality and integrity through rigorous testing and validation.

Perform data extraction from SAP or ERP systems when necessary.

Performance Optimization :

Monitor and optimize the performance of data pipelines and ETL processes.

Implement best practices for data management, including data governance, security, and compliance.

Collaboration and Communication :

Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.

Collaborate with cross-functional teams to design and implement data solutions that meet business needs.

Documentation and Maintenance :

Document technical solutions, processes, and workflows.

Maintain and troubleshoot existing ETL pipelines and data integrations.

Qualifications

Education :

Bachelor’s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus.

Experience :

7+ years of experience as a Data Engineer or in a similar role.

Proven experience with cloud platforms : AWS, Azure, and GCP.

Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.

Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.

Experience in building and managing data lakes and data warehouses.

Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.

Experience with data extraction from SAP or ERP systems is a plus.

Strong experience with Spark and Scala for data processing.

Skills :

Strong programming skills in Python, Java, or Scala.

Proficient in SQL and query optimization techniques.

Familiarity with data modeling, ETL / ELT processes, and data warehousing concepts.

Knowledge of data governance, security, and compliance best practices.

Excellent problem-solving and analytical skills.

Strong communication and collaboration skills.

Preferred Qualifications :

Experience with other data tools and technologies such as Apache Spark, or Hadoop.

Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified : Azure Data Engineer Associate).

Experience with CI / CD pipelines and DevOps practices for data engineering

Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law.

What we offer in return :

Remote Working : Lemongrass always has been and always will offer 100% remote work

Flexibility : Work where and when you like most of the time

Training : A subscription to A Cloud Guru and generous budget for taking certifications and other resources you’ll find helpful

State of the art tech : An opportunity to learn and run the latest industry standard tools

Team : Colleagues who will challenge you giving the chance to learn from them and them from you

Lemongrass Consulting is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics

Create a job alert for this search

Cloud Data Engineer • Guntur, IN

Related jobs

Promoted

Data Engineer

Response InformaticsGuntur, IN

We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 14 days ago

Promoted

Python AWS Data Engineer

Digitrix Software LLPGuntur, IN

Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Nityo InfotechGuntur, IN

Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes.Minimum 5 years of experience in Data Engineering or Infrastructure roles. Proven hands-on experience with Apache Spark ...Show moreLast updated: 4 days ago

Promoted

Data Engineer

TalogyGuntur, IN

This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

SAIVA AIGuntur, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

VeraxionGuntur, IN

Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 4 days ago

Promoted

Cloud Architect

iVedha Inc.Guntur, IN

Seeking a highly experienced Cloud Architect to design and oversee robust, scalable, and secure.Architect end-to-end cloud solutions (public, private, hybrid) with a focus on reliability, security,...Show moreLast updated: 30+ days ago

Promoted

Senior AWS Data Engineer

CYAN360Guntur, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Cloud Spend Optimization Engineer

Abacus.AIGuntur, IN

We’re seeking an engineer with expertise in optimizing AWS cloud costs.In this role, you’ll drive cost efficiency across our infrastructure by analyzing usage, automating optimizations, and guiding...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

IntraEdgeGuntur, IN

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago

Promoted

Cloud Engineer

VML Enterprise SolutionsVijayawada, IN

Type of position : Contract- 6 months.We are looking for talented developers with experience developing complex Cloud AWS serverless applications to join an exciting client project as part of our ex...Show moreLast updated: 14 days ago

Promoted

Data Engineer

Kline + CompanyVijayawada, IN

Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 29 days ago

Promoted

AWS Data Engineer

TerraGiGGuntur, IN

Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 4 days ago

Promoted

Data Engineer

RevXGuntur, IN

RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago

Promoted

Python Data Engineer

iVoyantVijayawada, IN

One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 4 days ago

Promoted

AWS Data Engineer

Tata Consultancy Servicesvijayawada, andhra pradesh, in

Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 1 day ago