This job offer is not available in your country.
Cloud Data Engineer
LemongrassTiruppur, IN30+ days ago
Job descriptionIntegrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake. Ensure data quality and integrity through rigorous testing and validation. Perform data extraction from SAP or ERP systems when necessary. Monitor and optimize the performance of data pipelines and ETL processes. Implement best practices for data management, including data governance, security, and compliance. Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Collaborate with cross-functional teams to design and implement data solutions that meet business needs. Document technical solutions, processes, and workflows. Maintain and troubleshoot existing ETL pipelines and data integrations. Bachelor’s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus. 7+ years of experience as a Data Engineer or in a similar role. Proven experience with cloud platforms : AWS, Azure, and GCP. Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc. Experience with other ETL tools like Informatica, SAP Data Intelligence, etc. Experience in building and managing data lakes and data warehouses. Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse. Experience with data extraction from SAP or ERP systems is a plus. Strong experience with Spark and Scala for data processing. Strong programming skills in Python, Java, or Scala. Proficient in SQL and query optimization techniques. Familiarity with data modeling, ETL / ELT processes, and data warehousing concepts. Knowledge of data governance, security, and compliance best practices. Excellent problem-solving and analytical skills. Strong communication and collaboration skills. Experience with other data tools and technologies such as Apache Spark, or Hadoop. Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified : Azure Data Engineer Associate). Experience with CI / CD pipelines and DevOps practices for data engineering Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law. Remote Working : Lemongrass always has been and always will offer 100% remote work Flexibility : Work where and when you like most of the time Training : A subscription to A Cloud Guru and generous budget for taking certifications and other resources you’ll find helpful State of the art tech : An opportunity to learn and run the latest industry standard tools Team : Colleagues who will challenge you giving the chance to learn from them and them from you
About Lemongrass
Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.
We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.
Key Responsibilities :
Design and Development :
- Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
- Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
- Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
- Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
- Develop and optimize data processing jobs using Spark Scala.
Data Integration and Management :
Performance Optimization :
Collaboration and Communication :
Documentation and Maintenance :
Qualifications
Education :
Experience :
Skills :
Preferred Qualifications :
What we offer in return :
Lemongrass Consulting is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics
Create a job alert for this search
Cloud Data Engineer • Tiruppur, IN
Related jobs
- Promoted
Cloud Data Engineer
LemongrassErode, IN Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Innodata Inc.Erode, IN CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 23 days ago
- Promoted
AWS Cloud Engineer
ProgliteCoimbatore, IN Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments.
Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 5 days ago
- Promoted
Sr. AWS Cloud Engineer
MastekCoimbatore, IN Cloud Engineer Job description : .Have work experience in the following areas : .Experience in designing, building, and maintaining AWS Cloud Infrastructure.
Proficient in AWS services including EC2, S3...Show moreLast updated: 22 days ago
- Promoted
Data Engineer
Kumaran SystemsErode, IN Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 5 days ago
- Promoted
Lead Data Engineer
Eucloid Data SolutionsErode, IN Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 5 days ago
- Promoted
Cloud Platform Engineer (5+ Years)
VerticalServeErode, IN Data & AI company committed to building cutting-edge AI products and providing expert professional services to our clients.
Founded in 2013, we have established ourselves as a nimble, innovative sta...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
EveriseErode, IN Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 4 days ago
- Promoted
Data Engineer
Bahwan CyberTekErode, IN Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 15 days ago
- Promoted
Senior Cloud Engineer AWS
Matrix USACoimbatore, IN We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 2 days ago
- Promoted
Senior Cloud Engineer
Dexian IndiaCoimbatore, IN Title : Senior Cloud Engineer / FullStack Developer (with Cloud Experience).Notice Period : Immediate to Currently serving.
Proficiency in modern programming languages such as Java, Python, JavaScript,...Show moreLast updated: 24 days ago
- Promoted
- Promoted
Data Engineer
Insight GlobalErode, IN Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume.
Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
- Promoted
Cloud Engineer
Strobes Security, Inc.Erode, IN We are looking for a Mid-level Cloud Engineer with hands-on expertise in designing, automating, and operating production-grade cloud infrastructure.
This role requires a strong background in AWS ser...Show moreLast updated: 24 days ago
- Promoted
Oracle Cloud Engineer
Optimal Virtual EmployeeErode, IN Job Description : Oracle Cloud Engineer (ERP, PaaS, APEX, DB, and AI Integration).Position Title : Oracle Cloud Engineer (ERP, PaaS, APEX, DB, and AI Integration).
We are seeking a highly skilled and ...Show moreLast updated: 6 days ago
- Promoted
Senior Data Engineer
InfogainCoimbatore, IN Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers.
You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
- Promoted
Cloud Engineer
DBiz.aiTiruppur, IN We are seeking a dynamic and skilled AWS Cloud & DevOps Engineer to design, implement, and maintain scalable, secure, and automated cloud environments on Amazon Web Services.The ideal candidate wil...Show moreLast updated: 6 days ago
- Promoted
Cloud Engineer
Delta System & Software, Inc.Tiruppur, IN AWS Cloud Development Kit (AWS CDK) in TypeScript.Solid experience with TypeScript fundamentals : interfaces, types, classes, generics.
Experience writing unit tests for infrastructure code using Jes...Show moreLast updated: 3 days ago
- Promoted
Senior Cloud Platform Engineer -AWS-Salary 70LPA
The BigCjobs.comErode, IN We are looking for a Senior Cloud Platform Engineer to lead the automation, reliability, and performance of our AWS-based infrastructure.
You will architect, optimize, and scale mission-critical sys...Show moreLast updated: 4 days ago
- Promoted
Lead Azure Data Engineer
RandomTreesTiruppur, IN We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies.
If you're passionate about building r...Show moreLast updated: 24 days ago