Cloud Data Engineer
Lemongrassludhiana, India6 days ago
Job descriptionIntegrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake. Ensure data quality and integrity through rigorous testing and validation. Perform data extraction from SAP or ERP systems when necessary. Monitor and optimize the performance of data pipelines and ETL processes. Implement best practices for data management, including data governance, security, and compliance. Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Collaborate with cross-functional teams to design and implement data solutions that meet business needs. Document technical solutions, processes, and workflows. Maintain and troubleshoot existing ETL pipelines and data integrations. Bachelor’s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus. 7+ years of experience as a Data Engineer or in a similar role. Proven experience with cloud platforms : AWS, Azure, and GCP. Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc. Experience with other ETL tools like Informatica, SAP Data Intelligence, etc. Experience in building and managing data lakes and data warehouses. Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse. Experience with data extraction from SAP or ERP systems is a plus. Strong experience with Spark and Scala for data processing. Strong programming skills in Python, Java, or Scala. Proficient in SQL and query optimization techniques. Familiarity with data modeling, ETL / ELT processes, and data warehousing concepts. Knowledge of data governance, security, and compliance best practices. Excellent problem-solving and analytical skills. Strong communication and collaboration skills. Experience with other data tools and technologies such as Apache Spark, or Hadoop. Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified : Azure Data Engineer Associate). Experience with CI / CD pipelines and DevOps practices for data engineering Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law. Remote Working : Lemongrass always has been and always will offer 100% remote work Flexibility : Work where and when you like most of the time Training : A subscription to A Cloud Guru and generous budget for taking certifications and other resources you’ll find helpful State of the art tech : An opportunity to learn and run the latest industry standard tools Team : Colleagues who will challenge you giving the chance to learn from them and them from you
About Lemongrass
Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.
We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.
Key Responsibilities :
Design and Development :
- Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
- Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
- Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
- Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
- Develop and optimize data processing jobs using Spark Scala.
Data Integration and Management :
Performance Optimization :
Collaboration and Communication :
Documentation and Maintenance :
Qualifications
Education :
Experience :
Skills :
Preferred Qualifications :
What we offer in return :
Lemongrass Consulting is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics
Create a job alert for this search
Cloud Data Engineer • ludhiana, India
Related jobs
- Promoted
Data Engineer
Response Informaticsludhiana, punjab, in We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals.
If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 24 days ago
- Promoted
Data Engineer
Impetusludhiana, India Strong ability to write clean and efficient code.Good understanding of Spark SQL for distributed data processing.Experience with large datasets and structured data manipulation.Ability to write que...Show moreLast updated: 5 days ago
- Promoted
Cloud Engineer
MAHTOludhiana, punjab, in MAHTO is a platform that connects contractors and homeowners with skilled blue-collar workers, primarily from the home building industry.
We facilitate easy hiring of construction contractors.Additi...Show moreLast updated: 3 days ago
- Promoted
- New!
AWS Data Engineer
Tata Consultancy Servicesludhiana, punjab, in Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 16 hours ago
- Promoted
Azure Cloud - AI ML Python Backend Engineer
Serenoludhiana, punjab, in You're someone who’s already shipped GenAI stuff—even if it was small : a chatbot, a RAG tool, or an agent prototype.You live in Python, LangChain, LlamaIndex, Hugging Face, and vector DBs like FAIS...Show moreLast updated: 8 days ago
- Promoted
Python AWS Data Engineer
Digitrix Software LLPludhiana, India Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 2 days ago
- Promoted
Cloud Spend Optimization Engineer
Abacus.AIludhiana, India We’re seeking an engineer with expertise in optimizing AWS cloud costs.In this role, you’ll drive cost efficiency across our infrastructure by analyzing usage, automating optimizations, and guiding...Show moreLast updated: 6 days ago
- Promoted
Data Engineer
V2Softludhiana, India Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala.
Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 6 days ago
- Promoted
Lead Data Engineer
ITQube LTDludhiana, India Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 6 days ago
- Promoted
Cloud Engineer
VML Enterprise Solutionsludhiana, India Type of position : Contract- 6 months.We are looking for talented developers with experience developing complex Cloud AWS serverless applications to join an exciting client project as part of our ex...Show moreLast updated: 6 days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladeludhiana, India The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 6 days ago
- Promoted
Data streaming Engineer
Xebialudhiana, India We’re seeking a hands-on engineer with deep expertise in Confluent Cloud Kafka and Apache Flink.Candidate should be able to design, build, and operate real-time streaming pipelines and analytics, w...Show moreLast updated: 2 days ago
- Promoted
Lead - Cloud Reliability Engineer
Searce Includhiana, India The ‘process-first’ AI-native modern tech consultancy that's rewriting the rules.As an engineering-led consultancy, we are dedicated to relentlessly improving the real business outcomes.Our solvers...Show moreLast updated: 4 days ago
- Promoted
Data Engineer
Sikich Indialudhiana, punjab, in Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
- Promoted
Cloud Engineer
Sonata Softwareludhiana, India Experience : 5+ years of experience in IT systems administration, with at least 3 years in a senior role focused exclusively on Google Workspace.
Expertise : Expert-level proficiency in the Google Wor...Show moreLast updated: 6 days ago
- Promoted
Data Engineer
Talogyludhiana, India This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 6 days ago
- Promoted
Senior Data Engineer
USEReadyludhiana, punjab, in Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 24 days ago
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail Analyticsludhiana, India Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equivalent...Show moreLast updated: 6 days ago