Talent.com
Cloud ETL Engineer
Cloud ETL EngineerLemongrass • Republic Of India, IN
Cloud ETL Engineer

Cloud ETL Engineer

Lemongrass • Republic Of India, IN
30+ days ago
Job description

About Lemongrass

Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.

We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.

Key Responsibilities :

Design and Development :

  • Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
  • Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
  • Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
  • Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
  • Develop and optimize data processing jobs using Spark Scala.

Data Integration and Management :

  • Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Perform data extraction from SAP or ERP systems when necessary.
  • Performance Optimization :

  • Monitor and optimize the performance of data pipelines and ETL processes.
  • Implement best practices for data management, including data governance, security, and compliance.
  • Collaboration and Communication :

  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Collaborate with cross-functional teams to design and implement data solutions that meet business needs.
  • Documentation and Maintenance :

  • Document technical solutions, processes, and workflows.
  • Maintain and troubleshoot existing ETL pipelines and data integrations.
  • Qualifications

    Education :

  • Bachelor’s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus.
  • Experience :

  • 7+ years of experience as a Data Engineer or in a similar role.
  • Proven experience with cloud platforms : AWS, Azure, and GCP.
  • Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
  • Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
  • Experience in building and managing data lakes and data warehouses.
  • Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
  • Experience with data extraction from SAP or ERP systems is a plus.
  • Strong experience with Spark and Scala for data processing.
  • Skills :

  • Strong programming skills in Python, Java, or Scala.
  • Proficient in SQL and query optimization techniques.
  • Familiarity with data modeling, ETL / ELT processes, and data warehousing concepts.
  • Knowledge of data governance, security, and compliance best practices.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Preferred Qualifications :

  • Experience with other data tools and technologies such as Apache Spark, or Hadoop.
  • Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified : Azure Data Engineer Associate).
  • Experience with CI / CD pipelines and DevOps practices for data engineering
  • Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law.
  • What we offer in return :

  • Remote Working : Lemongrass always has been and always will offer 100% remote work
  • Flexibility : Work where and when you like most of the time
  • Training : A subscription to A Cloud Guru and generous budget for taking certifications and other resources you’ll find helpful
  • State of the art tech : An opportunity to learn and run the latest industry standard tools
  • Team : Colleagues who will challenge you giving the chance to learn from them and them from you
  • Lemongrass Consulting is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics

    Create a job alert for this search

    Engineer Etl • Republic Of India, IN

    Related jobs
    ETL Solutions Engineer

    ETL Solutions Engineer

    Bahwan CyberTek • Chennai, Republic Of India, IN
    Mid-Level Integration Engineer.Support, maintain, and enhance existing Java Spring Boot microservices in a distributed environment. Design, develop, and implement ETL processes using tools like Info...Show more
    Last updated: 22 days ago • Promoted
    ETL Solutions Engineer

    ETL Solutions Engineer

    EXL • Pune, Republic Of India, IN
    Location - Pune, Bangalore, Noida, Gurgaon, Hyderabad.The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driv...Show more
    Last updated: 30+ days ago • Promoted
    ETL Applications Engineer

    ETL Applications Engineer

    Peoplefy • Pune, Republic Of India, IN
    Hiring : IT Applications Engineer Informatica Developer (Immediate Joiner).Experience Required : 6 -11 Years.Specialization : IICS, ADF / Azure data-brick, Python. ETL processes using Informatica IICS.E...Show more
    Last updated: 2 days ago • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    Vista Applied Solutions Group Inc • Republic Of India, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more
    Last updated: 9 days ago • Promoted
    Cloud ETL Architect

    Cloud ETL Architect

    Terra Technology Circle Consulting Private Limited • Republic Of India, IN
    Experience with Data / Content Crawling from public Internet,bot detection avoidance techniques and use of VPN.Expertise in Data Engineering-modelling and managing multi dimensional entitles and gra...Show more
    Last updated: 15 days ago • Promoted
    ETL Cloud Specialist

    ETL Cloud Specialist

    Tata Consultancy Services • Chennai, Republic Of India, IN
    Required Technical Skill Set • •Exp of Moving Informatica Power Centre to Cloud, IICS, Python, API.Location : Kolkata / Delhi / Bangalore / Chennai. Desired Competencies (Technical / Behavioral Competency).Exp...Show more
    Last updated: 13 hours ago • Promoted • New!
    ETL Systems Engineer

    ETL Systems Engineer

    Grantify • Republic Of India, IN
    Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirat...Show more
    Last updated: 5 hours ago • Promoted • New!
    ETL Solutions Engineer

    ETL Solutions Engineer

    Trinity Technology Solutions LLC • Pune, Republic Of India, IN
    Location : Pune preferred / remote.Programming Python, PySpark / Spark.Operating Systems Linux (RedHat).Databases Hive, MSSQL, MySQL, PostgreSQL. Big Data Hadoop ecosystem (HDFS, YARN, Sqoop).Version Co...Show more
    Last updated: 9 days ago • Promoted
    Cloud ETL Performance Engineer

    Cloud ETL Performance Engineer

    Mastek • Republic Of India, IN
    We need an experienced AWS Data Engineer / Performance Optimization Consultant to help us analyze, tune, and optimize our existing AWS Glue ETL, Step Functions workflows and Amazon Redshift data wa...Show more
    Last updated: 24 days ago • Promoted
    ETL Solutions Engineer

    ETL Solutions Engineer

    Tata Consultancy Services • Pune, Republic Of India, IN
    ETL / Python / SQL, and data visualization / exploration tools.Experience in building complex SQL queries.Familiarity with the Azure Databricks, Azure Data Factory. Develops and maintains scalable data pi...Show more
    Last updated: 24 days ago • Promoted
    ETL Solutions Engineer

    ETL Solutions Engineer

    NexionPro Services • Republic Of India, IN
    PySpark-based data processing workflows.Collaborate with data architects, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.Optimi...Show more
    Last updated: 30+ days ago • Promoted
    ETL / ELT Engineer

    ETL / ELT Engineer

    Vriba Solutions • Republic Of India, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    GoML • India, India
    At goML, we design and build cutting-edge Generative AI, AI / ML, and Data Engineering solutions that help businesses unlock the full potential of their data, drive intelligent automation, and create...Show more
    Last updated: 2 days ago • Promoted
    ETL Engineer

    ETL Engineer

    Atica Global • Pune, Republic Of India, IN
    Atica is a leading, tech-first remote sales & revenue management company for Hotels and Hotel operators in the US, enabled by a unified tech-led solution. We are a startup, funded by the top investo...Show more
    Last updated: 24 days ago • Promoted
    ETL Engineer

    ETL Engineer

    Tata Consultancy Services • Pune, Republic Of India, IN
    TCS is hiring for AWS Data engineer, please find the below JD.Experience range – 6 to 8 years.Location - Hyderabad / Pune / Indore. Skills Required - AWS, Pyspark, EMR, Glue.AMI Rehydration, Cloud for...Show more
    Last updated: 30+ days ago • Promoted
    Senior ETL Engineer

    Senior ETL Engineer

    SAIVA AI • Republic Of India, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    ETL Solutions Engineer

    ETL Solutions Engineer

    TalentOnLease • Bhopal, Republic Of India, IN
    We are looking for skilled ETL Developers with strong expertise in SQL and Informatica Intelligent Cloud Services (IICS). The role involves designing and implementing high-quality ETL workflows whil...Show more
    Last updated: 4 days ago • Promoted
    Lead Cloud Integration Engineer

    Lead Cloud Integration Engineer

    Sodexo • Republic Of India, IN
    The Senior Azure Integration Engineer is responsible for designing, developing, and maintaining complex integration solutions that connect various systems and applications across Sodexo's global en...Show more
    Last updated: 24 days ago • Promoted