Talent.com
This job offer is not available in your country.
AWS Data Lake Engineer

AWS Data Lake Engineer

ConfidentialIndore, India
9 days ago
Job description

Are you ready to write your next chapter

Make your mark at one of the biggest names in payments. With proven technology, we process the largest volume of payments in the world, driving the global economy every day. When you join Worldpay, you join a global community of experts and changemakers, working to reinvent an industry by constantly evolving how we work and making the way millions of people pay easier, every day.

What makes a Worldpayer It's simple : Think, Act, Win. We stay curious, always asking the right questions to be better every day, finding creative solutions to simplify the complex. We're dynamic, every Worldpayer is empowered to make the right decisions for their customers. And we're determined, always staying open – winning and failing as one.

We're looking for a Sr AWS Databricks Admin to join our Big Data Team to help us unleash the potential of every business.

Are you ready to make your mark Then you sound like a Worldpayer.

About The Team

We are seeking a talented and experienced Senior AWS Data Lake Engineer to join our dynamic team who can design, develop, and maintain scalable data pipelines and manage AWS Data Lake solutions. The ideal candidate will have extensive experience in handling sensitive data, including Personally Identifiable Information (PII) and Payment Card Industry (PCI) data, using advanced tokenization and masking techniques.

What You Will Be Doing

  • Design, develop, and maintain scalable data pipelines using Python and AWS services.
  • Implement and manage AWS Data Lake solutions, including ingestion, storage, and cataloging of structured and unstructured data.
  • Apply data tokenization and masking techniques to protect sensitive information in compliance with data privacy regulations (e.g., GDPR, HIPAA).
  • Collaborate with data engineers, architects, and security teams to ensure secure and efficient data flows.
  • Optimize data workflows for performance, scalability, and cost-efficiency.
  • Monitor and troubleshoot data pipeline issues and implement robust logging and alerting mechanisms.
  • Document technical designs, processes, and best practices.
  • Provide support on Databricks and Snowflake.
  • Maintain comprehensive documentation for configurations, procedures, and troubleshooting steps.

What You Bring

  • 5+ years of experience working as a Python developer / architect.
  • Strong proficiency in Python, with experience in data processing libraries (e.g., Pandas, PySpark).
  • Proven experience with AWS services such as S3, Glue, Lake Formation, Lambda, Athena, and IAM.
  • Solid understanding of data lake architecture and best practices.
  • Experience with data tokenization, encryption, and anonymization techniques.
  • Familiarity with data governance, compliance, and security standards.
  • Experience with Snowflake and / or Databricks (Nice to have).
  • Experience with CI / CD tools and version control (e.g., Git, CodePipeline).
  • Strong problem-solving skills and attention to detail.
  • Where you'll own it

    You'll own it in our modern Bangalore / Pune / Indore hub. With hubs in the heart of city centers and tech capitals, things move fast in APAC. We pride ourselves on being an agile and dynamic collective, collaborating with different teams and offices across the globe.

    Worldpay Perks - What We'll Bring For You

    We know it's bigger than just your career. It's your life, and your world. That's why we offer global benefits and programs to support you at every stage. Here's a taste of what you can expect.

  • A competitive salary and benefits.
  • Time to support charities and give back to your community.
  • Parental leave policy.
  • Global recognition platform.
  • Virgin Pulse access.
  • Global employee assistance program.
  • What Makes a Worldpayer

    At Worldpay, we take our Values seriously, and we live them every day. Think like a customer, Act like an owner, and Win as a team.

  • Curious. Humble. Creative. We ask the right questions, listening and learning to get better every day. We simplify the complex and we're always looking to create a bigger impact for our colleagues and customers.
  • Empowered. Accountable. Dynamic. We stay agile, using our initiative, taking calculated risks to progress. Never standing still, never settling, we work at pace to achieve our goals. We champion our ideas and stay flexible to make them happen. We know that every action adds up.
  • Determined. Inclusive. Open. Unlocking potential means working as one global community. Our work spans borders, and we stay united by our purpose. We collaborate, always encouraging others to perform at their best, welcoming new perspectives.
  • Does this sound like you Then you sound like a Worldpayer.

    Apply now to write the next chapter in your career. We can't wait to hear from you.

    To find out more about working with us, find us on LinkedIn.

    Privacy Statement

    Worldpay is committed to protecting the privacy and security of all personal information that we process in order to provide services to our clients. For specific information on how Worldpay protects personal information online, please see the Online Privacy Notice.

    Sourcing Model

    Recruitment at Worldpay works primarily on a direct sourcing model; a relatively small portion of our hiring is through recruitment agencies. Worldpay does not accept resumes from recruitment agencies which are not on the preferred supplier list and is not responsible for any related fees for resumes submitted to job postings, our employees, or any other part of our company.

    #pridepass

    Skills Required

    snowflake , Databricks, Python

    Create a job alert for this search

    Aws Data Engineer • Indore, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHindore, madhya pradesh, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 28 days ago
    • Promoted
    Cloud Engineer Lead (AWS)

    Cloud Engineer Lead (AWS)

    Datapel Systemsindore, madhya pradesh, in
    The Senior Cloud Engineer (AWS) will be responsible for developing, maintaining, optimising and supporting the cloud infrastructure that supports Datapel’s Warehouse Management System (WMS) and rel...Show moreLast updated: 18 days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesindore, madhya pradesh, in
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 26 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    DBiz.aiindore, madhya pradesh, in
    We are seeking a dynamic and skilled AWS Cloud & DevOps Engineer to design, implement, and maintain scalable, secure, and automated cloud environments on Amazon Web Services.The ideal candidate wil...Show moreLast updated: 7 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Servicesindore, madhya pradesh, in
    Job Title : Azure Data Engineer.Required Skillset : Azure Databricks(Strong),scala(strong), Pyspark(Good to have).Azure Databricks using Scala, PySpark. Software Development Life Cycle experience.Work...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeindore, madhya pradesh, in
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 26 days ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USAindore, madhya pradesh, in
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalindore, madhya pradesh, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh Technologiesindore, madhya pradesh, in
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 20 days ago
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    Lemongrassindore, madhya pradesh, in
    Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show moreLast updated: 20 days ago
    • Promoted
    Sr. AWS Cloud Engineer

    Sr. AWS Cloud Engineer

    Mastekindore, madhya pradesh, in
    Cloud Engineer Job description : .Have work experience in the following areas : .Experience in designing, building, and maintaining AWS Cloud Infrastructure. Proficient in AWS services including EC2, S3...Show moreLast updated: 24 days ago
    • Promoted
    Engineer

    Engineer

    Alp Consulting Ltd.indore, madhya pradesh, in
    As a GCP Data Engineer, you will be responsible for designing, building, and maintaining scalable data processing systems on. You will collaborate with cross-functional teams to ensure data is acces...Show moreLast updated: 19 days ago
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    Progliteindore, madhya pradesh, in
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 7 days ago
    • Promoted
    • New!
    Senior Generative AI Engineer (Databricks Data Lake)

    Senior Generative AI Engineer (Databricks Data Lake)

    Ampstekindore, madhya pradesh, in
    Title : Senior Generative AI Engineer (Databricks Data Lake).We are seeking an experienced Senior Generative AI Engineer with a strong background in Databricks and data lake architectures.This indiv...Show moreLast updated: 5 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekindore, madhya pradesh, in
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incindore, madhya pradesh, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 19 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data Solutionsindore, madhya pradesh, in
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.indore, madhya pradesh, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Servicesindore, madhya pradesh, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 4 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    ValueMomentumindore, madhya pradesh, in
    We are seeking a highly skilled.You will work closely with development, operations, and security teams to ensure continuous delivery, high availability, and optimal performance of our applications....Show moreLast updated: 7 days ago