Talent.com
This job offer is not available in your country.
3 Days Left : AWS Data engineer / Architect

3 Days Left : AWS Data engineer / Architect

Tata Consultancy ServicesIndia
7 hours ago
Job description

Job Summary : In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the Data Engineering organisation to design and implement scalable data infrastructure and processes using technologies such as Python, PySpark, EMR Serverless, Iceberg, Glue and Glue Data Catalog. The main goal of this position is to ensure successful migration and establish robust data quality governance across the new platform, enabling reliable and efficient data processing. Success in this role requires deep technical expertise, exceptional problem-solving skills, and the ability to lead and mentor within an agile team.

Must Have Tech Skills :

  • Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering a culture of continuous learning and innovation
  • Extensive experience in software architecture and solution design, including microservices, distributed systems, and cloud-native architectures.
  • Expert in Python and Spark, with a deep focus on ETL data processing and data engineering practices.
  • Deep technical knowledge of AWS data services and engineering practices, with demonstrable experience of implementing data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena
  • Experience of delivering Lakehouse solutions / architectures

Nice To Have Tech Skills :

  • Knowledge of additional programming languages and development tools to provide flexibility and adaptability across varied data engineering projects
  • A master’s degree or relevant certifications (e.g., AWS Certified Solutions Architect, Certified Data Analytics) is advantageous
  • Key Accountabilities :

  • Lead complex projects autonomously, fostering an inclusive and open culture within development teams. Mentor team members and lead technical discussions.
  • Provides strategic guidance on best practices in design, development, and implementation. Leads the development of high-quality, efficient code and develops necessary tools and applications to address complex business needs
  • Collaborates closely with architects, Product Owners, and Dev team members to decompose solutions into Epics, leading the design and planning of these components.
  • Drive the migration of existing data processing workflows to a Lakehouse architecture, leveraging Iceberg capabilities.
  • Serves as an internal subject matter expert in software development, advising stakeholders on best practices in design, development, and implementation
  • Key Skills :

  • Deep technical knowledge of data engineering solutions and practices. Expert in AWS services and cloud solutions, particularly as they pertain to data engineering practices
  • Extensive experience in software architecture and solution design
  • Specialized expertise in Python and Spark
  • Ability to provide technical direction, set high standards for code quality and optimize performance in data-intensive environments.
  • Skilled in leveraging automation tools and Continuous Integration / Continuous Deployment (CI / CD) pipelines to streamline development, testing, and deployment.
  • Exceptional communicator who can translate complex technical concepts for diverse stakeholders, including engineers, product managers, and senior executives.
  • Provides thought leadership within the engineering team, setting high standards for quality, efficiency, and collaboration. Experienced in mentoring engineers, guiding them in advanced coding practices, architecture, and strategic problem-solving to enhance team capabilities.
  • Educational Background :

  • Bachelor’s degree in computer science, Software Engineering, or a related field is essential.
  • Bonus Skills :

  • Financial Services expertise preferred, working with Equity and Fixed Income asset classes and a working knowledge of Indices.
  • Create a job alert for this search

    Days Left • India

    Related jobs
    • Promoted
    Data Architect

    Data Architect

    InfoBeansNagpur, IN
    Data Architect – Snowflake & Matillion.Snowflake, Matillion, Data Modeling, SQL, Python / Bash, Cloud Platforms (AWS / Azure). Immediate to 15 days preferred.The ideal candidate is proactive, self-direc...Show moreLast updated: 21 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Strobes Security, Inc.Nagpur, IN
    We are looking for a Mid-level Cloud Engineer with hands-on expertise in designing, automating, and operating production-grade cloud infrastructure. This role requires a strong background in AWS ser...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Azure Cloud Architect / Principal Engineer

    Principal Azure Cloud Architect / Principal Engineer

    First American (India)Nagpur, IN
    Job Title : Principal Azure Cloud Architect / Principal Engineer (20+ Years Experience).We are seeking a technical visionary Principal Azure Cloud Architect with 20+ years of experience to lead the tr...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    XebiaNagpur, IN
    We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week). Data Engineering with 4+ years team leadership...Show moreLast updated: 27 days ago
    • Promoted
    Data Architect

    Data Architect

    G10XNagpur, IN
    Senior Data Architect (15+ Years Experience).We are looking for a seasoned Data Architect to lead and shape enterprise-wide data initiatives. This role requires a strategic leader with deep technica...Show moreLast updated: 5 days ago
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    ProgliteNagpur, IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 12 days ago
    • Promoted
    • New!
    Cloud Architect

    Cloud Architect

    Mitra AINagpur, IN
    We are seeking a motivated Cloud Architect with a strong foundation in cloud architecture, operations, and FinOps practices. The ideal candidate will bring hands-on expertise in AWS services, data p...Show moreLast updated: 14 hours ago
    • Promoted
    Cloud Engineer Lead (AWS)

    Cloud Engineer Lead (AWS)

    Datapel SystemsNagpur, IN
    The Senior Cloud Engineer (AWS) will be responsible for developing, maintaining, optimising and supporting the cloud infrastructure that supports Datapel’s Warehouse Management System (WMS) and rel...Show moreLast updated: 23 days ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USANagpur, IN
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 9 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsNagpur, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 12 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    DBiz.aiNagpur, IN
    We are seeking a dynamic and skilled AWS Cloud & DevOps Engineer to design, implement, and maintain scalable, secure, and automated cloud environments on Amazon Web Services.The ideal candidate wil...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesNagpur, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineering Azure databricks

    Data Engineering Azure databricks

    EXLNagpur, IN
    Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Work with stakeholders to unders...Show moreLast updated: 5 days ago
    • Promoted
    Rocket UniData Engineer

    Rocket UniData Engineer

    Mitra AINagpur, IN
    The ideal candidate will have a deep understanding of UniData and UniVerse environments, with a proven track record in developing, maintaining, and optimizing complex legacy systems.Design, develop...Show moreLast updated: 23 days ago
    • Promoted
    Data Solutions Architect

    Data Solutions Architect

    BristleconeNagpur, IN
    We are seeking an accomplished Data Solutions Architect with deep experience in designing, implementing, and optimizing modern cloud data platforms. The ideal candidate will expertly leverage Snowfl...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    AWS Cloud Solutions Architect

    AWS Cloud Solutions Architect

    Saradysol Tech Ventures Private LimitedNagpur, IN
    Cloud Solutions Architect with strong AWS expertise to help us bridge immediate delivery needs while guiding us toward our longer-term enterprise architecture vision. This person will backfill key r...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Infrastructure Engineer (AWS & Typescript)

    Infrastructure Engineer (AWS & Typescript)

    Crossing HurdlesNagpur, IN
    AWS CDK + TypeScript - Infrastructure Engineer.We are seeking an experienced Infrastructure Engineer specializing in AWS CDK and TypeScript to design, develop, and maintain scalable cloud infrastru...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Vriba SolutionsNagpur, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Databricks Engineer

    Databricks Engineer

    RapidBrainsNagpur, IN
    ETL, and cloud-based data solutions.The ideal candidate should be highly skilled in.SQL, Databricks, PySpark, and cloud technologies. AWS (S3, Redshift, Lambda, EC2).Automate ETL processes and impro...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekNagpur, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 22 days ago