Talent.com
This job offer is not available in your country.
Staff Engineer - DataOps engineering, Python, API

Staff Engineer - DataOps engineering, Python, API

American Expresschennai, India
1 day ago
Job description

At American Express, our culture is built on a 175-year history of innovation, shared and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you’ll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career.

Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express.

Join Team Amex and let's lead the way together.

As part of our diverse tech team, you can architect, code and ship software that makes us an essential part of our customers’ digital lives.Here, you can work alongside talented engineers in an open, supportive, inclusive environment where your voice is valued, and you make your own decisions on what tech to use to solve challenging problems.American Express offers a range of opportunities to work with the latest technologies and encourages you to back the broader engineering community through open source.And because we understand the importance of keeping your skills fresh and relevant, we give you dedicated time to invest in your professional development.Find your place in technology on #TeamAmex.

How will you make an impact in this role?

The Infrastructure Data & Analytics team unifies FinOps, Data Science and Business Intelligence to enable Technology cost transparency, infrastructure performance optimization and commercial efficiency for the enterprise through consistent, high-quality data and predictive analytics. This team within Global Infrastructure aims to establish and reinforce a culture of effective metrics, data-driven business processes, architecture simplification, and cost awareness. Metric-driven cost optimization, workload-specific forecasting and robust contract management are among the tools and practices required to drive accountability for delivering business solutions that derive maximum value. The result will provide a solid foundation for decision-making around cost, quality and speed.

We are seeking a visionary leader to play a pivotal role in shaping the future of our organization by leading the development and implementation of our target state data architecture.This experienced Staff Engineer will be responsible for leading the design, development, and enhancement of our data model and architecture. The Staff Engineer will lead a team that will set the foundation for how infrastructure utilization, consumption and asset inventory data is ingested, validated, and presented in our suite of reporting capabilities. They will be responsible for ensuring our data feeds and processes are automated wherever possible and data quality (data accuracy, completeness, timeliness, consistency, uniqueness and relevance) is meeting the highest standards. This individual will partner across ID&A and Global Infrastructure product teams to aggregate and provide consistent data to users, leverage best practices for data management, and set expectations on how downstream systems should access different types of data.

Let’s build on what you know.

This role will require a unique blend of strategic vision, analytical prowess, and effective stakeholder engagement to deliver high-quality data consistently and efficiently to drive decision-making for our business and technology stakeholders. This individual will build a deep understanding of the infrastructure data we use in order to work across the ID&A team and key stakeholders the appropriate data to tell a data story. This includes implementing and maintaining a data architecture that follows data management best practices for ensuring data ingestion, transformation, storage and analytics are handled according to their specific purpose using the appropriate tools : ingestion captures raw data without applying business logic, transformation processes data discretely for auditability, and analytical queries retrieve structured outputs without relying on upstream processes. The Sr. Staff Engineer will also play a critical role in architecting the target state for our broader Infrastructure data domain in partnership with our Head Engineer and Enterprise Architecture. They will bring passion for data-driven decisions, enterprise solutions, and collaboration to the role, transforming platform data into actionable insights by utilizing data engineering and data visualization best practices.

Key responsibilities include :

  • Data Architecture : Function as steward and owner of ID&A’s data lake, including developing data pipelines, new database structures and APIs as applicable
  • Data Design : Translate logical data architectures into physical data designs, ensuring alignment with data modeling best practices and standards
  • Data Process and Monitoring : Ensure proper data ingestion, validation, testing, and monitoring for ID&A data lake
  • Data Migration : Design and support migration to a data model that is independent of the particular technologies or tools used for storing, processing, or accessing the data
  • Data Integrity : Ensure the accuracy, completeness, and quality of data is maintained over time regardless of upstream systems or downstream
  • Agile Methodologies : Lead an agile feature team and manage data assets as per the enterprise standards, guidelines and policies
  • Partner closely with business intelligence team to capture and define data requirements for new and enhanced data visualizations
  • Work with product teams to prioritize new capabilities and data requirements for ongoing sprints and manage backlog
  • Enterprise Thinking : Partner with data architects and engineers across Global Infrastructure and Asset Management teams to evolve the broader tech operations data architecture landscape
  • Enforce SDLC standards, enterprise reuse, and architecture guidelines and participate in any required Architecture Design Reviews
  • Act as point of contact for data-related inquiries and data access requests
  • Contribute to decisions about tools, methods and approaches
  • Innovation : Leverage the evolving technical landscape as needed, including AI, Big Data, Machine Learning and other technologies to deliver meaningful business insights

Minimum Requirements :

  • 10+ years of DataOps engineering experience in implementing pipeline orchestration, data quality monitoring, governance, security processes, and self-service data access
  • Deep technical understanding of event-driven architectures, API-first design, cloud-native technologies, and front-end integration patterns
  • Extensive experience managing databases, ETL / ELT pipelines, data lake architectures, and real-time processing
  • Hands-on coding experience in Python
  • Hands-on expertise with design and development across one or more database management systems (e.g. SQL Server, PostgreSQL, Oracle)
  • Experience in designing and implementing data solutions with high resiliency, availability, and reliability
  • Demonstrated experience leading cross-functional teams of Data Engineers, Data Architects, and Product-type roles
  • Proven ability to translate business data requirements into complete, accurate, extensible, and flexible logical data models using data modeling tools
  • Testing and Troubleshooting : Ability to test, troubleshoot, and debug data processes as needed
  • Strong analytical skills with a proven ability to understand and document business data requirements in complete, accurate, extensible and flexible logical data models, data visualization tools (e.g. Apptio BI, PowerBI)
  • Strong written and verbal communications, presentation skills, leadership, problem-solving and organizational skills
  • Fluent in data risk, management, and compliance terminology and best practices
  • Proven track record for managing large, complex ecosystems with multiple stakeholders
  • Self-starter who is able to problem-solve effectively, organize and document processes, and prioritize feature with limited guidance
  • An enterprise mindset that connects the dots across various requirements and the broader operations / infrastructure data architecture landscape
  • Excellent influential and collaboration skills; ability to drive consensus and tangible outcomes, demonstrated by breaking down silos and fostering cross-team communication
  • Understanding of complex software delivery including build, test, deployment, and operations; conversant in AI, Data Science, and Business Intelligence concepts and technology stack
  • Experience working in technology business management, technology infrastructure or data visualization teams
  • Experience in infrastructure products a plus; this may include network, compute, storage, database, midrange, mainframe, observability, and both public & private cloud
  • Foundational Public Cloud (AWS, Google, Microsoft) certification; advanced Public Cloud certifications a plus
  • Experience with design and coding across multiple platforms and languages a plus
  • Bachelor’s Degree in computer science, computer science engineering, data engineering, or related field required; advanced degree preferred
  • We back you with benefits that support your holistic well-being so you can be and deliver your best. This means caring for you and your loved ones' physical, financial, and mental health, as well as providing the flexibility you need to thrive personally and professionally :

  • Competitive base salaries
  • Bonus incentives
  • Support for financial-well-being and retirement
  • Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
  • Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
  • Generous paid parental leave policies (depending on your location)
  • Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
  • Free and confidential counseling support through our Healthy Minds program
  • Career development and training opportunities
  • American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law. Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.

    Create a job alert for this search

    Api Engineer • chennai, India

    Related jobs
    • Promoted
    • New!
    Python Data Engineer

    Python Data Engineer

    Response InformaticsChennai, Tamil Nadu, India
    Response Informatics is looking for.Python Full Stack Developer – Chennai(WFO).Skills -Python,ReactJS,RESTful APIs,PostgreSQL or MySQL,Agile / Scrum,FastAPI, Flask, or Django,JSON,TypeScript and fami...Show moreLast updated: 5 hours ago
    • Promoted
    Staff Engineer

    Staff Engineer

    CodewallaChennai, Tamil Nadu, India
    Codewalla is a New York–based product studio with engineering teams in India.Since 2005, we’ve built innovative products that scale. We work at the intersection of design, engineering, and AI develo...Show moreLast updated: 6 days ago
    • Promoted
    Sr. Fullstack engineer

    Sr. Fullstack engineer

    Relevance LabChennai, IN
    Design, develop, and maintain our AI Agents platform using Python, FastAPI, React, and TypeScript.Collaborate with cross-functional teams, including product managers, designers, and backend enginee...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesChennai, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreeChennai, Tamil Nadu, India
    We are hiring for AWS Data Engineer.Notice period - immediate to 30 days.Seeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and impl...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Chennai, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 27 days ago
    • Promoted
    Backend Python / AI Engineer

    Backend Python / AI Engineer

    JuiceLabs AIChennai, IN
    Where creative engineering meets applied AI.At JuiceLabs, we’re building vertical AI-native tools that unlock fresh insights and creative superpowers for our clients in advertising, ecommerce, and ...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfoBeansChennai, Tamil Nadu, India
    Azure Data Factory (Azure Data Factory, Fabric Data Factory, SQL, Matillion, Python.Chennai, Bangalore, Hyderabad, Indore. Experienced Data Professional with strong SQL skills, focusing on data inte...Show moreLast updated: 28 days ago
    • Promoted
    • New!
    Python Principal Software Engineer

    Python Principal Software Engineer

    Thryve Digital Health LLPChennai, Tamil Nadu, India
    Python Principal Software Engineer.Ramanujan IT City, Tharamani, Chennai & MindSpace Hi-Tech City, Madhapur, Hyderabad.PM to 12AM IST (Both the way cab will be provided). Strong experience in Soluti...Show moreLast updated: 5 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyChennai, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 19 days ago
    • Promoted
    • New!
    AI Full Stack Engineer

    AI Full Stack Engineer

    RecroChennai, Tamil Nadu, India
    We are looking for a highly skilled.Python and a passion for building scalable AI-powered solutions.This role offers the opportunity to work on cutting-edge products in the.Build and maintain scala...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Python

    Senior Software Engineer - Python

    techjaysChennai, Tamil Nadu, India
    What makes Techjays an inspiring place to work.At Techjays, we are driving the future of artificial intelligence with a bold mission to empower businesses worldwide by helping them build AI solutio...Show moreLast updated: 5 hours ago
    • Promoted
    Uniphore - Senior Staff Software Engineer - Python Technologies

    Uniphore - Senior Staff Software Engineer - Python Technologies

    Uniphore Software SystemsChennai
    Responsibilities : - Develop creative solutions and write technical designs based on the requirements.Work closely with peer teams to ensur...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    ImpetusChennai, Tamil Nadu, India
    Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark;.Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity. Collaborates with analytics and business...Show moreLast updated: 25 days ago
    • Promoted
    GCP & GKE Staff Engineer

    GCP & GKE Staff Engineer

    RapidBrainsChennai, IN
    We are looking for a highly skilled Staff Cloud Architect – GCP & GKE with expertise in designing, implementing, and managing large-scale cloud infrastructure solutions. The ideal candidate will be ...Show moreLast updated: 2 days ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USAChennai, IN
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    Data Engineer – Airflow | Python | Databricks

    Data Engineer – Airflow | Python | Databricks

    InternationalClientsChennai, Tamil Nadu, India
    Chennai, India (Onsite initially, Remote flexibility later).Leading Life Sciences Company – Specialized in the Pharmaceutical Industry. You will be responsible for building and managing reliable dat...Show moreLast updated: 5 hours ago
    • Promoted
    Dun & Bradstreet - Senior Generative AI Engineer - Python

    Dun & Bradstreet - Senior Generative AI Engineer - Python

    DUN BRADSTREET TECHNOLOGY AND CORPORATE SERVICESChennai
    Dun & Bradstreet Technology and Corporate Services India LLP is looking for candidates for the role of Senior Analyst to support the Data Science team. The candidate needs to work clos...Show moreLast updated: 19 days ago
    • Promoted
    AWS Data engineer ( Only Chennai / Hyderabad and kolkata Location)- 6-8 Years

    AWS Data engineer ( Only Chennai / Hyderabad and kolkata Location)- 6-8 Years

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Greetings from TATA Consultancy Services.Pls find the Job Description below.Hands-on experience in Pyspark, Glue.Experience on EMR, S3, IAM, Lambda, Cloud formation, Python.AMI Rehydration, Python,...Show moreLast updated: 2 days ago
    • Promoted
    AWS Data Engineer(Chennai, Indore,Pune)

    AWS Data Engineer(Chennai, Indore,Pune)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Good knowledge and experience in Pyspark for forming complex Transformation logic.Secondary : AWS Glue , Airflow.A minimum of 3 + years' experience and understanding of Python core concepts, and im...Show moreLast updated: 30+ days ago