Platform Automation EngineerConfidential • Chennai, India
Platform Automation Engineer
Confidential • Chennai, India
10 days ago
Job descriptionDesign, build, and maintain data pipelines to ingest, transform, and load data from a variety of sources, including but not limited to Hadoop, SQL, DB2, APIs, and TP systems. Implement data validation and quality checks within the pipelines to ensure the integrity and accuracy of the data. Monitor and optimize the performance of data pipelines to handle large volumes of data in a timely and efficient manner. Design and implement efficient database schemas in PostgreSQL to support the storage and retrieval of complex data structures related to AI and machine learning projects. Write and optimize complex SQL queries (DQL - Data Query Language) for data extraction, analysis, and reporting purposes. Perform database tuning and optimization activities, such as index optimization, query plan analysis, and configuration adjustments, to enhance the overall performance of the PostgreSQL database. Administer and optimize the Elasticsearch cluster. Design and define data mappings and indices to enable efficient full-text search and analytics capabilities. Monitor cluster health, performance metrics, and resource utilization, and take proactive measures to scale and optimize the Elasticsearch infrastructure as needed. Work with different types of data sources, such as Hadoop, PostgreSQL, and other relational and non-relational databases, to integrate and consolidate data into a unified data ecosystem. Develop connectors and adapters to enable seamless data transfer between various data sources and our platform. Stay updated with the latest technologies and best practices related to data integration and data source management. Collaborate closely with data scientists, model developers, and other stakeholders to understand their data requirements and provide them with the necessary data support. Participate in cross-functional team meetings and discussions to contribute to the overall success of projects. Document data engineering processes, data dictionaries, and technical specifications for future reference and knowledge sharing. Able to understand and work as per the Domain and Bank's wider strateg Preferred Experience with LLM use cases Good understanding and able to apply processes laid down within the team, and / or standards as defined by project and SCB. Provide technical expertise in Automation, Infra Methodologies, Admin Processes, Development best practises, Tools and Techniques across the teams. Be an escalation point for all matters related to Infrastructural changes. Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters. Comply with the software management practices and policies. Display exemplary conduct and live by the Group's Values and Code of Conduct. Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct. Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters Business users / Model engineers / Data scientists / Platform engineers / Platform support Good to have certifications in Python and Cloud technologies Hadoop PostgreSQL Elasticsearch Python API Development Docker and Kubernetes Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well Are better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations. Time-off including annual leave, parental / maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum. Flexible working options based around home and office locations, with flexible working patterns. Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning. Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.
Key Responsibilities
Technical Skills
- Minimum 5-7 experience in data engineering with hands on experience working with AIML projects.
- Proficiency in Hadoop (HDFS, MapReduce, Spark, etc.) for large-scale data processing.
- Strong hands-on experience with PostgreSQL database and Elasticsearch management, including database design, query optimization, and performance tuning.
- Proficiency in programming languages such as Python for data processing, automation tasks, data pipeline operations and system administration tasks related to data infrastructure.
- Strong analytical skills to understand and translate business requirements into effective data engineering solutions.
- Knowledge of API development, microservices architecture, containerization, and orchestration (Docker & Kubernetes)
Data Pipeline Development and Management
PostgreSQL and Elasticsearch Expertise
Data Source Integration
Collaboration and Communication
Strategy
Business
Processes
Risk Management
Governance
Regulatory & Business Conduct
Key stakeholders
Skills And Experience
About Standard Chartered
We're an international bank, nimble enough to act, big enough for impact. For more than 170 years, we've worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge and enjoy finding new opportunities to grow and do better than before. If you're looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents and we can't wait to see the talents you can bring us.
Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion.
Together We
What We Offer
In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.
Skills Required
Hadoop, Docker, Elasticsearch, Postgresql, Spark, Kubernetes, Python, Api Development
Create a job alert for this search
Automation Engineer • Chennai, India
Related jobs
Platform Automation Manager - Cypress
Bread Financial • Chennai, IN
Platform Automation Engineering Manager will be responsible for leading test automation frameworks, tooling, and test data management to optimize enterprise processes through innovative quality eng...Show more
Last updated: 5 days ago • Promoted
Catia Automation Engineer
Akkodis • Chennai, Tamil Nadu, India
Catia Customization with EKL scripting.To develop the script to check the standard rules for Architecture and design team to reduce lead time for business delivery with EKL / CATScript / VBA technologi...Show more
Last updated: 17 days ago • Promoted
AI Platform Engineer
BayOne Solutions • Chennai, IN
We are seeking a highly skilled.In this role, you will work on advanced AI systems including.Retrieval-Augmented Generation (RAG).
Model Context Protocol (MCP) tools.OpenWebUI or custom-built soluti...Show more
Last updated: 11 days ago • Promoted
Automation Engineer
ACL Digital • Chennai, IN
Hiring for Cypress Automation Engineer : : Bangalore : : Immediate - 15 Days.The ideal candidate should be proficient in both.
Design, develop, and maintain automated test scripts using.Implement and ex...Show more
Last updated: 13 days ago • Promoted
UFT Automation Engineer
Publicis Sapient • Chennai, IN
We’re Hiring – UFT Automation Engineer | 4–6 Years | Gurugram / Bangalore (Hybrid).Are you passionate about building scalable.
UFT, VBScript, and Desktop UI Automation.Join our dynamic team and work...Show more
Last updated: 18 days ago • Promoted
Lead Automation Engineer
BUSINESS INTEGRITY SERVICES PRIVATE LIMITED • Chennai
Description : - Lead end-to-end automation projects using UiPath tools and frameworks.Conduct Business Analysis to identify automation opportunities and defin...Show more
Last updated: 25 days ago • Promoted
Automation Engineer
UST • Chennai, IN
Worksoft Certify Automation Engineer.SAP, Web, Salesforce, APIs, and MS Office applications.The ideal candidate will have hands-on experience in building automation scripts, integrating automation ...Show more
Last updated: 6 hours ago • Promoted • New!
Automation Engineer
People Tech Group Inc • Chennai, IN
We are Hiring '' Automation Tester'' Role for ''People Tech Technology" Company.Notice Period : Immediate or 15 Days.Mandatory Skills : Automation, Robotic frame work , Selenium, TestNG, Maven, and R...Show more
Last updated: 4 hours ago • Promoted • New!
Automation Lead
Movate • Chennai, Tamil Nadu, India
The incumbent must have knowledge in software testing methodologies, automation best practices, and software development life cycle (SDLC).
The incumbent will lead, design and write automated script...Show more
Last updated: 13 days ago • Promoted
AI Platform Engineer
Antriksh Cloud Private Limited • Chennai, IN
Antriksh Cloud Private Limited is a leader in sustainable AI infrastructure, specializing in eco-efficient GPU data centers powered by hydroelectric energy.
We enable global AI innovation with scala...Show more
Last updated: 2 days ago • Promoted
Senior Automation Engineer
Alp Consulting Ltd. • Chennai, Tamil Nadu, India
Job Title : Automation Test Engineer (Selenium + Java).We are seeking a highly skilled.The ideal candidate will design, develop, and maintain robust automation frameworks while ensuring high-quality...Show more
Last updated: 2 days ago • Promoted
QA Automation Engineer
Numeric Technologies • Chennai, IN
We are seeking a Senior QA Engineer with strong expertise in Cypress / Playwright, and JavaScript / Typescript to ensure the quality and reliability of our web & Cloud based applications.This role invo...Show more
Last updated: 6 hours ago • Promoted • New!
Automation Architect
LTIMindtree • Chennai, Tamil Nadu, India
LTIMindtree is seeking a Test Automation Architect role in Chennai.Enterprise Strategy, Supporting Sales, Customer presentations,.
Consulting, Enterprise Assessments , Solutioning, Customer Escalati...Show more
Last updated: 30+ days ago • Promoted
Senior SolarWinds Automation Engineer
The AES Group • chennai, tamil nadu, in
Role – Network Tools Engineer L4.Location – Preferably Chennai – Remote Options Available.Mandate Skill : PowerShell Development – Any Monitoring tools Experience – Like Solarwinds OR logic Monitor...Show more
Last updated: 2 days ago • Promoted
Platform Automation Engineer
Standard Chartered Bank • Chennai, Tamil Nadu, India
This job is with Standard Chartered Bank, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.
Please do not contact the recruiter directly....Show more
Last updated: 13 days ago • Promoted
Senior Automation Engineer
QX Global Group • Chennai, IN
Senior QA engineers must have at least 6 years of experience and at least 3 years of experience in automation testing, including setting up the automation testing framework, creating new test scrip...Show more
Last updated: 1 day ago • Promoted
Platform AI Engineer
Supervity • Chennai, IN
Supervity is the trusted AI transformation technology partner for over 30 global enterprises and governments.The company is the creator and leader of the “AI Agents-as-a-Service” software category....Show more
Last updated: 6 hours ago • Promoted • New!
Senior AI & Automation Engineer
engineersmind • Chennai, IN
Role : Senior AI & Automation Engineer.Quality Engineering & Product Assurance.API layers, ensuring seamless integration, performance, and security.
This is a hands-on role that requires strong techn...Show more
Last updated: 7 days ago • Promoted