Platform Automation EngineerConfidential • Chennai, India
Platform Automation Engineer
Confidential • Chennai, India
13 days ago
Job descriptionDesign, build, and maintain data pipelines to ingest, transform, and load data from a variety of sources, including but not limited to Hadoop, SQL, DB2, APIs, and TP systems. Implement data validation and quality checks within the pipelines to ensure the integrity and accuracy of the data. Monitor and optimize the performance of data pipelines to handle large volumes of data in a timely and efficient manner. Design and implement efficient database schemas in PostgreSQL to support the storage and retrieval of complex data structures related to AI and machine learning projects. Write and optimize complex SQL queries (DQL - Data Query Language) for data extraction, analysis, and reporting purposes. Perform database tuning and optimization activities, such as index optimization, query plan analysis, and configuration adjustments, to enhance the overall performance of the PostgreSQL database. Administer and optimize the Elasticsearch cluster. Design and define data mappings and indices to enable efficient full-text search and analytics capabilities. Monitor cluster health, performance metrics, and resource utilization, and take proactive measures to scale and optimize the Elasticsearch infrastructure as needed. Work with different types of data sources, such as Hadoop, PostgreSQL, and other relational and non-relational databases, to integrate and consolidate data into a unified data ecosystem. Develop connectors and adapters to enable seamless data transfer between various data sources and our platform. Stay updated with the latest technologies and best practices related to data integration and data source management. Collaborate closely with data scientists, model developers, and other stakeholders to understand their data requirements and provide them with the necessary data support. Participate in cross-functional team meetings and discussions to contribute to the overall success of projects. Document data engineering processes, data dictionaries, and technical specifications for future reference and knowledge sharing. Able to understand and work as per the Domain and Bank's wider strateg Preferred Experience with LLM use cases Good understanding and able to apply processes laid down within the team, and / or standards as defined by project and SCB. Provide technical expertise in Automation, Infra Methodologies, Admin Processes, Development best practises, Tools and Techniques across the teams. Be an escalation point for all matters related to Infrastructural changes. Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters. Comply with the software management practices and policies. Display exemplary conduct and live by the Group's Values and Code of Conduct. Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct. Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters Business users / Model engineers / Data scientists / Platform engineers / Platform support Good to have certifications in Python and Cloud technologies Hadoop PostgreSQL Elasticsearch Python API Development Docker and Kubernetes Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well Are better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations. Time-off including annual leave, parental / maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum. Flexible working options based around home and office locations, with flexible working patterns. Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning. Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.
Key Responsibilities
Technical Skills
- Minimum 5-7 experience in data engineering with hands on experience working with AIML projects.
- Proficiency in Hadoop (HDFS, MapReduce, Spark, etc.) for large-scale data processing.
- Strong hands-on experience with PostgreSQL database and Elasticsearch management, including database design, query optimization, and performance tuning.
- Proficiency in programming languages such as Python for data processing, automation tasks, data pipeline operations and system administration tasks related to data infrastructure.
- Strong analytical skills to understand and translate business requirements into effective data engineering solutions.
- Knowledge of API development, microservices architecture, containerization, and orchestration (Docker & Kubernetes)
Data Pipeline Development and Management
PostgreSQL and Elasticsearch Expertise
Data Source Integration
Collaboration and Communication
Strategy
Business
Processes
Risk Management
Governance
Regulatory & Business Conduct
Key stakeholders
Skills And Experience
About Standard Chartered
We're an international bank, nimble enough to act, big enough for impact. For more than 170 years, we've worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge and enjoy finding new opportunities to grow and do better than before. If you're looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents and we can't wait to see the talents you can bring us.
Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion.
Together We
What We Offer
In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.
Skills Required
Hadoop, Docker, Elasticsearch, Postgresql, Spark, Kubernetes, Python, Api Development
Create a job alert for this search
Automation Engineer • Chennai, India
Related jobs
Project Engineer (Servo) - Automation Solutions
BASE Automation • Greater Chennai Area, India
Troubleshoot, commission, and support servo drive systems—predominantly Rockwell Automation (Kinetix series preferred), but exposure to other platforms (Siemens, Omron, Mitsubishi) is a plus.Lead o...Show more
Last updated: 5 days ago • Promoted
Platform Engineer
Yum! India Global Services Private Limited • chennai, India
We’re looking for a Platform Engineer to lead the design and development of internal self-service workflows and automation for our internal developer platform.
Build reusable workflows using Go, emp...Show more
Last updated: 5 days ago • Promoted
QA Automation Engineer
Xped pvt Ltd • Chennai
Key Responsibilities : - Primary responsibilities include working with Dev / PM / Test to design and implement test and validation strategies througho...Show more
Last updated: 30+ days ago • Promoted
Platform Automation Manager - Cypress
Bread Financial • Chennai, IN
Platform Automation Engineering Manager will be responsible for leading test automation frameworks, tooling, and test data management to optimize enterprise processes through innovative quality eng...Show more
Last updated: 8 days ago • Promoted
Catia Automation Engineer
Akkodis • Chennai, Tamil Nadu, India
Catia Customization with EKL scripting.To develop the script to check the standard rules for Architecture and design team to reduce lead time for business delivery with EKL / CATScript / VBA technologi...Show more
Last updated: 21 days ago • Promoted
AI Platform Engineer
BayOne Solutions • Chennai, IN
We are seeking a highly skilled.In this role, you will work on advanced AI systems including.Retrieval-Augmented Generation (RAG).
Model Context Protocol (MCP) tools.OpenWebUI or custom-built soluti...Show more
Last updated: 14 days ago • Promoted
Automation
Deloitte • Chennai, Tamil Nadu, India
Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance.
As the undisputed leader in professional services, Del...Show more
Last updated: 7 hours ago • Promoted • New!
Senior Automation Engineer
QX Global Group • chennai, India
Senior QA engineers must have at least 6 years of experience and at least 3 years of experience in automation testing, including setting up the automation testing framework, creating new test scrip...Show more
Last updated: 3 days ago • Promoted
UFT Automation Engineer
Publicis Sapient • Chennai, IN
We’re Hiring – UFT Automation Engineer | 4–6 Years | Gurugram / Bangalore (Hybrid).Are you passionate about building scalable.
UFT, VBScript, and Desktop UI Automation.Join our dynamic team and work...Show more
Last updated: 21 days ago • Promoted
Lead Automation Engineer
BUSINESS INTEGRITY SERVICES PRIVATE LIMITED • Chennai
Description : - Lead end-to-end automation projects using UiPath tools and frameworks.Conduct Business Analysis to identify automation opportunities and defin...Show more
Last updated: 28 days ago • Promoted
Logitech - Firmware Automation Engineer - Embedded System
Logitech • Chennai
Description : Logitech is the Sweet Spot for people who want their actions to have a positive global impact while having the flexibility to do it in their own way.Th...Show more
Last updated: 15 days ago • Promoted
Automation Lead
Movate • Chennai, Tamil Nadu, India
The incumbent must have knowledge in software testing methodologies, automation best practices, and software development life cycle (SDLC).
The incumbent will lead, design and write automated script...Show more
Last updated: 17 days ago • Promoted
AI Platform Engineer
Antriksh Cloud Private Limited • Chennai, IN
Antriksh Cloud Private Limited is a leader in sustainable AI infrastructure, specializing in eco-efficient GPU data centers powered by hydroelectric energy.
We enable global AI innovation with scala...Show more
Last updated: 5 days ago • Promoted
Senior Automation Engineer
Alp Consulting Ltd. • Chennai, Tamil Nadu, India
Job Title : Automation Test Engineer (Selenium + Java).We are seeking a highly skilled.The ideal candidate will design, develop, and maintain robust automation frameworks while ensuring high-quality...Show more
Last updated: 5 days ago • Promoted
Lead – Projects (Industrial Automation)
BASE Automation • Greater Chennai Area, India
Monitor task progress, delivery timelines, site readiness, and engineering completion.Coordinate across engineering, design, procurement, production, and service teams for smooth execution.Validate...Show more
Last updated: 1 day ago • Promoted
Automation Engineer
Confidential • Chennai, India
Banyan Software provides the best permanent home for successful enterprise software companies, their employees, and customers.
We are on a mission to acquire, build and grow great enterprise softwar...Show more
Last updated: 27 days ago • Promoted
Senior AI & Automation Engineer
engineersmind • Chennai, IN
Role : Senior AI & Automation Engineer.Quality Engineering & Product Assurance.API layers, ensuring seamless integration, performance, and security.
This is a hands-on role that requires strong techn...Show more
Last updated: 10 days ago • Promoted
Automation Architect
LTIMindtree • Chennai, Tamil Nadu, India
LTIMindtree is seeking a Test Automation Architect role in Chennai.Enterprise Strategy, Supporting Sales, Customer presentations,.
Consulting, Enterprise Assessments , Solutioning, Customer Escalati...Show more
Last updated: 5 days ago • Promoted