Data Pipeline ArchitectRandstad Enterprise • Republic Of India, IN
Data Pipeline Architect
Randstad Enterprise • Republic Of India, IN
30+ days ago
Job descriptionServe as subject matter expert and define data architecture and infrastructure requirements Partner with business analysts to plan project execution including appropriate product and technical specifications, direction, resources, and establishing realistic completion times Understand data technology trends and identify opportunities to implement new technologies and provide forward-thinking recommendations Proactively partner with internal stakeholders to bridge gaps, provide historical references, and design the appropriate processes Design and implement a robust data observability process Resolve escalated reporting requests and communicate proactively and timely Troubleshoot, and provide technical guidance to resolve issues related to misaligned or inaccurate data or data fields or new customer requirements Maintain new release, migration, and sprint schedules for software upgrades, enhancements, and fixes to aid with product evolution Write QA / QC Scripts to conduct first round of testing and partner with BA team for test validation for new developments prior to moving to production Use industry knowledge & feedback to aid in the development of technology roadmap and future product(s) vision Document standard ways of working via QRGs, intranet pages, and video series Drive day-to-day development activities of development team in close collaboration with on-site and off-shore resources, scrum masters and product owners Bootstrapping a data engineering team at an early stage in the team’s evolution Provide leadership on technical front in difficult situations facilitate contentious discussions, and report up when necessary Guide, mentor and coach offshore resources Provide input in forming a long-term data strategy Master’s degree in Computer Science / Information Technology or related field, highly preferred Extensive knowledge of BI concepts and related technologies that help drive sustainable technical solutions Extensive Experience with data lakes, ETL and data warehouses Advanced experience of building data pipelines Passion for building quality BI software Project Management and / or process improvement experience highly preferred Polyglot coder and expert level in multiple languages including, Python, R, Java, SQL, relational databases, ERP, DOMO or other data visualization tools i.E. Tableau Advanced and proven experience with Google cloud platform (GCP) is preferred. But experience with Microsoft Azure / Amazon will be considered. Any exposure to Kafka, Spark, and Scala will be an added advantage. Should demonstrate a strong understanding of OOPS concepts and methodologies Expert level understanding of data engineering Intrinsic motivation and problem-solving Proactive leadership, project management, time management, and problem-solving skills Demonstrated continuous improvement, process documentation, and workflow skills Extensive experience with data analysis, modeling, and data pipelining including data cleaning, standardizing, scaling, tuning, scheduling and deployment Experience composing detailed technical documentation and procedures for data models Ability to prioritize and manage multiple projects, tasks, and meeting deadlines while maintaining quality Strong drive and commitment for delivering outstanding results Strong follow up and service orientation
Role : Data Engineer
Location : Remote
Shift Timing : 2 : 00 Pm - 11 : 00 Pm
Experience : 2- 4 years relevant Experience only ( this is a Junior position with us )
Must have skillset :
GCP - 2 years minimum working Experience
Python and Pyspark - 2 years
SQL - 2 years
Excellent communication
Worked with global stakeholders
Who we are :
Randstad Sourceright’s global talent solutions provides instant access to experienced recruitment
and contingent workforce management support by combining technology, analytics and deep
global and local expertise. Our operations consist of the client aligned service delivery teams
operating across RPO, MSP and Blended Workforce Solutions. We are certified as a “great place to
work” for the last 3 consecutive years and are recognized as the best place to work by Glassdoor
Group Objective
The mission of the business intelligence team is to create a data-driven culture that empowers leaders to integrate data into daily decisions and strategic planning. We aim to provide visibility, transparency, and guidance regarding the quantity and quality of results, activities, financial KPIs, and leading indicators to identify trends aimed at data-based decision-making easily.
Position Objective
As a Senior Data Engineer, you will be responsible for designing, architecting, and implementing robust data solutions in a cloud-based environment (GCP). You will partner with other data engineers and technical teams to ensure the availability, reliability, and performance of our data systems.
Position Summary
Programming & Code Writing
- Architect and build complex data pipelines using advanced cloud data technologies
- Lead efforts to optimize data pipelines for performance, scalability, and cost-efficiency
- Define industry best practices for building data pipelines
- Ensure data security, compliance, and governance standards are met.
- Partner with leadership team to define and implement agile and DevOps methodologies
Consulting & Partnership
Troubleshooting & Continuous Improvement
Senior activities
Education
Experience
Knowledge, Skills, and Abilities
Supervisory Responsibility
☒ Provides guidance, leadership, or training to junior employees
☐ Directly responsible for supervising non-exempt, clerical, or office administrative personnel
☐ Directly responsible for supervising exempt, professional, or technical employees
☒ Directly responsible for supervising supervisory / managerial employees
Organizational Structure :
Job Title this position reports : Manager, Data Engineering
Create a job alert for this search
Data Pipeline Architect • Republic Of India, IN
Related jobs
Data Pipeline Architect
MyData Insights Pvt Ltd • Republic Of India, IN
The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
Last updated: 4 days ago • Promoted
Data Pipeline Architect
Tredence Inc. • Republic Of India, IN
IT experience and 7+ years' experience in SQL Server, SSIS, SQL, Python / C#, ETL, Streaming.Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL p...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Architect
IntraEdge • Republic Of India, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
GCP Data Pipeline Architect
EXL • Pune, Republic Of India, IN
The ideal candidate will have a solid background in big data technologies, data warehousing, and cloud-based data architecture, with hands-on experience using GCP-native tools.Dataflow, Dataproc, P...Show more
Last updated: 15 days ago • Promoted
Lead Data Pipeline Architect
CYGNVS • Chennai, Republic Of India, IN
Our company culture is a perfect blend of productivity and enjoyment, prioritizing the growth and development of our talented employees as part of a high-achieving team.
We are in search of exceptio...Show more
Last updated: 22 days ago • Promoted
Lead Data Pipeline Architect
Lear Corporation • Pune, Republic Of India, IN
Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
Last updated: 19 days ago • Promoted
Data Pipeline Architect
Solytics Partners • Pune, Republic Of India, IN
Solytics Partners is a Global Analytics firm, recognized with multiple industry awards for innovation and excellence.Our team comprises experts with deep knowledge in risk, analytics, AI / ML, AML / FC...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Architect
Kanerika Inc • Indore, Republic Of India, IN
Hyderabad, Indore and Ahmedabad (India).Develop and maintain data pipelines using Azure Data Factory (ADF) / Databricks for data integration and ETL processes.
Design, implement, and optimize Power B...Show more
Last updated: 22 days ago • Promoted
Data Pipeline Architect
JIT Global Infosystems Pvt. Ltd. • Chennai, Republic Of India, IN
Applications, Analytics, and Consulting services to clients worldwide.By combining technological expertise with deep domain knowledge, we ensure tangible improvements in business performance.Our ex...Show more
Last updated: 4 days ago • Promoted
Data Pipeline Architect
NielsenIQ • Chennai, Republic Of India, IN
Design, build, and optimize large-scale ETL and data-processing pipelines handling GB–TB volumes.Operate within the Databricks ecosystem and drive migration of selected workloads to high-performanc...Show more
Last updated: 10 days ago • Promoted
Data Pipeline Architect
HCLTech • Chennai, Republic Of India, IN
Senior Data Engineer – Vendor Experience : 6–12 Years.We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernete...Show more
Last updated: 10 days ago • Promoted
Data Pipeline Architect
EXL • Pune, Republic Of India, IN
Location - Pune, Bangalore, Noida, Gurgaon, Hyderabad.The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driv...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Architect
Digitalzone • Republic Of India, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 22 days ago • Promoted
Data Pipeline Architect
Mastek • Chennai, Republic Of India, IN
Work closely with our data science team to help build complex algorithms that provide unique insights into our data.Use agile software development processes to make iterative improvements to our ba...Show more
Last updated: 4 days ago • Promoted
Senior Data Pipeline Architect
Ascendion • Chennai, Republic Of India, IN
Job Description : Senior DBT Engineer (8–12 Years).Senior Data Engineer with strong ELT experience.Focus on building scalable, efficient, and well-governed DBT data models on modern cloud platforms.Show more
Last updated: 1 day ago • Promoted
Data Pipeline Architect
Blend • Chennai, Republic Of India, IN
We are looking for an experienced.In this role, you will build and maintain scalable data pipelines and architecture to support analytics, data science, and business intelligence initiatives.You’ll...Show more
Last updated: 1 day ago • Promoted
Lead Data Pipeline Architect
LanceSoft, Inc. • Republic Of India, IN
US working hours (Night Shift form india).This team is looking to hire a motivated Sr.Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-...Show more
Last updated: 3 days ago • Promoted
Lead Azure Data Pipeline Architect
All European Careers • Republic Of India, IN
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
Last updated: 7 days ago • Promoted