Job Description :
Role Overview :
We are seeking a lead Data Engineer to lead the on-site deployment and implementation of Data Catalog for an enterprise client.
This is a customer-facing role that requires a blend of deep data engineering expertise and the maturity to manage client conversations independently.
The successful candidate will own the technical delivery on the ground, working directly with the client's stakeholders to ensure a smooth and successful deployment.
Key Responsibilities :
- Lead the end-to-end on-site deployment, configuration, and implementation Data Catalog.
- Serve as the primary technical point of contact for the client, managing day-to-day conversations and translating business requirements into technical solutions.
- Architect and validate data engineering solutions on big data platforms, ensuring scalability, performance, and alignment with client needs.
- Integrate Data Catalog with existing data sources, pipelines, and the broader data ecosystem, including metadata and lineage tooling.
- Provide technical guidance, troubleshooting, and best-practice recommendations throughout the engagement.
- Document the deployment, configurations, and hand-over materials for the client team.
Required Skills and Experience :
- Must have 8+ years of experience in data engineering.
- Must have extensive hands-on expertise with Hadoop and PySpark.
- Must have Strong experience with the Cloudera platform and the broader Hadoop ecosystem.
- Working knowledge of Apache Atlas for metadata management, data lineage, and governance.
- Proven track record of designing and deploying large-scale data engineering solutions.
- Demonstrated ability to handle customer-facing conversations and manage stakeholders independently.
- Excellent communication and problem-solving skills.
Preferred / Nice to Have :
- Prior experience delivering on-site or consulting engagements.
- Broader familiarity with the Talend suite and data governance / metadata management practices.
- Relevant certifications in Cloudera, or cloud data platforms.
Lead Data Engineer • Mumbai
Full-time, Remote/Hybrid (2/3 split).Proficient in English with strong communication and documentation skills.Expertise in SQL, data engineering, data warehousing, data integration, and data modeli... Show more
Headquartered in San Francisco, our investors include.Data Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, scalability issues, and fai... Show more
Collinson is the global, privately-owned company dedicated to helping the world to travel with ease and confidence.We use our expertise and products to craft customer experiences which enable some ... Show more
Contract (6 Months, extendable based on performance and project needs).Bangalore (Hyderabad, Pune, Mumbai).We are looking for a SAS ETL Expert with strong SQL expertise.The role involves building s... Show more
Design, develop, and maintain low-code enabled data pipelines for collecting, transforming, and loading data into various data stores and build insightful reports.Build and maintain data wareho... Show more
The DataOps Engineer will play a critical role in ensuring the reliability, security and operational excellence of Collinson's modern data platform.As a key member of the Data & Analytics team, you... Show more
At Parable Associates, we specialize in transforming complex data into clear, actionable insights for our clients across various industries.We’re not just another business intelligence company; we’... Show more
Collinson is a global loyalty and benefits company.We use our expertise and products to craft customer experiences which enable some of the world’s.While specialising in Financial Services, Travel ... Show more
