Senior Lead Software Engineer

ConfidentialIndia

10 days ago

Job description

We are seeking a highly skilled Senior Lead Data Engineer to join our R&D Data Engineering Team. In this role, you will be a key player in shaping the architecture and technical direction of our data platform, ensuring that it meets the evolving needs of the business while adhering to best practices and industry standards. If you're looking for an opportunity to combine your technical skills with strategic thinking and make a real difference, we want to hear from you.

About You – Experience, Education, Skills, And Accomplishments

Bachelor's Degree or equivalent
At least 7 years of Relevant Experience
At least 5+ Years in Software Development : Demonstrated experience in software development, with a focus on Big Data technologies.
At least 3+ Years in Distributed Data Processing : Proven experience in building scalable distributed data processing solutions.
At least 3+ Years in Database Design : Expertise in database design and development, with a strong focus on data model design.
Strong Proficiency with Apache Spark and Airflow : Extensive hands-on experience with these technologies, leveraging them for data processing and orchestration.
Python Proficiency : Advanced proficiency in Python for data processing and building services.
Experience with Databricks and Snowflake : Practical experience with these platforms, including their use in cloud-based data pipelines.
Familiarity with Delta Lake or Apache Iceberg : Experience working with these data storage to decouple storage from processing engines.
Cloud-Based Solutions Expertise : Proven experience in designing and implementing cloud-based data pipelines, with specific expertise in AWS services such as S3, RDS, EMR, and AWS Glue.
CI / CD Best Practices : Strong understanding and application of CI / CD principles

It Would Be Great If You Also Had

Knowledge of Additional Technologies : Familiarity with Cassandra, Hadoop, Apache Hive, Jupyter notebooks, BI tools : Tableau and Power BI.

Experience with PL / SQL and Oracle GoldenGate : Additional experience in these areas is advantageous

Knowledge on any of these technologies / tools : Cassandra, Hadoop, Apache Hive, Snowflake, Jupiter notebook, Databricks stack,

AWS services, EC2, ECS, RDS, EMR, S3, AWS Glue, Airflow

What will you be doing in this role

Provide Technical Leadership : Offer strategic guidance on technology choices, comparing different solutions to meet business requirements while considering cost control and performance optimization.

Communicate Effectively : Exhibit excellent communication skills, with the ability to clearly articulate complex technical concepts to both technical and non-technical stakeholders.

Design and Maintain Data Solutions : Develop and maintain the overall solution architecture for the Data Platform, demonstrating deep expertise in integration architecture and design across multiple platforms at an enterprise scale.

Enforce Best Practices : Implement and enforce best practices in Big Data management, from software selection to architecture design and implementation processes.

Drive Continuous Improvement : Contribute to the continuous enhancement of support and delivery functions by staying informed about technology trends and making recommendations for improving application services.

Lead Technical Investigations : Conduct technical investigations and proofs of concept, both individually and as part of a team, including hands-on coding to provide technical recommendations.

Knowledge Sharing : Actively spread knowledge and best practices within the team, fostering a culture of continuous learning and improvement

About The Team

We are team located in India, US, and Europe.

Hours of Work

Regular working timing in India.

At Clarivate, we are committed to providing equal employment opportunities for all qualified persons with respect to hiring, compensation, promotion, training, and other terms, conditions, and privileges of employment. We comply with applicable laws and regulations governing non-discrimination in all locations.

Skills Required

Airflow, snowflake , AWS Glue, Apache Spark, Databricks, Python

Create a job alert for this search

Lead Software Engineer • India

Related jobs

Promoted

Senior Backend Software Engineer

Truxt.aiNagpur, IN

As an early-stage company driven by a meaningful mission, we seek exceptional engineering talent who values purpose, long-term impact, and significant equity ownership over traditional salary compe...Show moreLast updated: 6 days ago

Promoted

Senior Backend Engineer

Blossom SocialNagpur, IN

Blossom Social is building the future of social investing.Our platform empowers retail investors by combining the best of social networks with investing tools—enabling users to connect, learn, and ...Show moreLast updated: 17 days ago

Promoted

Lead Engineer

HyqooNagpur, IN

Design, deploy, and manage AWS cloud infrastructure, including EC2 instances, S3 buckets, VPCs, RDS databases, and Lambda functions. Assist in the design, implementation, and maintenance of backup, ...Show moreLast updated: 1 day ago

Promoted
New!

Senior Software Engineer

Qube Cinemanagpur, maharashtra, in

At Qube Cinema, technology and innovation are at our core.Our purpose is to bring to life every story to engage, entertain and enlighten the world. As a company with a passion for cinema, we are com...Show moreLast updated: 13 hours ago

Promoted

Senior Software Engineer

ArrowNagpur, IN

Arrow is focused on revolutionizing healthcare payments by bringing speed, accuracy, and transparency to the process.Our mission is to simplify healthcare payments for patients, providers, and heal...Show moreLast updated: 30+ days ago

Promoted

Senior Software Engineer

BrightEdgeNagpur, IN

Senior Software Engineer, Remote.The Software Engineer will be a critical individual contributor responsible for designing collection strategies, developing, and maintaining robust and scalable dat...Show moreLast updated: 30+ days ago

Promoted

Senior Software Engineer

Integrated Wireless SolutionsNagpur, IN

Skills - Java + React + Docker + Kubernetes + RDBMS + NOSQL + Cloud (Azure / AWS).We are seeking a highly skilled and experienced Tech Lead (Full-Stack) to join our dynamic and innovative team.As a T...Show moreLast updated: 30+ days ago

Promoted

Senior Software Engineer

IGT SolutionsNagpur, IN

We are hiring for Night Shifts in IGT Solutions : .The Java Full Stack Developer is responsible for designing, developing, and maintaining both front-end and back-end components of enterprise applica...Show moreLast updated: 26 days ago

Promoted

Senior Software Engineer

Peoplefynagpur, maharashtra, in

Job Description : Senior Software Engineer.Design, develop, and maintain scalable.JavaScript, Material-UI, Bootstrap, HTML, CSS. Collaborate with cross-functional teams for development, QA, DevOps, a...Show moreLast updated: 17 days ago

Promoted

Senior Staff Software Engineer - Platform

CoinbaseNagpur, IN

Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 30+ days ago

Promoted

Lead Software Engineer

Scrapingdognagpur, maharashtra, in

At Scrapingdog, we make web scraping easy for everyone.Our suite of APIs handles millions of proxies, browsers, and CAPTCHAs to provide users with HTML of any web page in a single API call.Designed...Show moreLast updated: 3 days ago

Promoted

Senior Software Engineer

Chargebeenagpur, maharashtra, in

Chargebee is the leading Revenue Growth Management (RGM) platform for subscription businesses.Thousands of companies at every stage of development — from startups to enterprises — use Chargebee to ...Show moreLast updated: 19 days ago

Promoted

Senior Software Engineer

Cimpress IndiaNagpur, IN

Cimpress Technology develops cutting-edge, best-in-world software that our mass customization businesses use to create personalized products for over 17 million global customers.Our Mass Customizat...Show moreLast updated: 30+ days ago

Promoted

Senior Software Engineer

Programmers.ioNagpur, IN

We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show moreLast updated: 28 days ago

Promoted

Senior Software Engineer

FileSpinNagpur, IN

Remote-first (UK / EU / India preferred).AI-powered Digital Asset Management SaaS.AI-powered Digital Asset Management (DAM) and Media Processing. We help enterprises scale their content operations with ...Show moreLast updated: 1 day ago

Promoted

Senior Software Engineer

Concentrixnagpur, maharashtra, in

An understanding of software patterns and practices, affinity for developing unit tests with complete code coverage.More than 8 years exposure to Modern web application development.Minimum 4+ years...Show moreLast updated: 26 days ago

Promoted

Senior Java Software Engineer

Curately AI, IncNagpur, IN

We are looking for a talented Java Developer to join our dynamic team.The ideal candidate will have extensive experience in Java development and will be proficient in AWS services, Elasticsearch, a...Show moreLast updated: 16 days ago

Promoted

Senior Software Engineer - 35501

TuringNagpur, IN

We are seeking a Python Developer with strong expertise in FastAPI to join an exciting Reinforcement Learning (RL) Gym project. You will design, build, and optimize scalable APIs, collaborate with r...Show moreLast updated: 28 days ago