This job offer is not available in your country.

Lead Software Engineer - Bigdata

Société Générale Assurancesbangalore, India

16 hours ago

Job description

Lead Software Engineer - Bigdata

Innovation / Project / Organization Permanent contract Bangalore, India Reference 25000HVJ Start date 2025 / 10 / 01 Publication date 2025 / 09 / 04

Responsibilities

We are seeking an experienced Data Engineer with strong Snowflake skills to join our data engineering team. The ideal candidate will have a solid background in data ingestion, data processing, and data management using technologies such as Snowflake, Snowpark,DBT .

Knowledge on Apache Spark, Hive, and HDFS would be good to have.. You will be responsible for migrating and testing data pipelines and ensuring efficient data storage and processing. In addition, you will work with CI / CD tools, such as Jenkins, and schedulers like CTRL-M, to automate data workflows.

Responsibilities

Will work as an Individual contributor on Big Data Migration Project to Lakehouse migration project.
Perform tasks related to migrating & testing applications on Snowflake, Snowpark, Apache Spark, Hive , on new retail banking data Lakehouse.
Good to have knowledge on DBT.
Perform extensive testing of the migrated code, debugging & fixing issues.
Manage DevOPS as required & defined on the project
Automate processes wherever required to improve efficiency of testing team.
Co-ordinate with diverse geographically located teams to complete assigned activities.
Participate in daily various agile ceremonies during the ongoing sprint and complete tasks as required.
Conduct bug-free release validations and produce metrics, tests, and defect reports.
Assist in developing and enforcing team guidelines.
Being spoc for the team and provide information / status on ongoing activities on regular basis to management whenever needed.

Profile required

At least 3 to 7 Years of experience on big data platform and at least 2 years of experience in implementing DWH on Snowflake

Proven experience with cloud platforms preferable Azure particularly on data services

Good understanding of distributed computing frameworks like Apache Spark, Hadoop etc

Perform Analysis on existing data storage systems Big Data & development of data solutions in Snowflake

High Proficiency in SQL and at least one of the following languages Scala / Python &

Experience in working on migrating data from on-premise databases preferably Big Data platformto Snowflake

Expertise in building robust ELT / ETL processes , performance tuning of the data pipelines in Snowflake and should be able to trouble shoot the issues quickly

Strong Knowledge on Integration concepts and design best practices

Data Modeling & data integration, Advanced SQL skills for analysis, standardizing queries

Proven experience in managing and mentoring data engineering teams

Excellent interpersonal skills, with the ability to work across teams and communicate effectively with technical and non-technical stake holders

Strong analytical and trouble shooting skills with proven ability to find solutions in complex data environments

Why join us

We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status

Create a job alert for this search

Lead Software Engineer • bangalore, India