Data Engineer, Pune

What youll do

We are looking for a strong Senior Data Engineer with deep experience in Java based data platforms and hands-on expertise with GCP GCS Iceberg and Parquet . The role involves building efficient data pipelines improving storage and query performance and enabling a scalable data lake architecture. Experience with Trino or Apache Spark is a plus.

Java Data Engineering is a must due to our tech stack requirement; would not consider Pyspark candidates.

Key Responsibilities

Data Engineering and Development

• Design and develop scalable data ingestion and transformation frameworks using Java.
• Build and maintain Iceberg tables stored on GCS using Parquet format.
• Continuously improve pipeline performance through better partitioning compression data layouts and efficient Java code.

2. Cloud Engineering (Google Cloud Platform)

3. Data Lake Operations

4. Integration and Query Layer

5. Testing and Quality

6. DevOps and Observability

Why we should decide on you

Required Skills

Nice to Have

Soft Skills

Education

Why you should decide on us

To get a first impression we only need your CV and look forward to meeting you in a (personal / virtual) interview!

Recognizing the benefits of working in diverse teams we are committed to equal employment opportunities regardless of gender age nationality ethnic or social origin disability and sexual identity.

Are you interested Apply now!

R&DN202502

R&DN202503

About us

Regnology is a leading technology firm on a mission to bring efficiency and stability to the financial markets. With an exclusive focus on regulatory reporting and more than 35000 financial institutions over 100 regulators international organizations and tax authorities relying on our solutions to process their regulatory reporting data we are uniquely positioned to bring greater data quality automation and cost savings to all market participants. With a global team of over 1200 employees our clients can swiftly implement and derive value from our solutions and stay ahead of regulatory changes. Established in 2021 through the merger of BearingPoint RegTech and Vizor Software Regnology is rapidly growing into a leading global regulatory reporting powerhouse.

Visit our website

W ant to know m ore about Regnology Find our news and business events on LinkedIn : to know more about life and people at Regnology Check out our Instagram page :

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full-Time

Experience : years

Vacancy : 1