This job offer is not available in your country.

Senior Data Engineer

astuto.aiBengaluru, Karnataka, India

30+ days ago

Job description

Role : Senior Engineer – Data Platform

Experience : 3 to 7 years

Location : Bangalore, on-site

Reports To : VP of Engineering

About Astuto

We aim to build an AI-first Cloud Efficiency Platform that helps businesses maximize the ROI on public cloud investments.

Given the increase in complexity and cost of cloud infrastructure and services, this space has an enormous opportunity. Over $600 billion is being spent on the public cloud, and an estimated $180 billion is being wasted. In addition, lack of expertise as complexity and scale increase is a big challenge for organizations.

Astuto is growing its engineering team in Bengaluru and is on the lookout for exceptional engineers to drive our vision.

Job Overview :

We are seeking an experienced Engineer with a passion for building scalable, modular ELT systems. The successful candidate will be central to developing a platform that can efficiently handle vast volumes of data and ensure quick ingestion and fast data processing.

If you are a problem solver, a team player, and have expertise in Go programming and Kubernetes, we would like to meet you.

Key Responsibilities :

Design and Implement Data Pipelines : Develop scalable, efficient, and modular data pipelines to move data between various sources and destinations.
System Integration : Seamlessly integrate multiple data sources that can push or pull data into our platform using
Scalability : Ensure systems scale effectively to manage vast data volumes without compromising on speed or security.
Optimization : Continuously monitor, optimize, and improve data ingestion and processing speeds.
Deploy and manage in Kubernetes : Efficiently deploy, manage, and monitor our systems within Kubernetes.

Qualifications :

Bachelor's degree in Computer Science, Software Engineering, or a related field.

Relevant 4+ years of experience in building ELT systems

Strong proficiency in the Go programming language.

Good hold on streaming services like Kafka or Pulsar and caching services like Redis

Experience with Kubernetes deployment

Good to have knowledge of Apache Spark / Flink

Good understanding of Grafana and Prometheus

Familiarity with data integration, ELT processes, and data warehousing concepts.

Good understanding of with service-oriented architecture and gRPC

Familiarity with data modeling, database systems, and SQL

Experience with data versioning, data lineage, and data cataloging tools is a plus.

Excellent problem-solving and communication skills.

Strong team player and ability to collaborate with cross-functional teams.

Results-oriented and able to work independently with minimal supervision.

Proactive in staying up to date with industry trends and best practices.

Create a job alert for this search

Senior Data Engineer • Bengaluru, Karnataka, India