Role : Senior Engineer – Data Platform
Experience : 3 to 7 years
Location : Bangalore, on-site
Reports To : VP of Engineering
About Astuto
We aim to build an AI-first Cloud Efficiency Platform that helps businesses maximize the ROI on public cloud investments.
Given the increase in complexity and cost of cloud infrastructure and services, this space has an enormous opportunity. Over $600 billion is being spent on the public cloud, and an estimated $180 billion is being wasted. In addition, lack of expertise as complexity and scale increase is a big challenge for organizations.
Astuto is growing its engineering team in Bengaluru and is on the lookout for exceptional engineers to drive our vision.
Job Overview :
We are seeking an experienced Engineer with a passion for building scalable, modular ELT systems. The successful candidate will be central to developing a platform that can efficiently handle vast volumes of data and ensure quick ingestion and fast data processing.
If you are a problem solver, a team player, and have expertise in Go programming and Kubernetes, we would like to meet you.
Key Responsibilities :
- Design and Implement Data Pipelines : Develop scalable, efficient, and modular data pipelines to move data between various sources and destinations.
- System Integration : Seamlessly integrate multiple data sources that can push or pull data into our platform using
- Scalability : Ensure systems scale effectively to manage vast data volumes without compromising on speed or security.
- Optimization : Continuously monitor, optimize, and improve data ingestion and processing speeds.
- Deploy and manage in Kubernetes : Efficiently deploy, manage, and monitor our systems within Kubernetes.
Qualifications :
Bachelor's degree in Computer Science, Software Engineering, or a related field.Relevant 4+ years of experience in building ELT systemsStrong proficiency in the Go programming language.Good hold on streaming services like Kafka or Pulsar and caching services like RedisExperience with Kubernetes deploymentGood to have knowledge of Apache Spark / FlinkGood understanding of Grafana and PrometheusFamiliarity with data integration, ELT processes, and data warehousing concepts.Good understanding of with service-oriented architecture and gRPCFamiliarity with data modeling, database systems, and SQLExperience with data versioning, data lineage, and data cataloging tools is a plus.Excellent problem-solving and communication skills.Strong team player and ability to collaborate with cross-functional teams.Results-oriented and able to work independently with minimal supervision.Proactive in staying up to date with industry trends and best practices.