Senior Software Engineer

About the company :

We are a new-age AI-First Digital and Cloud Engineering services company that drives Agility and Relevance for our client’s success.

Powered by cutting-edge technology solutions that enable new business models and revenue streams, we help our clients achieve their trajectory of growth.

Agility is a core muscle, an integral part of the fabric of a modern enterprise. To succeed in an ever-changing business environment, every modern organization needs to adapt and renew itself quickly. We help foster a more agile approach to business to reconfigure strategy, structure, and processes to achieve more growth and drive greater efficiencies.

Relevance is timeless and is the only way to survive and thrive.

The quest for relevance defines the exponential acceleration of humanity. This has presented us with a slew of opportunities, but also many unprecedented challenges. With technology-led innovation, we help our customers harness these opportunities and address myriad challenges.

About the role :

We are looking for a highly skilled Principal / Senior Engineer to drive the design and development of our core product components. In this role, you will work on complex distributed systems, high-performance data ingestion pipelines, and large-scale storage integrations that power mission-critical enterprise workloads. You will influence architecture, own end-to-end modules, and help shape the technology roadmap for our next-generation platform.

What You’ll Do :

Translate design specifications into robust, scalable, and maintainable implementations.

Build high-throughput, parallel-processing data ingestion pipelines in Java, C++, or Go, integrating with sources such as :

Cloud object stores (Amazon S3, Azure Blob, GCS)

Databases (Snowflake, BigQuery, PostgreSQL)

File systems, Kafka, and modern lakehouse formats (e.g., Iceberg)

Develop and optimize high-availability (HA) ingestion with cross-region replication and failover strategies.

Implement monitoring, reliability, and error-reporting frameworks for large-scale ingestion workloads.

Design and maintain Spark connectors, ensuring efficient pushdown, vectorization, and compatibility with Spark ecosystem.

Own integration and lifecycle management of third-party components including Kafka and Kafka Connect.

Contribute to architecture decisions for distributed systems and influence best practices across the engineering organization.

Requirements :

Strong experience building distributed systems with parallel and concurrent processing.(4+ Years of experience)

Expertise in one or more of the following technologies :

Kafka, Zookeeper, Spark, Stream Processing Frameworks

Hands-on experience with :

Kafka Connect, Kafka Streams, Kafka security & custom extensions

Spark Connectors (development or deep integration)

Understanding of event-driven architectures and streaming data patterns.

Solid grasp of Agile development practices, with experience in CI / CD pipelines and modern DevOps workflows.

Nice to Have :

Experience with gRPC, high-performance RPC systems, and multi-threaded programming.

Exposure to Zookeeper, ETCD, or Consul for service coordination.

Familiarity with distributed consensus algorithms (Paxos, Raft).

Hands-on experience with Docker, Kubernetes, and cloud-native deployments.