Qualys - Lead Software Engineer - Distributed Systems

About the job :

Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!

Description :

We are seeking a talented Lead Software Engineer Performance to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.

You will lead the performance engineering efforts across Spark, Kafka, Elasticsearch, and Middleware APIs, ensuring that our real-time data pipelines and services meet enterprise-grade SLAs.

As part of our high-performing engineering team, you will design and execute performance testing strategies, identify system bottlenecks, and work with development teams to implement performance improvements that support billions of cyber security events processing a day across our data platform.

Responsibilities :

• Own the performance strategy across distributed systems which includes Hadoop, Spark, Kafka, Elasticsearch / OpenSearch, Big Data Components and APIs for each release.
• Define, develop, and execute performance test plans, load tests, stress tests, and soak tests.
• Create realistic performance test scenarios for data pipelines and microservices based on production-like workloads.
• Proactively identify bottlenecks, resource contention, and latency issues using tools such as JMeter, Spark UI, Kafka Manager, Elastic Monitoring and App Dynamics.
• Provide deep-dive analysis and recommendations on tuning and scaling Spark jobs, Kafka topics / partitions, ES queries, and API endpoints.
• Collaborate with developers, architects, and infrastructure teams to integrate performance feedback into design and implementation.
• Simulate and benchmark real-time and batch data flow at scale using synthetic and production-like datasets and own this framework end to end for synthetic data generator.
• Lead the initiative to build a performance testing framework that integrates with CI / CD pipelines.
• Establish and track SLAs for throughput, latency, CPU / memory utilization and Garbage collection.
• Create performance dashboards and visualization using Prometheus / Grafana, Kibana, or equivalent.
• Document performance test findings and create technical reports for leadership and engineering teams.
• Recommend performance optimization to Dev and Platform groups.
• Responsible for optimizing the overall cost.
• Contribute to feature development and fixes apart from performance benchmarking.

Qualifications :

Additional Plus Competencies :

(ref : hirist.tech)