Elastic Data Engineer

This job is with Kyndryl, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.

Who We Are

At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.

The Role

Are you ready to dive headfirst into the captivating world of data engineering at Kyndryl? As a Data Engineer, you'll be the visionary behind our data platforms, crafting them into powerful tools for decision-makers. Your role? Ensuring a treasure trove of pristine, harmonized data is at everyone's fingertips.

As a Data Engineer at Kyndryl, you'll be at the forefront of the data revolution, crafting and shaping data platforms that power our organization's success. This role is not just about code and databases; it's about transforming raw data into actionable insights that drive strategic decisions and innovation.

As an ELK (Elastic, Logstash & Kibana) Data Engineer, you would be responsible for developing, implementing, and maintaining the ELK stack-based solutions for Kyndryl's clients. This role would be responsible to develop efficient and effective, data & log ingestion, processing, indexing, and visualization for monitoring, troubleshooting, and analysis purposes.

Responsibilities :

Design, implement, and maintain scalable data pipelines using ELK Stack (Elasticsearch, Logstash, Kibana) and Beats for monitoring and analytics.

Develop data processing workflows to handle real-time and batch data ingestion, transformation and visualization.

Implement techniques like grok patterns, regular expressions, and plugins to handle complex log formats and structures.

Configure and optimize Elasticsearch clusters for efficient indexing, searching, and performance tuning.

Collaborate with business users to understand their data integration & visualization needs and translate them into technical solutions

Create dynamic and interactive dashboards in Kibana for data visualization and insights that can enable to detect the root cause of the issue.

Leverage open-source tools such as Beats and Python to integrate and process data from multiple sources.

Collaborate with cross-functional teams to implement ITSM solutions integrating ELK with tools like ServiceNow and other ITSM platforms.

Anomaly detection using Elastic ML and create alerts using Watcher functionality

Extract data by Python programming using API

Build and deploy solutions in containerized environments using Kubernetes.

Monitor Elasticsearch clusters for health, performance, and resource utilization

Automate routine tasks and data workflows using scripting languages such as Python or shell scripting.

Provide technical expertise in troubleshooting, debugging, and resolving complex data and system issues.

Create and maintain technical documentation, including system diagrams, deployment procedures, and troubleshooting guides

In this role, you'll be engineering the backbone of our data infrastructure, ensuring the availability of pristine, refined data sets. With a well-defined methodology, critical thinking, and a rich blend of domain expertise, consulting finesse, and software engineering prowess, you'll be the mastermind of data transformation.

Your journey begins by understanding project objectives and requirements from a business perspective, converting this knowledge into a data puzzle. You'll be delving into the depths of information to uncover quality issues and initial insights, setting the stage for data excellence. But it doesn't stop there. You'll be the architect of data pipelines, using your expertise to cleanse, normalize, and transform raw data into the final dataset-a true data alchemist.

Armed with a keen eye for detail, you'll scrutinize data solutions, ensuring they align with business and technical requirements. Your work isn't just a means to an end; it's the foundation upon which data-driven decisions are made - and your lifecycle management expertise will ensure our data remains fresh and impactful.

So, if you're a technical enthusiast with a passion for data, we invite you to join us in the exhilarating world of data engineering at Kyndryl. Let's transform data into a compelling story of innovation and growth.

Your Future at Kyndryl

Every position at Kyndryl offers a way forward to grow your career. We have opportunities that you won't find anywhere else, including hands-on experience, learning opportunities, and the chance to certify in all four major platforms. Whether you want to broaden your knowledge base or narrow your scope and specialize in a specific sector, you can find your opportunity here.

Who You Are

You're good at what you do and possess the required experience to prove it. However, equally as important - you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused - someone who prioritizes customer success in their work. And finally, you're open and borderless - naturally inclusive in how you work with others.

Required Technical and Professional Expertise

At least 3 years of experience with ELK Stack and Python programming, along with a minimum of 10 years overall experience in the IT industry.

ELK Stack : Deep expertise in Elasticsearch, Logstash, Kibana, Beats and Anomaly detection.

Programming : Proficiency in Python for scripting and automation.

ITSM Platforms : Hands-on experience with ServiceNow or similar ITSM tools.

Containerization : Experience with Kubernetes and containerized applications.

Operating Systems : Strong working knowledge of Windows, Linux, and AIX environments.

Open Source Tools : Familiarity with various open-source data integration and monitoring tools.

Additional Skills :

Knowledge of network protocols, log management, and system performance optimization.

Experience in integrating ELK solutions with enterprise IT environments.

Strong analytical and problem-solving skills with attention to detail.

Knowledge in MySQL or NoSQL Databases will be added advantage

Fluent in English (written and spoken).

Preferred Technical and Professional Experience

Graduate / Postgraduate in computer science, computer engineering .

"Elastic Certified Analyst" or "Elastic Certified Engineer" certification is preferrable

Familiarity with additional monitoring tools like Prometheus, Grafana, or Splunk.

Knowledge of cloud platforms (AWS, Azure, or GCP).

Experience with DevOps methodologies and tools.

Being You

Diversity is a whole lot more than what we look like or where we come from, it's how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we're not doing it single-handily : Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you - and everyone next to you - the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That's the Kyndryl Way.

What You Can Expect

With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter - wherever you are in your life journey. Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations.  At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed.

Get Referred!

If you know someone that works at Kyndryl, when asked 'How Did You Hear About Us' during the application process, select 'Employee Referral' and enter your contact's Kyndryl email address.

]]>