Lead Software Engineer

About BU

The Architecture Team plays a pivotal role in the end-to-end design, governance, and strategic direction of product development within Epsilon People Cloud (EPC). As a centre of technical excellence, the team ensures that every product feature is engineered to meet the highest standards of scalability, security, performance, and maintainability. Their responsibilities span across architectural ownership of critical product features, driving techno-product leadership, enforcing architectural governance, and ensuring systems are built with scalability, security, and compliance in mind. They design multi cloud and hybrid cloud solutions that support seamless integration across diverse environments and contribute significantly to interoperability between EPC products and the broader enterprise ecosystem. The team fosters innovation and technical leadership while actively collaborating with key partners to align technology decisions with business goals. Through this, the Architecture Team ensures the delivery of future-ready, enterprise-grade, efficient and performant, secure and resilient platforms that form the backbone of Epsilon People Cloud.

Why we are Looking for You?

At Epsilon, we run on our people’s ideas. It’s how we solve problems and exceed expectations. Our team is now growing, and we are on the lookout for dedicated individuals who always set the standard by constantly challenging themselves and are experts in building customized solutions in the digital marketing space.

What you will enjoy in this Role?

So, are you someone who wants to work with innovative technology and enable marketers to create data-driven, omnichannel consumer experiences through data platforms? Then you could be exactly who we are looking for.

Apply today and be part of a creative, innovative, and dedicated team that’s not afraid to push boundaries or take risks.

Click here to view how Epsilon transforms marketing with 1 View, 1 Vision and 1 Voice.

Responsibility

We seek Software Engineers with experience building and scaling services in on-premises and cloud environments.

As a Lead Software Engineer in the Epsilon Attribution / Forecasting Product Development team, you will design, implement, and optimize data processing solutions using Scala, Spark, and Hadoop. Collaborate with cross-functional teams to deploy big data solutions on our on-premises and cloud infrastructure along with building, scheduling and maintaining workflows. Perform data integration and transformation, solve issues, Document processes, communicate technical concepts clearly, and continuously enhance our attribution engine / forecasting engine.

Strong written and verbal communication skills (in English) are required to facilitate work across multiple countries and time zones. Good understanding of Agile Methodologies – SCRUM.

Qualification

Strong experience (9 - 12 years) in Python or Scala programming language and extensive experience with Apache Spark for Big Data processing for design, developing and maintaining scalable on-prem and cloud environments, especially on AWS and as needed with GCP cloud.

Proficiency in performance tuning of Spark jobs, optimizing resource usage, shuffling, partitioning, and caching for maximum efficiency in Big Data environments.

In-depth understanding of the Hadoop ecosystem, including HDFS, YARN, and MapReduce.

Expertise in designing and implementing scalable, fault-tolerant data pipelines with end-to-end monitoring and alerting.

Using Python to develop infrastructure modules. Hence, hands-on experience with Python.

Solid grasp of database systems and SQLs for writing efficient SQL’s (RDBMS / Warehouse) to handle TBS of data.

Familiarity with design patterns and best practices for efficient data modelling, partitioning strategies, and sharding for distributed systems and experience in building, scheduling and maintaining DAG workflows.

End-to-end ownership with definition, development, and documentation of software’s objectives, business requirements, deliverables, and specifications in collaboration with stakeholders.

Experience in working on GIT (or equivalent source control) and solid understanding of Unit and integration test frameworks.

Must have the ability to collaborate with stakeholders / teams to understand requirements and develop a working solution and the ability to work within tight deadlines and effectively prioritize and execute tasks in a high-pressure environment.

Must be able to mentor junior staff.

Advantageous to have experience on below :

Hands-on with Databricks for unified data analytics, including Databricks Notebooks, Delta Lake, and Catalogues.

Proficiency in using the ELK (Elasticsearch, Logstash, Kibana) stack for real-time search, log analysis, and visualization.

Strong background in analytics, including the ability to derive actionable insights from large datasets and support data-driven decision-making.

Experience with data visualization tools like Tableau, Power BI, or Grafana.

Familiarity with Docker for containerization and Kubernetes for orchestration.

Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we’ve provided marketers from the world’s leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual. And 1 Voice to harmonize engagement across paid, owned and earned channels.

Epsilon’s comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology. We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Epsilon is a global company with more than 9,000 employees around the world.

Epsilon has a core set of 5 values that define our culture and guide us to create value for our clients, our people and consumers. We are seeking candidates that align with our company values, demonstrate them and make them meaningful in their day-to-day work :

Act with integrity. We are transparent and have the courage to do the right thing.

Work together to win together. We believe collaboration is the catalyst that unlocks our full potential.

Innovate with purpose. We shape the market with big ideas that drive big outcomes.

Respect all voices. We embrace differences and foster a culture of connection and belonging.

Empower with accountability. We trust each other to own and deliver on common goals.

Because You Matter

YOUniverse. A work-world with you at the heart of it!

At Epsilon, we believe people make the place. And everything we do is designed with you in mind. That’s why our work-world, aptly named ‘YOUniverse’ is focused on creating a nurturing environment that elevates your growth, wellbeing and work-life harmony. So, come be part of a people-centric workspace where care for you is at the core of all we do.

Take a trip to YOUniverse and explore our unique benefits, here .

Epsilon is an Equal Opportunity Employer.

Epsilon is committed to promoting diversity, inclusion, and equal employment opportunities by using reasonable efforts to attract, recruit, engage and retain qualified individuals of all ethnicities and backgrounds, including, but not limited to, women, people of color, LGBTQ individuals, people with disabilities and any other underrepresented groups, traits or characteristics.