About Us
BrightEdge is a leading enterprise SEO and content performance platform trusted by over 1,500 global brands including Microsoft, Adobe, and Marriott.
What makes BrightEdge special is our innovative technology that transforms complex search data into actionable insights. We're not just another martech company – we literally pioneered the SEO platform category and continue to lead with AI-powered solutions.
Working with us means joining a team that's solving fascinating technical and business challenges at scale. You'll be directly impacting how major brands connect with their audiences online.
We're looking for a talented Big Data Engineer to join our Professional Services team to help us scale and optimize our data processing capabilities.
Role Overview
As a Big Data Engineer at BrightEdge, you will design, build, and maintain high-performance data pipelines that process terabytes of data. You'll work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.
Key Responsibilities
- Design and implement scalable batch processing systems using Python and big data technologies
- Optimize database performance, focusing on slow-running queries and latency improvements
- Use Python profilers and performance monitoring tools to identify bottlenecks
- Reduce P95 and P99 latency metrics across our data platform
- Build efficient ETL pipelines that can handle large-scale data processing
- Collaborate with data scientists and product teams to understand data requirements
- Monitor and troubleshoot data pipeline issues in production
- Implement data quality checks and validation mechanisms
- Document data architecture and engineering processes
- Stay current with emerging big data technologies and best practices
Qualifications
Required
Bachelor's degree in Computer Science, Engineering, or related technical field4+ years of experience in data engineering rolesStrong Python programming skills with focus on data processing librariesExperience with big data technologies (Spark, Hadoop, etc.)Proven experience optimizing database performance (SQL or NoSQL)Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)Understanding of performance optimization techniques and profiling toolsExperience with cloud platforms (AWS, GCP, or Azure)Ability to translate business requirements into technical specificationsAbility to work in UK timezone (12 PM IST to 9 : 30 PM IST)Preferred
Bachelor's / Master's degree in Computer Science or related fieldExperience with SEO data or web crawling systemsExperience with Clickhouse DatabaseKnowledge of distributed systems and microservices architectureFamiliarity with container orchestration (Kubernetes, Docker)Experience with real-time data processingContributions to open-source projectsExperience with machine learning operationsSkills and Abilities
Strong analytical thinking and problem-solving skillsExcellent attention to detail and commitment to data qualityAbility to work effectively in a collaborative team environmentGood communication skills to explain complex technical conceptsSelf-motivated with the ability to work independentlyPassion for performance optimization and efficiency