Talent.com
This job offer is not available in your country.
Senior Data Engineer

Senior Data Engineer

BrightEdgeChennai, IN
22 days ago
Job description

About Us

BrightEdge is a leading enterprise SEO and content performance platform trusted by over 1,500 global brands including Microsoft, Adobe, and Marriott.

What makes BrightEdge special is our innovative technology that transforms complex search data into actionable insights. We're not just another martech company – we literally pioneered the SEO platform category and continue to lead with AI-powered solutions.

Working with us means joining a team that's solving fascinating technical and business challenges at scale. You'll be directly impacting how major brands connect with their audiences online.

We're looking for a talented Big Data Engineer to join our Professional Services team to help us scale and optimize our data processing capabilities.

Role Overview

As a Big Data Engineer at BrightEdge, you will design, build, and maintain high-performance data pipelines that process terabytes of data. You'll work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.

Key Responsibilities

  • Design and implement scalable batch processing systems using Python and big data technologies
  • Optimize database performance, focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • Build efficient ETL pipelines that can handle large-scale data processing
  • Collaborate with data scientists and product teams to understand data requirements
  • Monitor and troubleshoot data pipeline issues in production
  • Implement data quality checks and validation mechanisms
  • Document data architecture and engineering processes
  • Stay current with emerging big data technologies and best practices

Qualifications

Required

  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)
  • Understanding of performance optimization techniques and profiling tools
  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Ability to translate business requirements into technical specifications
  • Ability to work in UK timezone (12 PM IST to 9 : 30 PM IST)
  • Preferred

  • Bachelor's / Master's degree in Computer Science or related field
  • Experience with SEO data or web crawling systems
  • Experience with Clickhouse Database
  • Knowledge of distributed systems and microservices architecture
  • Familiarity with container orchestration (Kubernetes, Docker)
  • Experience with real-time data processing
  • Contributions to open-source projects
  • Experience with machine learning operations
  • Skills and Abilities

  • Strong analytical thinking and problem-solving skills
  • Excellent attention to detail and commitment to data quality
  • Ability to work effectively in a collaborative team environment
  • Good communication skills to explain complex technical concepts
  • Self-motivated with the ability to work independently
  • Passion for performance optimization and efficiency
  • Create a job alert for this search

    Senior Data Engineer • Chennai, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incedo Inc.Chennai, Tamil Nadu, India
    Required Skills and Experience : .Strong hands-on experience with.API Gateway configuration, and monitoring.KMS, tokenization, IAM policies). Work mode- Hyd, 4days wfo in a week.Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Grid DynamicsChennai, Tamil Nadu, India
    We are seeking a skilled Data Engineer with over 6+ years of experience to design, build, and maintain scalable data pipelines and perform advanced data analysis to support business intelligence an...Show moreLast updated: 9 days ago
    Senior Data Engineer

    Senior Data Engineer

    BlackStone eITIN
    Remote
    Quick Apply
    BlackStone eIT is on the lookout for a.In this role, you will be responsible for the design, development, and optimization of our data infrastructure. You'll play a crucial part in supporting data a...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    LTIMindtreeChennai, Tamil Nadu, India
    Are you looking for a new career challenge? With LTIMindtree, are you ready to embark on a data-driven career? Working for global leading manufacturing client for providing an engaging product expe...Show moreLast updated: 16 days ago
    Senior Data Engineer

    Senior Data Engineer

    Cynosure Corporate SolutionsChennai, TN, in
    Quick Apply
    Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.Build scalable and automated MLOps pipelines for model training, validation, and ...Show moreLast updated: 6 days ago
    Senior Data Engineer

    Senior Data Engineer

    Saaki Argus & Averil ConsultingChennai, Tamil Nadu, India
    Quick Apply
    Hiring Senior Data Engineer for an IT Product Company.Minimum 4+Yrs of Relevant Experience.Mandatory Skills : Strong expertise in Python ( Class methods), OOPS in Python, SQL , Databricks , AWS or A...Show moreLast updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    Forbes AdvisorChennai, India
    We are hiring a Senior Data Engineer to help design and scale the infrastructure behind our analytics performance marketing and experimentation platforms. This role is ideal for someone who thrives ...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer - IICS

    Senior Data Engineer - IICS

    INSIGHT INDChennai
    Role : Senior Data Engineer - IICS (Informatica Intelligent Cloud Services) Years of Experience : 5+ years No.Openings : 2 Location : ...Show moreLast updated: 30+ days ago
    • New!
    Senior Platform Data Engineer

    Senior Platform Data Engineer

    InfiligenceChennai, TN, India
    Quick Apply
    Infiligence is a global technology company with offices in Chennai, India, Hyderabad, and California, USA.We are committed to delivering innovative data solutions to our clients worldwide.We offer ...Show moreLast updated: 1 hour ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ViasatChennai, Tamil Nadu, India
    At Viasat, we’re on a mission to deliver connections with the capacity to change the world.For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries arou...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Ops Engineer

    Senior Data Ops Engineer

    LuxoftIndia, India
    Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Ideas2IT TechnologiesChennai, Tamil Nadu, India
    As a Data Engineer, you'll build and maintain data pipelines and architectures.Responsibilities include optimizing databases and ETL processes, using Python or SQL,and collaborating with data teams...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer - IICS

    Senior Data Engineer - IICS

    Resource Tree Global ServicesChennai
    Job Name : Senior Data Engineer IICS.Years of Experience : 5.Job Description : We are looking for a skilled and motivated Se...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Cimpress IndiaChennai, IN
    At Cimpress Technology, we are dedicated to crafting cutting-edge, world-class software solutions that power our mass customization businesses, serving a vast customer base of over 17 million indiv...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Agilisium ConsultingChennai, Tamil Nadu, India
    Data Integration and Transformation.Automation and Workflow Management.Life sciences / Pharma (Added advantage).Show moreLast updated: 12 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Chennai, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    LogitechChennai
    Logitech is the Sweet Spot for people who want their actions to have a positive global impact while having the flexibility to do it in their own way.Job Description : ...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    DautomChennai, IN
    Java, MapReduce, Hive, and Spark jobs.HDFS, Pig, Hive, HBase, Sqoop, Flume.Analyze source data integrity and ensure accurate data ingestion. Build dashboards and BI solutions using best practices.Co...Show moreLast updated: 21 hours ago