Talent.com
This job offer is not available in your country.
Senior Data Engineer

Senior Data Engineer

BrightEdgeGhaziabad, IN
24 days ago
Job description

About Us

BrightEdge is a leading enterprise SEO and content performance platform trusted by over 1,500 global brands including Microsoft, Adobe, and Marriott.

What makes BrightEdge special is our innovative technology that transforms complex search data into actionable insights. We're not just another martech company – we literally pioneered the SEO platform category and continue to lead with AI-powered solutions.

Working with us means joining a team that's solving fascinating technical and business challenges at scale. You'll be directly impacting how major brands connect with their audiences online.

We're looking for a talented Big Data Engineer to join our Professional Services team to help us scale and optimize our data processing capabilities.

Role Overview

As a Big Data Engineer at BrightEdge, you will design, build, and maintain high-performance data pipelines that process terabytes of data. You'll work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.

Key Responsibilities

  • Design and implement scalable batch processing systems using Python and big data technologies
  • Optimize database performance, focusing on slow-running queries and latency improvements
  • Use Python profilers and performance monitoring tools to identify bottlenecks
  • Reduce P95 and P99 latency metrics across our data platform
  • Build efficient ETL pipelines that can handle large-scale data processing
  • Collaborate with data scientists and product teams to understand data requirements
  • Monitor and troubleshoot data pipeline issues in production
  • Implement data quality checks and validation mechanisms
  • Document data architecture and engineering processes
  • Stay current with emerging big data technologies and best practices

Qualifications

Required

  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 4+ years of experience in data engineering roles
  • Strong Python programming skills with focus on data processing libraries
  • Experience with big data technologies (Spark, Hadoop, etc.)
  • Proven experience optimizing database performance (SQL or NoSQL)
  • Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)
  • Understanding of performance optimization techniques and profiling tools
  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Ability to translate business requirements into technical specifications
  • Ability to work in UK timezone (12 PM IST to 9 : 30 PM IST)
  • Preferred

  • Bachelor's / Master's degree in Computer Science or related field
  • Experience with SEO data or web crawling systems
  • Experience with Clickhouse Database
  • Knowledge of distributed systems and microservices architecture
  • Familiarity with container orchestration (Kubernetes, Docker)
  • Experience with real-time data processing
  • Contributions to open-source projects
  • Experience with machine learning operations
  • Skills and Abilities

  • Strong analytical thinking and problem-solving skills
  • Excellent attention to detail and commitment to data quality
  • Ability to work effectively in a collaborative team environment
  • Good communication skills to explain complex technical concepts
  • Self-motivated with the ability to work independently
  • Passion for performance optimization and efficiency
  • Create a job alert for this search

    Senior Data Engineer • Ghaziabad, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    LTIMindtreeNoida, Uttar Pradesh, India
    Are you looking for a new career challenge? With LTIMindtree, are you ready to embark on a data-driven career? Working for global leading manufacturing client for providing an engaging product expe...Show moreLast updated: 18 days ago
    Senior Data Engineer

    Senior Data Engineer

    BlackStone eITIN
    Remote
    Quick Apply
    BlackStone eIT is on the lookout for a.In this role, you will be responsible for the design, development, and optimization of our data infrastructure. You'll play a crucial part in supporting data a...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Varahe Analytics Private LimitedNoida, Uttar Pradesh, India
    We are one of India’s premier integrated political consulting firms specializing in building data-driven 360-degree election campaigns. We help our clients with strategic advice and implementation w...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Cimpress IndiaGhaziabad, IN
    At Cimpress Technology, we are dedicated to crafting cutting-edge, world-class software solutions that power our mass customization businesses, serving a vast customer base of over 17 million indiv...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Ops Engineer

    Senior Data Ops Engineer

    LuxoftGhaziabad, IN
    Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Warehouse Engineer

    Senior Data Warehouse Engineer

    Asian HiresGhaziabad, IN
    POSITION REPORTS TO : Senior Manager Application Development.DEPARTMENT : Information Technology.POSITION LOCATION : INDIA (REMOTE). COMPANY BUDGET : 18,00,000 - 23,00,000.We are seeking a highly skille...Show moreLast updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    NTTNoida, IN
    We are currently seeking a Senior Data Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Job Duties : Key Responsibilities : . Design and implement tailored data solutions to meet c...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer - ETL / SQL

    Senior Data Engineer - ETL / SQL

    Essvee ConsultantNoida
    Job Summary : We're seeking a highly skilled and experienced Senior Data Engineer with 6-8 years of expertise to join our team in New Delhi.This critical role f...Show moreLast updated: 17 days ago
    • Promoted
    DataHavn - Senior Data Engineer - ETL

    DataHavn - Senior Data Engineer - ETL

    DataHavnNoida
    Responsibilities : - Data Pipeline Development : Build and maintain scalable data pipelines to extract, transform, and load (ETL) data from various sources (e...Show moreLast updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    TalentojNoida, Uttar Pradesh, India
    Experience on working with ETL on a data warehouse or big data projects.Experience with cloud services like Azure or GCP or AWS with respect to the data related services, could be just etl data cle...Show moreLast updated: 2 days ago
    Senior Data Engineer

    Senior Data Engineer

    Tata Consultancy ServicesNoida, Uttar Pradesh, India
    Greetings from TCS Recruitment Team.For all those Azure Data Engineer, we are coming bigger with the plan of.Walk In Drive on 12-July-2025(Saturday) in Noida. Walkin For Azure Data Engineer In Noida...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Governance Engineer

    Senior Data Governance Engineer

    Elfonze TechnologiesGhaziabad, IN
    Job Description : As a Senior Data Governance Engineer, you will play a crucial role in the development and implementation of our data governance architecture & strategy. ETL, Azure Databricks, Pyspa...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer - SQL / Python

    Senior Data Engineer - SQL / Python

    Strategic Talent PartnerNoida
    Job Description : - Create and maintain optimal data pipeline architecture - Identify, design, and implement internal process improvements : automating manu...Show moreLast updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    LUMIQNoida, Uttar Pradesh, India
    LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance (FSI) industry.We are trusted by the world's largest FSIs, including insurers, banks, AMCs, and NBFCs, to add...Show moreLast updated: 13 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Ghaziabad, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DautomGhaziabad, IN
    Java, MapReduce, Hive, and Spark jobs.HDFS, Pig, Hive, HBase, Sqoop, Flume.Analyze source data integrity and ensure accurate data ingestion. Build dashboards and BI solutions using best practices.Co...Show moreLast updated: 2 days ago
    Senior Data Engineer

    Senior Data Engineer

    Freescale Semiconductor India Pvt LtdINDIA
    As a part of the AI & Data Platform organization, the Enterprise Business Intelligence (EBI) team is central to NXPs data analytic success, providing and maintaining data solutions, platforms and m...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Data Warehousing

    Senior Data Engineer - Data Warehousing

    QuesthiringNoida
    Job Description : As a Data Engineer in the Data Warehouse team you will be relied on to independently develop and deliver high-quality features and finish tasks to a...Show moreLast updated: 30+ days ago