Talent.com
Data Pipeline Architect

Data Pipeline Architect

BrightEdgeRepublic Of India, IN
30+ days ago
Job description

BrightEdge is a global leader in enterprise SEO and content performance solutions, driving AI-powered digital marketing success for the world’s top brands. Our culture is product-first, innovation-driven, and built for those passionate about building exceptional technology that empowers results at scale.

About the Role :

BrightEdge is seeking a Sr. / Software Engineer to lead the development of scalable, resilient, and high-performance data ingestion pipelines. This is a high-impact role at the core of our data platform, enabling timely, accurate, and complete data access for insights, products, and operational excellence.

What You’ll Do :

  • Design and build robust data ingestion pipelines using Python.
  • Integrate with diverse data sources (APIs, databases, streaming platforms, cloud storage).
  • Optimize for scalability, fault tolerance, and cost-efficiency.
  • Implement data validation, error handling, and self-healing mechanisms.
  • Collaborate with cross-functional teams to ensure seamless data flow.
  • Champion best practices in testing, monitoring, alerting, and documentation.

What You Bring :

  • Expertise in Python for production-grade applications.
  • Experience with distributed systems, cloud platforms (AWS / GCP), and data integration.
  • Strong knowledge of SQL, schema design, and query optimization.
  • Familiarity with REST APIs, GraphQL, Kafka, S3, SFTP, and streaming platforms.
  • Experience with monitoring tools (Prometheus, Grafana) and setting up alerts.
  • Experience with Git, Docker, and Kubernetes.
  • Exposure to real-time data processing (Kafka, Flink, Spark Streaming) is a plus.
  • Solid understanding of data quality, error handling, and self-healing systems.
  • Strong communication, ownership, and problem-solving mindset.

    • Why BrightEdge :

  • Work on cutting-edge data technologies and solve complex scalability challenges.
  • Be part of a collaborative, high-impact team driving data-driven decisions.
  • Enjoy a culture of continuous improvement, innovation, and growth.
  • Opportunity to shape the future of data ingestion at scale.

    • Ready to build the future of data at BrightEdge? Apply now!

    Create a job alert for this search

    Data Pipeline Architect • Republic Of India, IN

    Related jobs
    • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Randstad EnterpriseRepublic Of India, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Pipeline Architect

    Senior Data Pipeline Architect

    BrightEdgeRepublic Of India, IN
    Senior Software Engineer, Remote.The Software Engineer, Data Ingestion will be a critical individual contributor responsible for designing collection strategies, developing, and maintaining robust ...Show moreLast updated: 29 days ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    AaysNagpur, IN
    Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Architect

    GCP Data Architect

    Tata Consultancy Servicesnagpur, maharashtra, in
    Job Title : - GCP Data Architect.Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and co...Show moreLast updated: 21 days ago
    • Promoted
    Enterprise Data Architect

    Enterprise Data Architect

    DBiz.aiNagpur, IN
    You will ensure that data is modeled, structured and integrated across the organization to support analytics and AI / ML initiatives at scale. You will work closely with business stakeholders and tech...Show moreLast updated: 10 days ago
    • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    KaarTechChennai, Republic Of India, IN
    Data Pipeline Development : Design, develop, and maintain scalable data pipelines to support various data analytics and reporting needs. Data Integration : Integrate data from multiple sources and ens...Show moreLast updated: 29 days ago
    • Promoted
    Lead Data Pipeline Architect

    Lead Data Pipeline Architect

    MSBC GroupPune, Republic Of India, IN
    As a Data Engineer, your primary role is to create and maintain high-performance data pipelines, warehouses, and cloud-based systems. This includes creating efficient batch and streaming pipelines, ...Show moreLast updated: 21 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsNagpur, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Solytics PartnersPune, Republic Of India, IN
    Solytics Partners is a Global Analytics firm, recognized with multiple industry awards for innovation and excellence.Our team comprises experts with deep knowledge in risk, analytics, AI / ML, AML / FC...Show moreLast updated: 12 days ago
    • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    EXLChennai, Republic Of India, IN
    Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation.Lead the data validation...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Pipeline Architect

    Senior Data Pipeline Architect

    CoffeeBeansPune, Republic Of India, IN
    Hybrid (3 days WFO, 2 days WFH).Tech-lead in one of the feature teams, candidate need to be work along with team lead in handling the team without much guidance. Good communication and leadership sk...Show moreLast updated: 28 days ago
    • Promoted
    AI Data Architect

    AI Data Architect

    Tata Consultancy Servicesnagpur, maharashtra, in
    We are seeking an inventive Data Architect for AI with 8–15 years of experience to lead the strategic design and implementation of enterprise-scale AI solutions. ETL / ELT, Big Data cloud data solutio...Show moreLast updated: 16 days ago
    • Promoted
    Data Architect - Snowflake (Job Location : Kerala)

    Data Architect - Snowflake (Job Location : Kerala)

    Reflections Info Systemsnagpur, maharashtra, in
    We are looking for 10 + year experienced Data Architect with strong background in Snowflake, demonstrating leadership in technical design, architecture, and implementation of complex data solutions...Show moreLast updated: 12 days ago
    • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    TagChennai, Republic Of India, IN
    We are seeking a highly skilled.This role is a key part of our.Business Intelligence team, responsible for enabling robust data flows that power enterprise dashboards, analytics, and machine learni...Show moreLast updated: 30+ days ago
    • Promoted
    Data Architect

    Data Architect

    Tata Consultancy Servicesnagpur, maharashtra, in
    Greetings from TCS Human Resources Team!!!.Years of experience : 8 to 10 Years.Airflow • : Data pipeline orchestration.Data Form & DBT • : Data architecture and modeling. Architecture Design • : Scalable d...Show moreLast updated: 30+ days ago
    • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    JRD SystemsRepublic Of India, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Exult GlobalCochin, Republic Of India, IN
    Proficient in Python (Including popular python packages e.Strong background in distributed data processing and storage (e. Large scale (TBs of data) data engineering skills - Model data, create prod...Show moreLast updated: 30+ days ago
    • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    VAANTECHChennai, Republic Of India, IN
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago