Talent.com
This job offer is not available in your country.
Staff Software Engineer

Staff Software Engineer

BrightEdgeSolapur, IN
24 days ago
Job description

Staff Software Engineer, Data Ingestion

The Staff Software Engineer, Data Ingestion will be a critical individual contributor responsible for designing collection strategies, developing, and maintaining robust and scalable data pipelines. This role is at the heart of our data ecosystem, deliver new analytical software solution to access timely, accurate, and complete data for insights, products, and operational efficiency.

Key Responsibilities :

  • Design, develop, and maintain high-performance, fault-tolerant data ingestion pipelines using Python.
  • Integrate with diverse data sources (databases, APIs, streaming platforms, cloud storage, etc.).
  • Implement data transformation and cleansing logic during ingestion to ensure data quality.
  • Monitor and troubleshoot data ingestion pipelines, identifying and resolving issues promptly.
  • Collaborate with database engineers to optimize data models for fast consumption.
  • Evaluate and propose new technologies or frameworks to improve ingestion efficiency and reliability.
  • Develop and implement self-healing mechanisms for data pipelines to ensure continuity.
  • Define and uphold SLAs and SLOs for data freshness, completeness, and availability.
  • Participate in on-call rotation as needed for critical data pipeline issues

Key Skills :

  • 5+ years of experience, ideally with an engineering background, working in software product companies.
  • Extensive Python Expertise : Extensive experience in developing robust, production-grade applications with Python.
  • Data Collection & Integration : Proven experience collecting data from various sources (REST APIs, OAuth, GraphQL, Kafka, S3, SFTP, etc.).
  • Distributed Systems & Scalability : Strong understanding of distributed systems concepts, designing for scale, performance optimization, and fault tolerance.
  • Cloud Platforms : Experience with major cloud providers (AWS or GCP) and their data-related services (e.g., S3, EC2, Lambda, SQS, Kafka, Cloud Storage, GKE).
  • Database Fundamentals : Solid understanding of relational databases (SQL, schema design, indexing, query optimization). OLAP database experience is a plus (Hadoop)
  • Monitoring & Alerting : Experience with monitoring tools (e.g., Prometheus, Grafana) and setting up effective alerts.
  • Version Control : Proficiency with Git.
  • Containerization (Plus) : Experience with Docker and Kubernetes.
  • Streaming Technologies (Plus) : Experience with real-time data processing using Kafka, Flink, Spark Streaming.
  • Create a job alert for this search

    Staff Software Engineer • Solapur, IN

    Related jobs
    • Promoted
    Staff Software Engineer-Java

    Staff Software Engineer-Java

    EgnyteSolapur, IN
    Title : Staff Software Engineer.Egnyte is a place where we spark opportunities for amazing people.We believe that every role has meaning, and every Egnyter should be respected.With 17,000 customers ...Show moreLast updated: 2 days ago
    Sr. Software / Staff Engineer - Embedded Developer

    Sr. Software / Staff Engineer - Embedded Developer

    StrykerINDIA
    Passionate & Goal-oriented Engineers : .Passion for excellence in technology.Keeping the customer and requirements squarely in focus, people who deliver safe and robust solutions.People who go beyond...Show moreLast updated: 30+ days ago
    Staff Software Design and Test Engineer

    Staff Software Design and Test Engineer

    GE Healthcare LtdINDIA
    Be designing and developing functional and automated tests and test harnesses application for application under test.Review verification results looking for compliance to our quality management sys...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer

    Software Engineer

    Komfy Trip LLPSolapur, IN
    Komfy Trip LLP specializes in crafting seamless, personalized travel experiences for individuals.From budget-friendly adventures to luxurious getaways, we handle every detail, ensuring a stress-fre...Show moreLast updated: 2 days ago
    Staff Software Engineer

    Staff Software Engineer

    Oportun, IncIndia
    Remote
    Oportun (Nasdaq : OPRT) is a digital banking platform that puts its 2.With intelligent borrowing and savings, Oportun empowers members with the confidence to build a better financial future.Since in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Staff Software Engineer - Platform

    Senior Staff Software Engineer - Platform

    CoinbaseSolapur, IN
    Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Engineer

    Staff Engineer

    Platform9Solapur, IN
    Platform9 is a leader in simplifying enterprise private clouds.Our flagship product, Private Cloud Director, turns existing infrastructure into a full-featured private cloud.Enterprise IT teams can...Show moreLast updated: 2 days ago
    Staff Software Engineer

    Staff Software Engineer

    Weekday AIIN
    Remote
    Quick Apply
    This role is for one of the Weekday's clients.Salary range : Rs 7000000 - Rs 12000000 (ie INR 70-120 LPA).You will architect scalable solutions, drive best practices, and influence technical directi...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Software Engineer

    Staff Software Engineer

    First American (India)Solapur, IN
    At First American (India), we don’t just build software—we build the future of real estate technology.Our people-first culture empowers bold thinkers and passionate technologists to solve real-worl...Show moreLast updated: 24 days ago
    • Promoted
    Software Engineer

    Software Engineer

    RevXSolapur, IN
    Software Development Engineer (SDE-I).Reports to : Engineering Manager.This role is ideally suited for individuals who possess a strong passion for writing clean, efficient, and scalable code, and w...Show moreLast updated: 2 days ago
    Staff Software Development Engineer

    Staff Software Development Engineer

    RazorpayINDIA
    Razorpay was founded by Shashank Kumar and Harshil Mathur in 2014.Razorpay is building a new-age digital banking hub (Neobank) for businesses in India with the mission to enable frictionless bankin...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Engineer

    Staff Engineer

    Jupiter AI LabsSolapur, IN
    Role : Member of Technical Staff.We are seeking a hands-on Staff Engineer / Tech Lead to join us at a very pivotalearly-growth phase. The ideal candidate combines deep executional ability (80% IC.OBJ...Show moreLast updated: 2 days ago
    Staff Firmware Engineer, Pixel System Software

    Staff Firmware Engineer, Pixel System Software

    Google India Pvt LtdINDIA
    Staff Firmware Engineer, Pixel System Software.New Taipei, Banqiao District, New Taipei City, Taiwan.Google welcomes people with disabilities. Bachelor's degree in Computer Science, Electrical Engin...Show moreLast updated: 30+ days ago
    Staff Software Development Engineer

    Staff Software Development Engineer

    trellixINDIA
    Staff Software Development Engineer.Trellix, the trusted CISO ally, is redefining the future of cybersecurity and soulful work. Our comprehensive, GenAI-powered platform helps organizations confront...Show moreLast updated: 30+ days ago
    Sr Staff Software Quality Engineer

    Sr Staff Software Quality Engineer

    ServiceNowINDIA
    It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today ServiceNow stands as a global market l...Show moreLast updated: 30+ days ago
    Staff Software Engineer

    Staff Software Engineer

    BloomreachIndia
    Our India team is a critical product development and innovation hub for the company, with many of the company’s key products and technology initiatives created and developed by this team.Bloomreach...Show moreLast updated: 30+ days ago
    Staff Engineer, Software Development Engineering (Apps)

    Staff Engineer, Software Development Engineering (Apps)

    WESTERN DIGITALINDIA
    Weve been storing the worlds data for more than 50 years.Once, it was the most important thing we could do for data.Now were helping the world capture, preserve, access and transform data in a way ...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer

    Software Engineer

    EYEGLOBAL SOLUTIONS PVT. LTD.Solapur, IN
    Role : Quadient Developer - CCM.Watch JD for more details : https : / / youtu.Unlock Your Future with Expert Recruitment!.Show moreLast updated: 11 days ago