Talent.com
This job offer is not available in your country.
Staff Software Engineer

Staff Software Engineer

BrightEdgeSolapur, IN
24 days ago
Job description

Staff Software Engineer, Data Ingestion

The Staff Software Engineer, Data Ingestion will be a critical individual contributor responsible for designing collection strategies, developing, and maintaining robust and scalable data pipelines. This role is at the heart of our data ecosystem, deliver new analytical software solution to access timely, accurate, and complete data for insights, products, and operational efficiency.

Key Responsibilities :

  • Design, develop, and maintain high-performance, fault-tolerant data ingestion pipelines using Python.
  • Integrate with diverse data sources (databases, APIs, streaming platforms, cloud storage, etc.).
  • Implement data transformation and cleansing logic during ingestion to ensure data quality.
  • Monitor and troubleshoot data ingestion pipelines, identifying and resolving issues promptly.
  • Collaborate with database engineers to optimize data models for fast consumption.
  • Evaluate and propose new technologies or frameworks to improve ingestion efficiency and reliability.
  • Develop and implement self-healing mechanisms for data pipelines to ensure continuity.
  • Define and uphold SLAs and SLOs for data freshness, completeness, and availability.
  • Participate in on-call rotation as needed for critical data pipeline issues

Key Skills :

  • 5+ years of experience, ideally with an engineering background, working in software product companies.
  • Extensive Python Expertise : Extensive experience in developing robust, production-grade applications with Python.
  • Data Collection & Integration : Proven experience collecting data from various sources (REST APIs, OAuth, GraphQL, Kafka, S3, SFTP, etc.).
  • Distributed Systems & Scalability : Strong understanding of distributed systems concepts, designing for scale, performance optimization, and fault tolerance.
  • Cloud Platforms : Experience with major cloud providers (AWS or GCP) and their data-related services (e.g., S3, EC2, Lambda, SQS, Kafka, Cloud Storage, GKE).
  • Database Fundamentals : Solid understanding of relational databases (SQL, schema design, indexing, query optimization). OLAP database experience is a plus (Hadoop)
  • Monitoring & Alerting : Experience with monitoring tools (e.g., Prometheus, Grafana) and setting up effective alerts.
  • Version Control : Proficiency with Git.
  • Containerization (Plus) : Experience with Docker and Kubernetes.
  • Streaming Technologies (Plus) : Experience with real-time data processing using Kafka, Flink, Spark Streaming.
  • Create a job alert for this search

    Staff Software Engineer • Solapur, IN

    Related jobs
    Sr. Software / Staff Engineer - Embedded Developer

    Sr. Software / Staff Engineer - Embedded Developer

    StrykerINDIA
    Passionate & Goal-oriented Engineers : .Passion for excellence in technology.Keeping the customer and requirements squarely in focus, people who deliver safe and robust solutions.People who go beyond...Show moreLast updated: 30+ days ago
    Staff Software Design and Test Engineer

    Staff Software Design and Test Engineer

    GE Healthcare LtdINDIA
    Be designing and developing functional and automated tests and test harnesses application for application under test.Review verification results looking for compliance to our quality management sys...Show moreLast updated: 30+ days ago
    Staff Software Development Engineer - Java, Kafka, AWS

    Staff Software Development Engineer - Java, Kafka, AWS

    ZscalerINDIA
    Serving thousands of enterprise customers around the world including 40 PERCENT of Fortune 500 companies, Zscaler (NASDAQ : ZS) was founded in 2007 with a mission to make the cloud a safe place to ...Show moreLast updated: 30+ days ago
    Staff Software Engineer

    Staff Software Engineer

    Oportun, IncIndia
    Remote
    Oportun (Nasdaq : OPRT) is a digital banking platform that puts its 2.With intelligent borrowing and savings, Oportun empowers members with the confidence to build a better financial future.Since in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Staff Software Engineer - Platform

    Senior Staff Software Engineer - Platform

    CoinbaseSolapur, IN
    Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Engineer

    Staff Engineer

    Platform9Solapur, IN
    Platform9 is a leader in simplifying enterprise private clouds.Our flagship product, Private Cloud Director, turns existing infrastructure into a full-featured private cloud.Enterprise IT teams can...Show moreLast updated: 2 days ago
    Staff Software Engineer

    Staff Software Engineer

    Weekday AIIN
    Remote
    Quick Apply
    This role is for one of the Weekday's clients.Salary range : Rs 7000000 - Rs 12000000 (ie INR 70-120 LPA).You will architect scalable solutions, drive best practices, and influence technical directi...Show moreLast updated: 30+ days ago
    • Promoted
    Software Support Engineer

    Software Support Engineer

    BeatRouteSolapur, IN
    BeatRoute is the world's only Goal-Driven AI platform for retail sales and distribution.It is an enterprise-grade, scalable platform that uses a unique Goal-Driven AI to deliver measurable business...Show moreLast updated: 2 days ago
    Staff Software Development Engineer

    Staff Software Development Engineer

    RazorpayINDIA
    Razorpay was founded by Shashank Kumar and Harshil Mathur in 2014.Razorpay is building a new-age digital banking hub (Neobank) for businesses in India with the mission to enable frictionless bankin...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Engineer

    Staff Engineer

    Jupiter AI LabsSolapur, IN
    Role : Member of Technical Staff.We are seeking a hands-on Staff Engineer / Tech Lead to join us at a very pivotalearly-growth phase. The ideal candidate combines deep executional ability (80% IC.OBJ...Show moreLast updated: 2 days ago
    • Promoted
    Frontend Software Engineer

    Frontend Software Engineer

    ContinuousSolapur, IN
    Salesforce, providing seamless scalability and reliability for our customers.Founded by industry veterans in recurring revenue and billing, we partner with companies of all sizes to solve their mos...Show moreLast updated: 11 days ago
    • Promoted
    Backend Software Engineer

    Backend Software Engineer

    IntelliasSolapur, IN
    Engineer with robust Quality Assurance experience to join our SWAT team working on payment integration.You will work closely with the product owner, area architect, and your team members to clarify...Show moreLast updated: 14 days ago
    Staff Firmware Engineer, Pixel System Software

    Staff Firmware Engineer, Pixel System Software

    Google India Pvt LtdINDIA
    Staff Firmware Engineer, Pixel System Software.New Taipei, Banqiao District, New Taipei City, Taiwan.Google welcomes people with disabilities. Bachelor's degree in Computer Science, Electrical Engin...Show moreLast updated: 30+ days ago
    Staff Software Architect

    Staff Software Architect

    GE HealthCareINDIA
    In this role, you will work closely with peer architects to contribute to the mission of the software function, by leading teams on delivery of quality products, innovation and development of team ...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer (Backend)

    Software Engineer (Backend)

    RECRIVIOSolapur, IN
    Software Development Engineer (Backend Expert).We’re building systems that run lean, fast, and reliably at scale.Software Development Engineer (Backend Expert). APIs, and infrastructure that power e...Show moreLast updated: 18 days ago
    Staff Software Development Engineer

    Staff Software Development Engineer

    trellixINDIA
    Staff Software Development Engineer.Trellix, the trusted CISO ally, is redefining the future of cybersecurity and soulful work. Our comprehensive, GenAI-powered platform helps organizations confront...Show moreLast updated: 30+ days ago
    Sr Staff Software Quality Engineer

    Sr Staff Software Quality Engineer

    ServiceNowINDIA
    It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today ServiceNow stands as a global market l...Show moreLast updated: 30+ days ago
    Staff Software Engineer

    Staff Software Engineer

    BloomreachIndia
    Our India team is a critical product development and innovation hub for the company, with many of the company’s key products and technology initiatives created and developed by this team.Bloomreach...Show moreLast updated: 30+ days ago
    Staff Engineer, Software Development Engineering (Apps)

    Staff Engineer, Software Development Engineering (Apps)

    WESTERN DIGITALINDIA
    Weve been storing the worlds data for more than 50 years.Once, it was the most important thing we could do for data.Now were helping the world capture, preserve, access and transform data in a way ...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer

    Software Engineer

    LTIMindtreeSolapur, IN
    We are hiring ServiceNow Developer – ITSM,Integration,CSM.Location : Across LTIMindtree Pan India location.Skills : ServiceNow Developer – ITSM. Experience on developing applications on ServiceNow pla...Show moreLast updated: 2 days ago