Build & maintain high tps, reliable, performant and cost-effective data collection and extraction modules using Node.js & Python, using streaming solutions like Kafka.
Deploy, maintain and support these modules on AWS & GCP cloud.
Index, archive and retain necessary data in multiple persistence stores like Object stores(S3), Key value store (Dynamo DB), and Elastic Search based on the use case.
Manage the quality of data collected using data quality libraries built using SQL / Python / Spark on AWS Glue and exposed as Dashboards for monitoring using AWS Quick sight and Kibana.
Restfully abstract the data collected to the downstream applications through a Node.js backend.
Collaborate well with engineers, researchers, and data implementation specialists to design and create advanced, elegant and efficient end to end competitive intelligence solutions.
Qualifications & Experience :
Proven experience 4+ years as a Software Development Engineer who has built, deployed and operationally supported systems in production.
Excellent knowledge of programming languages such as Node.JS, Python
Strong understanding of software design patterns, algorithms, and data structures
Experience with SQL & NoSQL databases.
Good communication and collaboration skills.
Works with good ownership and accountability.
Ability to work in a fast-paced and dynamic environment.
Experience in writing high volume / tps, reliable crawlers and scrapers is a plus.
Bachelor's or master's degree in computer science or a related field.
Create a job alert for this search
Software Engineer Ii • dombivli, maharashtra, in
Related jobs
Promoted
Software Development Engineer II
ClearDemandthane, maharashtra, in
Build & maintain high tps, reliable, performant and cost-effective data collection and extraction modules using Node.Python, using streaming solutions like Kafka.
Deploy, maintain and support these ...Show moreLast updated: 3 days ago
Promoted
Software Engineer
Seceon Inc.Kalyan-Dombivli, IN
Seceon delivers a unified cybersecurity platform that enables enterprises, MSPs, and MSSPs to detect, respond, and remediate threats in real-time.
With AI-powered threat detection and auto-response,...Show moreLast updated: 30+ days ago
Promoted
Senior Software Engineer
WiseEngage Private Limiteddombivli, maharashtra, in
We are seeking a highly skilled Senior Software Engineer to execute our strategy preferably experienced in.Financial Services / Procurement domain.
SaaS platform using latest technologies like.ReactJS...Show moreLast updated: 12 days ago
Promoted
Software Development Engineer II - Backend Engineering
SaShr ConsultantsMumbai
We are looking for an experienced SDE-2 (Backend Engineer) to lead the design and development of scalable backend systems.
You will own critical components in Golang, architect event-driven solution...Show moreLast updated: 30+ days ago
Promoted
Sciative Solutions - Software Development Engineer III - SaaS Applications
Sciative Solution Private LimitedNavi Mumbai
Job Responsibilities : - Hands on (Full Stack) Web application design and development concentrating on Artificial intelligence using big data technologies.Facilitate s...Show moreLast updated: 30+ days ago
Promoted
Lead Software Engineer
Cimpress Indiadombivli, maharashtra, in
As a Lead Software Engineer, you will join a motivated and collaborative engineering team focused on building the platform that powers scalable, personalized design solutions for Vista’s customers....Show moreLast updated: 12 days ago
Promoted
Software Engineer
GleantapMumbai, IN
Gleantap is an intelligent customer experience platform designed for fitness and wellness clubs, enabling them to use data to run powerful sales and marketing campaigns.
Gleantap optimizes communica...Show moreLast updated: 3 days ago
Promoted
Software Engineer
DroisysKalyan-Dombivli, IN
Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution.
We leverage deep technical expertise, Agil...Show moreLast updated: 30+ days ago
Promoted
Software Engineer
RevXmumbai city, maharashtra, in
At RevX, we operate at scale — handling.We’re looking for a passionate Software Development Engineer to help us build and deliver high-performance systems and features that power customer engagemen...Show moreLast updated: 12 days ago
Promoted
Software Engineer
PluntraKalyan-Dombivli, IN
Pluntra is a secure video conferencing platform designed specifically for telemedicine, facilitating connections between patients and healthcare providers with ease.
It supports real-time consultati...Show moreLast updated: 3 days ago
Promoted
Associate Software Engineer
Quarticthane, maharashtra, in
Our platform turns raw plant data into real-time intelligence that drives smarter decisions—whether it’s predicting equipment failures, optimizing batches, or improving product quality.Built on mod...Show moreLast updated: 12 days ago
Promoted
Software Engineer
Ovelo incKalyan-Dombivli, IN
Ovelo is an advanced AI platform that empowers users to generate, enhance, and transform images with remarkable ease.Combining cutting-edge artificial intelligence with intuitive design tools, Ovel...Show moreLast updated: 4 days ago
Promoted
Sr Software Engineer– ScienceLogic
CDWThane, IN
CDW is a leading provider of technology solutions for business, government, education, and healthcare.Our mission is to help our customers achieve their goals by providing innovative technology sol...Show moreLast updated: 18 days ago
Promoted
Software Development Engineer II - Android Platform
XL AdvisorsMumbai
About KiwiTech : KiwiTech is a startup accelerator and technology services company dedicated to helping emerging entrepreneurs transform their visionary ideas into cu...Show moreLast updated: 21 days ago
Promoted
Software Development Engineer 2
noonMumbai, IN
On December 12th, 2017, noon launched its consumer platform in Saudi Arabia and the UAE, expanding to Egypt in February 2019.
The noon ecosystem of services now includes marketplaces for food delive...Show moreLast updated: 1 day ago
Promoted
Lead Software Development Engineer
RevXMumbai, IN
Software Lead Software Engineer.RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.
We're all about taking your app businesses to a new...Show moreLast updated: 30+ days ago
Promoted
Software Engineer III - (Python / C#)
techjaysmumbai, maharashtra, in
What makes Techjays an inspiring place to work.At Techjays, we are driving the future of artificial intelligence with a bold mission to empower businesses worldwide by helping them build AI solutio...Show moreLast updated: 12 days ago
Promoted
Software Development Engineer 2
Media.netmumbai, maharashtra, in
While our HQ is in Dubai, our employees are spread across key operation centers in New York, Los Angeles, Dubai, Zurich, Mumbai and Bangalore.
It’s gotthe culture of a startupwith the stabilityand r...Show moreLast updated: 12 days ago
Promoted
Software development engineer
100Trixmumbai, maharashtra, in
Fortune 100, DAX 40 and FTSE 100 veterans.We offer premium product engineering services to clients in the US, Australia, Asia and Europe.
You will work closely with stakeholders, product owners, and...Show moreLast updated: 3 days ago
Promoted
Software Development Engineer II - DevOps
HyreSnapMumbai
Description : We are seeking a skilled and motivated SDE 2 with a strong DevOps background to join our team.As an SDE2 - DevOps, you will play a crucial role in maint...Show moreLast updated: 9 days ago