Streamsets Developer

Greetings from TCS!!!!!!!

TCS Hiring for StreamSets Developer

Location : Hyderabad, Chennai, Indore, Noida, Pune, Kolkata

Experience Range : 5 to 10 yrs

Job Description :

Required Technical Skill Set :

Streamsets Data Collector to design, UnitTests, Deploy, Operate and maintain pipelines that streaming and batch jobs

Must Have :

1. Hands-on experience with Streamsets (especially with Data Collectors and Control Hub)

2. Strong knowledge on SQL , ETL / ELT pipelines, and data integration patterns

3. Experience with real-time data processing and stream processing frameworks.

4. Experience with cloud environment and Data Lake / Warehouse .

5. Familiarity with Source control tools (e.g, Git) and CI / CD pipelines

6. Knowledge of Python , Scala or Java for scripting and automation.

7. Understanding data privacy, compliance, and governance framework

Responsibility of / Expectations from the Role

• Design, develop and deploy end-to-end data pipelines using StreamSets Data collector and StreamSets Control Hub.
• Integrate data from diverse sources including relational databases, cloud storage (AWS / Azure / GCP), APIs, and streaming platforms like Kafka .
• Collaborate with data architects and business analysts to understand data requirements and implement solutions accordingly.
• Monitor data flows and troubleshoot issues related to data quality, latency, and pipeline failure.
• Optimize Pipelines performance, reliability, and scalability.