Java / Scala Connector SDK Developer / Lead

Job Title : Java / Scala Connector SDK Developer / Lead

Location : Chennai

Employment Type : Full-Time / Contract

Joining : Immediate (Preferred)

Tech Stack : Java (JDK 8+) and Scala, Gradle / Maven, Public Connector SDKs, ODBC, REST, JDBC, PF4J, SLF4J, POI, Data Fabric

We are seeking an experienced Java / Scala Developer to design, develop, and optimize connectors using an open-source SDK framework. This role will address a comprehensive backlog of connector requirements, encompassing data cataloging, synchronization, management, and integrations for heterogeneous systems. The developer will contribute to an enterprise-grade framework that supports metadata extraction, real-time synchronization, and efficient data management, facilitating a marketplace for extensible connectors within data fabric environments.

Responsibilities

Develop Connectors : Build and maintain SDK-based connectors for diverse data sources, ensuring robust support for data cataloging, synchronization, management, and integrations in data fabric architectures.

Implement SDK Interfaces : Utilize the SDK's factory and connection patterns to create modular components for metadata ingestion, validation, synchronization, and resource management across the backlog, incorporating data fabric principles for hybrid data orchestration.

Backlog Prioritization : Collaborate on resolving a portfolio of connector needs, including data catalog enhancements, synchronization workflows, and integration pipelines for 20+ systems, leveraging concepts from data fabrics and similar tools.

Framework Enhancement : Abstract and generalize the SDK architecture to support versioning, CI / CD integration, plugin deployment, data management protocols, real-time synchronization mechanisms, and seamless integration with data fabric platforms.

Logging and Monitoring : Integrate standard logging mechanisms (SLF4J) to facilitate debugging, performance tracking, and compliance in enterprise data environments, aligned with data fabric governance standards.

Team Collaboration : Work within a multidisciplinary pod model, including data engineers and architects, to deliver solutions in iterative sprints focused on connector SDK development and data fabric compatibility.

Documentation and Deployment : Package connectors for marketplace distribution, provide comprehensive documentation on data catalog integration, synchronization processes, management features, and data fabric orchestration.

Required Qualifications

Experience : 3+ years in Java / Scala development, with proven expertise in API integrations, data synchronization, and metadata handling within data fabric or similar architectures.

Technical Skills :

Proficiency in Java (JDK 8+) and Scala, along with build tools like Gradle or Maven.

Familiarity with file parsing libraries (Apache POI) and data access protocols (ODBC, REST, JDBC).

Understanding of logging APIs (SLF4J) and plugin frameworks (PF4J) for modular development.

Soft Skills : Strong analytical abilities, effective collaboration in team settings, and precise documentation skills.

Education : Bachelor’s degree in computer science, Information Technology, or a related field (or equivalent professional experience).

Preferred Qualifications

SDK Expertise : Hands-on experience with open-source connector SDKs or similar plugin frameworks (PF4J), with a focus on connector SDK development for data catalogs and integrations in data fabric environments.

Integration Knowledge : Background in data intelligence platforms, with exposure to hybrid environments and tools like Apache Camel or ETL frameworks for synchronization and management, including data fabric implementations.

Enterprise Tools : Familiarity with metadata catalogs, governance practices, and real-time data processing in multi-source ecosystems, such as Data Fabric or comparable solutions (Microsoft Fabric, Denodo).

Additional Skills : Proficiency in handling diverse data sources, including legacy systems and cloud APIs, emphasizing scalability, performance, and data management standards within unified data architectures.

Key Deliverables

A suite of SDK-based connectors addressing the full backlog, with advanced metadata synchronization and management capabilities integrated into data fabric workflows.

An abstracted framework design supporting plugin modularity, data catalog integration, marketplace deployment, and data fabric orchestration.

Sprint-based outputs, including prototypes for high-priority integrations and a roadmap for ongoing enhancements in synchronization and management.

Comprehensive testing and documentation to ensure reliability in enterprise deployments.

To Apply

Send your CV to and a Cover Letter (Important) in the format below .

Cover Letter : ( To be Submitted along with the CV )

1. Hands on Experience Self Rating Levels ( 1 to 5) :

Java Development (JDK 8+)

Scala Development

Build Tools (Gradle or Maven)

Data Access Protocols (ODBC, REST, JDBC)

Open-Source Connector SDKs

Plugin Frameworks and Logging APIs (PF4J, SLF4J)

Data Fabric Experience

Metadata Catalogs and Governance

File Parsing Libraries & Real-Time Data Processing

Handling Diverse Data Sources

2. Expectations : Current Location

Current Organization

Current CTC

Expected CTC

Availability to Join / Notice Period

Open to come to Office Location (Chennai)

3. What is your understanding of the role and responsibilities?

4. Why do you think you are a fit for the role?

5. Hands-on Project Experience highlight details on above self-rating skills (If any)