Data Engineer

Data Engineer (Strong with Building data connectors)

Location : Remote

Key Skills : Python, Data Connectors, Metadata, API Integration-Rest / GraphQL

Job Description :

1. Must have proven background in building data connectors.

2. Experience software engineering in JAVA, Rust, GO, etc, but Python is desired

3. Experience in coding agents in critical use

4. Understanding in relational and non-relational databases, metadata, catalog and Lineage.

Required Experience

Proven custom connector development - Built data connectors / integrators from scratch (not just configuring ETL pipelines and scripts)

Strong Software engineering fundamentals - Wrote production-quality code in a popular language like Java, Go, Rust, but preferably Python.

API integration expertise - REST / GraphQL clients with retry logic, rate limiting, pagination, and connection pooling, etc.

Database systems knowledge - Hands-on experience with relational (PostgreSQL, MySQL, Snowflake), NoSQL databases, and / or BI Tools

Metadata & lineage understanding - Can extract schemas, understands table / column-level lineage from SQL, APIs, or system catalogs

Technical Skills

Performance optimization

Testing rigor

Scale awareness

Software design patterns

Problem-Solving & Quality

Systematic debugging

Security-conscious

Autonomous systems thinking

LLM-assisted development with critical thinking

Bonus Qualifications

Additional languages - Java, Rust, or Go experience (Python still required)

Data platform familiarity - Snowflake, Databricks, BigQuery, or BI tools (Tableau, Looker, Power BI)

Open source contributions - DataHub, dbt, Airflow, or similar data tools