Data Engineer (Strong with Building data connectors)
Location : Remote
Key Skills : Python, Data Connectors, Metadata, API Integration-Rest / GraphQL
Job Description :
1. Must have proven background in building data connectors.
2. Experience software engineering in JAVA, Rust, GO, etc, but Python is desired
3. Experience in coding agents in critical use
4. Understanding in relational and non-relational databases, metadata, catalog and Lineage.
Required Experience
- Proven custom connector development - Built data connectors / integrators from scratch (not just configuring ETL pipelines and scripts)
- Strong Software engineering fundamentals - Wrote production-quality code in a popular language like Java, Go, Rust, but preferably Python.
- API integration expertise - REST / GraphQL clients with retry logic, rate limiting, pagination, and connection pooling, etc.
- Database systems knowledge - Hands-on experience with relational (PostgreSQL, MySQL, Snowflake), NoSQL databases, and / or BI Tools
- Metadata & lineage understanding - Can extract schemas, understands table / column-level lineage from SQL, APIs, or system catalogs
Technical Skills
Performance optimizationTesting rigorScale awarenessSoftware design patternsProblem-Solving & QualitySystematic debuggingSecurity-consciousAutonomous systems thinkingLLM-assisted development with critical thinkingBonus Qualifications
Additional languages - Java, Rust, or Go experience (Python still required)Data platform familiarity - Snowflake, Databricks, BigQuery, or BI tools (Tableau, Looker, Power BI)Open source contributions - DataHub, dbt, Airflow, or similar data tools