Full Stack + Data Engineering
Title : STC / LTC
Relevant Experience : 4+ Years
Location : Remote (Preferred Location : Chennai)
Type of Hire : Open to both Persons with Disabilities (PwD) and Non-PwD candidates
Availability : Immediate Joiners Preferred
Please fill this form and let us know if we can connect with you.
https : / / docs.google.com / forms / d / e / 1FAIpQLSdlr0DPXdGzsTffOP7HmDRhUVA7zvOCjk_5smKVmowTlTeBWA / viewform?usp=header
A Full-Stack Data Engineer is a professional who handles the entire data lifecycle , from data ingestion and processing to analysis and delivery, often combining skills from data engineering, software development, and data science.
Core Responsibilities
- Data Ingestion & ETL Pipelines
- Build and maintain ETL / ELT processes using tools like Apache Airflow , dbt , Apache NiFi , etc.
- Connect to APIs, scrape data, or use message queues like Kafka or RabbitMQ .
- Data Storage & Warehousing
- Design and manage databases and data warehouses like PostgreSQL , Snowflake , Big Query , Redshift .
- Optimize schema design, partitions, indexes.
- Data Processing
- Use distributed frameworks like Apache Spark , Databricks , or Flink for large-scale processing.
- Clean, transform, and validate data for use in analytics or ML.
- Backend Engineering
- Develop RESTful APIs and data services using Python (Fast API / Flask) , Node.js , or Java / Spring Boot .
- Implement authentication, error handling, and deployment pipelines.
- Frontend Dashboards (Optional but Valuable)
- Build or integrate with dashboards using React , Vue , or tools like Streamlit , Power BI , or Tableau .
- DevOps & Infrastructure
- Monitor performance, logging, and alerts with tools like Prometheus , Grafana , ELK stack .
- Version Control : Git, GitHub
- CI / CD : GitHub Actions, Jenkins, GitLab CI
- Cloud Platforms : AWS, GCP, Azure
- Containers : Docker, Kubernetes
Required Skills
Languages : Python, SQL, Shell scripting, possibly Scala or JavaDatabases : PostgreSQL, MySQL, MongoDB, Cassandra, SnowflakeTools : Airflow, dbt, Spark, Kafka, Git, DockerCloud Platforms : AWS (Glue, S3, Redshift), GCP (Big Query, Dataflow), AzureFrontend (Client-Side)
Languages / Tech : HTML, CSS, JavaScriptFrameworks : React, Angular, Vue.jsTools : Tailwind, Next.js, WebpackBackend (Server-Side)
Languages : Node.js, Python, Java, Go, RubyFrameworks : Express.js, Django, Flask, Spring BootAPIs : RESTful, Graph QLAuthentication : JWT, OAuth