About Senzcraft :
Founded by IIM Bangalore and IEST Shibpur Alumni, Senzcraft is a hyper-automation company. Senzcraft vision is to Radically Simplify Today's Work. And Design Business Process For The Future. Using intelligent process automation technologies.
We have a suite of SaaS products and services, partnering with automation product companies.
Please visit our website - https : / / www.senzcraft.com for more details
Our AI Operations SaaS platform – https : / / MagicOps.ai
Senzcraft on linkedin ->
https : / / www.linkedin.com / company / senzcraft
Senzcraft is awarded by Analytics India Magazine in it’s report “State of AI in India” as a “Niche AI startup”. Senzcraft is also recognized by NY based SSON as a top hyper-automation solutions provider.
About the Role (Senior Data Engineer)
We are seeking Senior Data Engineer (5+ years of experience) profiles with strong expertise in design, build, and optimize scalable data pipelines to support real time data ingestion and transformation . The candidate must have hands-on experience with Apache Spark (including Spark Streaming and internals) , Airflow and / or similar orchestration platform. Candidate must be proficient on Azure or AWS cloud , with Databricks or similar toolset for data processing and analytics.
Key Responsibilities :
Design and Development of real-time data ingestion and transformation pipelines using SPARK.
Develop and orchestrate ETL workflows using Apache tech stack.
Collaborate with data scientists and analysts to optimize data models and queries using SQL .
Utilize Databricks for advanced data processing, transformation, and integration.
Build and manage data solutions on Azure or AWS cloud environments.
Ensure reliability, scalability, and performance of data systems.
Design, develop, and maintain scalable ETL / ELT pipelines using PySpark and Apache Spark .
Required Skills :
Hands-on experience with Apache Spark , Spark Streaming , and Spark internals .
Experience with Airflow for workflow orchestration.
Proficiency in Azure or AWS cloud services.
Practical experience with Databricks for data engineering workloads.
Familiarity with Terraform or CloudFormation will be added advantage.
Strong programming skills in Python , PySpark , and SQL .
Educational Qualification : Bachelor’s or Master’s degree in a technical field such as B.Tech, BE, MCA, or equivalent .
Experience : 5+ years
Location : Bangalore
Work Mode : Hybrid
Notice Period : Immediate joiners preferred, up to 15 days’ notice accepted
Senior Data Engineer • Hosur, Tamil Nadu, India