Embedded AI Engineer

Responsibilities :

Deep Learning Model Conversion : Convert and adapt deep learning network architectures (e.g., from PyTorch) for deployment on various embedded platforms.

Quantization-Aware Training (QAT) : Implement and fine-tune Quantization-Aware Training techniques to optimize model performance and reduce memory footprint while maintaining accuracy.

Model Optimization : Perform extensive model optimization techniques, including pruning, quantization (post-training and QAT), and network architecture search, to achieve desired latency, power, and memory targets.

Runtime Integration : Integrate optimized deep learning models with embedded runtime environments and hardware accelerators.

Performance Profiling & Tuning : Analyze and profile model performance on target embedded hardware, identifying bottlenecks and implementing solutions for real-time inference.

Number Format Conversion : Work with various number formats (e.g., FP32, FP16, INT8) and develop strategies for efficient conversion and utilization on embedded processors.

Toolchain Development & Utilization : Utilize and contribute to the development of custom conversion tools and optimization scripts to streamline the deployment pipeline.

Skills Required :

Experience : 5+ years of experience in embedded software development with a strong focus on AI / Machine Learning deployment.

Programming Skills : Proficient in Python for AI development and scripting.

Deep Learning Frameworks : Hands-on experience with deep learning frameworks such as PyTorch. Experience with TensorFlow / Keras is a plus.

Embedded Systems : Strong understanding of embedded system architectures, microcontrollers, DSPs, and / or FPGAs.

Optimization Techniques : Proven experience with deep learning model optimization techniques (quantization, pruning, knowledge distillation).

Number Formats : Familiarity with different number formats (e.g., FP32, FP16, INT8) and their implications for embedded inference.

Conversion Tools : Experience with model conversion tools (e.g., ONNX, OpenVINO, TensorRT, TVM).

Problem-Solving : Excellent analytical and problem-solving skills, with a strong ability to debug and optimize complex systems.

Experience with C / C++ for embedded development.

Familiarity with hardware acceleration (e.g., NPUs, GPUs on edge devices).