Postgraduate DiplomaHealth, Biomechanics, Wearables & Operational Safety Applications open

Postgraduate Diploma in MCU/NPU Inference (TFLite/ONNX/TensorRT)

Online 800 h Postgraduate Diploma in MCU/NPU inference (TFLite/ONNX/TensorRT). 8 modules covering ISO/PAS 8800 (artificial intelligence in road vehicles), ISO 26262 (functional safety in automotive) and TensorFlow Lite / LiteRT. Assigned tutor and open enrolment.

Duration800 h
ModeOnline
LanguageEnglish
Start datesSet by the faculty
AwardSEIUM Institute diploma
Virtual lab · try it before you enrol

Take the controls.

Run a real engineering trade-off from this field. Move the sliders, watch the model react in real time and beat the challenge.

SIM · LIVE ●
Learning outcomes

What you will be able to do

01

Compare MCU, NPU and embedded GPU architectures for inference.

02

Design efficient models for limited resources.

03

Apply quantisation techniques and assess their impact on accuracy.

04

Deploy models with TensorFlow Lite on microcontrollers.

05

Export and run models with ONNX Runtime.

06

Optimise inference on embedded GPUs with TensorRT.

07

Put embedded inference systems into production and monitor them.

Profile

Who it's for

  • Embedded machine learning engineer who wants to specialise in Inference in MCU/NPUs (TFLite/ONNX/TensorRT).
  • Embedded software engineer who wants to specialise in Inference in MCU/NPUs (TFLite/ONNX/TensorRT).
  • Edge MLOps engineer who wants to specialise in Inference in MCU/NPUs (TFLite/ONNX/TensorRT).
  • Embedded computer vision developer who wants to specialise in Inference in MCU/NPUs (TFLite/ONNX/TensorRT).
  • AI hardware architect who wants to specialise in Inference in MCU/NPUs (TFLite/ONNX/TensorRT).
  • Model optimisation engineer who wants to specialise in Inference in MCU/NPUs (TFLite/ONNX/TensorRT).
  • Graduates in engineering or sciences seeking to enter consumer electronics.
Standards & tools

What you'll work with

  • ISO/PAS 8800 (artificial intelligence in road vehicles)
  • ISO 26262 (functional safety in automotive)
  • IEC 61508
  • ONNX specification
  • MISRA C:2012
  • ISO/IEC 22989 (AI concepts)
  • Regulation (EU) 2024/1689 (AI Act)
Syllabus

8 modules · 800 h

  1. 1.1Cortex-M and RISC-V microcontrollers
  2. 1.2DSP extensions and Helium (MVE)
  3. 1.3Embedded NPUs: Ethos-U and similar
  4. 1.4SoCs with accelerators: Jetson and Coral
  5. 1.5Memory hierarchy: SRAM, flash and DRAM
  6. 1.6Energy consumption and power budgets
  7. 1.7Metrics: latency, throughput and TOPS/W
  8. 1.8MLPerf Tiny benchmarks
  9. 1.9Platform selection by application
  10. 1.10Case study: comparing platforms for keyword spotting
  1. 2.1Lightweight architectures: MobileNet and EfficientNet
  2. 2.2Networks for time series and audio
  3. 2.3Depthwise separable convolutions
  4. 2.4Architecture search for MCUs: MCUNet
  5. 2.5Knowledge distillation
  6. 2.6Structured and unstructured pruning
  7. 2.7Low-rank factorisation
  8. 2.8Calculating MACs and activation memory
  9. 2.9The accuracy-efficiency trade-off
  10. 2.10Practice: training a compact model in Keras
  1. 3.1Fixed-point and integer representation
  2. 3.2Post-training quantisation
  3. 3.3Quantisation-aware training
  4. 3.4Per-tensor and per-channel quantisation
  5. 3.5Calibration with representative data
  6. 3.6INT8, INT4 and mixed precision
  7. 3.7Effects on accuracy and debugging
  8. 3.8Quantisation of activations and biases
  9. 3.9Compressed weight formats
  10. 3.10Lab: INT8 quantisation with TFLite Converter
  1. 4.1FlatBuffer conversion workflow
  2. 4.2TFLite Micro interpreter
  3. 4.3Operator resolution and registration
  4. 4.4Tensor arena and memory planning
  5. 4.5Optimised CMSIS-NN kernels
  6. 4.6Delegates for NPUs
  7. 4.7Deployment on STM32 and nRF boards
  8. 4.8Per-layer latency profiling
  9. 4.9On-device debugging
  10. 4.10Lab: deploying a classifier on Cortex-M4
  1. 5.1ONNX format: graph, operators and opsets
  2. 5.2Exporting from PyTorch
  3. 5.3Graph optimisation and operator fusion
  4. 5.4ONNX Runtime and execution providers
  5. 5.5Quantisation in ONNX Runtime
  6. 5.6Tools: Netron and onnx-simplifier
  7. 5.7Compilers: TVM and microTVM
  8. 5.8Interoperability between frameworks
  9. 5.9Numerical validation after conversion
  10. 5.10Practice: exporting and optimising a PyTorch model
  1. 6.1TensorRT architecture
  2. 6.2Building engines and optimisation profiles
  3. 6.3FP16 and INT8 precision with calibration
  4. 6.4Custom layers and plugins
  5. 6.5DLA on Jetson platforms
  6. 6.6DeepStream for video
  7. 6.7Memory management and CUDA streams
  8. 6.8Profiling with Nsight Systems
  9. 6.9Container deployment
  10. 6.10Lab: accelerating a detector with TensorRT on Jetson
  1. 7.1On-device sensor pre-processing
  2. 7.2Audio, video and IMU pipelines
  3. 7.3OTA model updates
  4. 7.4Model security and encryption
  5. 7.5Drift monitoring at the edge
  6. 7.6Federated and on-device learning
  7. 7.7Real-time requirements and RTOS
  8. 7.8Firmware testing and validation
  9. 7.9MLOps for embedded systems
  10. 7.10Case study: predictive maintenance with vibration on MCU
  1. 8.1Defining the use case
  2. 8.2Hardware selection
  3. 8.3Data collection and preparation
  4. 8.4Model design and training
  5. 8.5Optimisation and quantisation
  6. 8.6Deployment and profiling
  7. 8.7Field validation
  8. 8.8Power consumption and cost analysis
  9. 8.9Report and presentation
  10. 8.10Final review with the tutor
Methodology, software & labs

How you'll learn

Fully 100% online training on the SEIUM campus, with downloadable material, recorded classes and an assigned technical tutor. No fixed timetables: students progress at their own pace within the enrolment period, which makes it possible to combine study with work.

Each module combines theory, guided reading of the original standard and applied exercises. The working software is TensorFlow Lite / LiteRT, ONNX Runtime, NVIDIA TensorRT, STM32Cube.AI, Edge Impulse, in free, academic or evaluation versions. Tests are studied using real benchmarking procedures for latency and power consumption (MLPerf Tiny), microcontroller deployment, and accuracy comparisons after quantisation. Assessment is continuous per module plus the final integrating project.

Accreditable laboratories(EN ISO/IEC 17025) with a rotor test rig, EMC/Lightning pre-compliance, HIL/SIL, vibration/acoustics.
Evidence-oriented final project:safety case, test plan, compliance dossier and operating limits.
Industry-mentored:lecturers with a track record in training, , eVTOL/UAM and flight test.
Flexible mode of study(hybrid/online), international cohorts and support from SEIUM Career Services.
Ethics and safety:a safety-by-design approach, cyber-OT, DIH and compliance as pillars.
Capstone project

Build it end to end

Your final project follows the real engineering workflow, step by step, reviewed by your tutor.

Defining the use case

Compare MCU, NPU and embedded GPU architectures for inference.

Hardware selection

Design efficient models for limited resources.

Data collection and preparation

Apply quantisation techniques and assess their impact on accuracy.

Model design and training

Deploy models with TensorFlow Lite on microcontrollers.

Optimisation and quantisation

Export and run models with ONNX Runtime.

Career opportunities

Where this takes you

Embedded machine learning engineerEmbedded software engineerEdge MLOps engineerEmbedded computer vision developerAI hardware architectModel optimisation engineer
Admissions & scholarships

Requirements

  • Prior technical training or professional experience in the sector. A university degree is not required.
  • Internet connection and a computer capable of running the programme's software.
  • Sufficient level of Spanish to follow technical regulatory texts.

Ready to start?

Send your application today. Our admissions team replies within 72 hours with your study plan and funding options.

FAQ

Frequently asked questions

The programme comprises 800 total hours spread over 6 to 8 months. That is an average of 10 to 15 hours per week, compatible with a full-time job.

The programme works with TensorFlow Lite / LiteRT, ONNX Runtime, NVIDIA TensorRT, STM32Cube.AI, Edge Impulse. Free, academic or evaluation versions are used, and the tutor indicates the free alternative where one exists.

A SEIUM own diploma upon passing the continuous assessment and the integrating project. It is in-house training, not an official title from the Ministry.

Yes. Modules passed in a course or postgraduate diploma in the same area are recognised in the advanced programme. Check the recognition policy when you enrol.

Postgraduate Diploma in MCU/NPU Inference (TFLite/ONNX/TensorRT)Enrol
Scroll to Top
SEIUM – Institute of Advanced Engineering
Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.