Performance Evaluation of Split Computing with TinyML on IoT Devices
2024 IEEE 21ST CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC(2024)
Abstract
The proliferation of Internet of Things (IoT) devices has sparked a growing demand for lightweight and energy-efficient machine learning solutions, leading to the emergence of Tiny Machine Learning (TinyML). This paper presents a thorough evaluation of TinyML, encompassing its performance metrics, challenges, and prospects, focused on the use of Split Computing. Split Computing allows to offload a subset of layers of a neural network to a more powerful Edge server, to achieve a faster computation hence lower inference latency. We evaluate our proposal on a real testbed with ESP32 microcontrollers with different neural network structures, highlighting the benefits of split computing for IoT devices with varying conditions. Our results indicate that split computing on IoT devices is viable and can bring benefits particularly in heavy load scenarios where the network conditions may rapidly change.
MoreTranslated text
Key words
tinyML,performance evaluation,split computing
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined