FoodTracker: A Real-time Food Detection Mobile Application by Deep Convolutional Neural Networks
Published in
arXiv.org(2019)External Links:
TL
TL;DR
A deep convolutional neural network merging with YOLO is built to achieve simultaneous multi-object recognition and localization with nearly 80% mean average precision and is well-suited for mobile devices with negligible inference time and small memory requirements with a deep learning algorithm.
Abstract
We present a mobile application made to recognize food items of multi-object meal from a single image in real-time, and then return the nutrition facts with components and approximate amounts. Our work is organized in two parts. First, we build a deep convolutional neural network merging with YOLO, a state-of-the-art detection strategy, to achieve simultaneous multi-object recognition and localization with nearly 80% mean average precision. Second, we adapt our model into a mobile application with extending function for nutrition analysis. After inferring and decoding the model output in the app side, we present detection results that include bounding box position and class label in either real-time or local mode. Our model is well-suited for mobile devices with negligible inference time and small memory requirements with a deep learning algorithm.
References24 items
1
Exploring Better Food Detection via Transfer Learning
2
A multi-task learning approach for meal assessment
3
Simultaneous estimation of food categories and calories with multi-task CNN
4
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
5