DeepNOVA: a deep learning NOVA classifier for food images

Shady Elbassuoni, Hala Ghattas, Jalila El Ati, Zoulfikar Shmayssani, Sarah Katerji, Yorgo Zoughbi, Aline Semaan, Christelle Akl, Houda Ben Gharbia, Sonia Sassi

Research output: Contribution to journalA1: Web of Science-articlepeer-review

2 Downloads (Pure)

Abstract

Assessing the healthiness of food items in images has gained attention in both the computer vision and the nutrition fields. However, such task is generally a difficult one as food images are captured in various settings and thus are usually non-homogeneous. Moreover, assessing how healthy a food item is requires nutritional expertise and knowledge of the constituents of the food item and how it is processed. In this manuscript, we propose an end-to-end deep learning approach that can detect and localize various food items in a given food image using a customized object detection model. Our approach then assesses how healthy each detected food item is by classifying it into one or more of the four NOVA groups (Unprocessed Food, Processed Culinary Ingredients, Processed Food, and Ultra-processed Food). To train our food item detection model, we used two public datasets and a custom one we created ourselves and which contains images of food taken using wearable cameras. To train the NOVA food classifier, we use the custom dataset we created ourselves and that was manually labeled by expert nutritionists. Our food item detection model achieved a mAP of 0.90 and the NOVA food classifier achieved an average F1-score of 0.86 on test data.

Original languageEnglish
JournalIEEE Access
Volume10
Pages (from-to)128523-128535
Number of pages13
ISSN2169-3536
DOIs
Publication statusPublished - 2022

Keywords

  • Food images
  • NOVA food classification
  • deep learning
  • nutrition

Fingerprint

Dive into the research topics of 'DeepNOVA: a deep learning NOVA classifier for food images'. Together they form a unique fingerprint.

Cite this