Food is life. Everyone has to eat. Indeed, if you live to be 80, you will have consumed food more than 87,000 times. Our laboratory is tackling a variety of food related issues through image and video processing, natural language processing, spoken dialogue and chat communication systems, information retrieval, and machine learning. Students in our laboratory share space and resources with the Yamasaki and Matsui Lab.
To understand the nutrients we consume, the first step is to record what we eat. However, keeping track of every meal and snack should be challenging. We are developing a food logging app based on deep image recognition technology called FoodLog Athl. When you upload an image of your meal, the app detects the area of each food and recognizes the dish name, allowing it to estimate the nutritional value of that meal. The users who have access to a dietitian’s support can share their food records with the dietitians and communicate via chat.
For example, even the same dish, "nikujaga," can have significantly different nutritional values depending on the recipe. We are developing a meal nutrition calculation app, RecipeLog, that estimates the types and quantities of ingredients from meal images, allowing for detailed nutritional calculations. The app features functionalities enabling users to assess their meals by visualizing how the nutritional values calculated from their created ingredient list fulfill their daily recommended intake.
Food frequency questionnaires (FFQs) are commonly used in cohort studies involving large numbers of participants. In this study, we aim to develop a system that automatically converts dietary records̶which are initially completed by participants and then supplemented by dietitians through interviews̶into a data format suitable for nutritional calculations based on standard food composition tables, by fine-tuning a large language model.
We are developing technology to automatically monitor land-use changes associated with mineral resource extraction activities and artisanal and small-scale gold mining (ASGM) using satellite imagery. We are also conducting research on large-scale language models and large-scale multimodal models designed to semi-automatically update and expand the Total Material Requirement (TMR) database̶which tracks the total material requirements for food production and distribution̶that they have built manually.