January 19, 2016
This smartphone technology 3-D maps your meal and counts its calories
NutriRay3D combines laser mapping technology with a smartphone app to estimate the calories and other nutritional content on a plate of food.University of Washington
How many calories are on the plate of food you’re about to eat?
You could eyeball it, but science says you’d probably underestimate. You could painstakingly weigh each ingredient in that salad or burger or look up items in a smartphone app, but that requires time and attention to detail.
A new laser mapping technology and smartphone app developed by University of Washington electrical engineers called NutriRay3D allows you to point your phone at a plate of food and get an accurate count of the total calories and nutrition.
The team launched a crowdfunding campaign to transform a research device developed for nutritional epidemiologists into a consumer product aimed at nutrition-obsessed athletes, health-conscious eaters or people aiming to shed pounds. (Update: The crowdfunding campaign was temporarily suspended on Jan. 21 to address issues of intellectual property and degree of involvement of team participants.)
“If you’re trying to lose weight, there are a lot of cell phone applications out there but you still have to measure or somehow guesstimate how much you’re eating,” said UW electrical engineering doctoral student Sep Makhsous. “What we’re doing is removing the tedious work people are doing and automating one of biggest roadblocks to accurate calorie counts.”
Using laser-based 3-D reconstruction techniques, the NutriRay3D device can calculate the caloric content of 9,000 different types of food. In initial user studies, it estimated nutritional content with between 87.5 and 91 percent accuracy. Other methods such as paper logs that rely on people self-reporting what they eat have much lower accuracy.
With additional funding, the research team aims to manufacture a small laser accessory module that connects to the phone’s power charging port.NutriRay3D
If the crowdfunding campaign is successful, the team aims to bring a consumer product priced between $150 and $200 to market by the end of the year.
A laser accessory that connects to a smartphone projects a grid of dots onto a plate or bowl and precisely calculates the volume of food. From those measurements, the app estimates the nutritional content of a particular slab of steak or a handful of popcorn or a bowl of cereal and milk.
“It creates a 3-D map based on where the dots align, and then you can put them all together to get the actual volume of the food,” said Makhsous. “And estimating these portion sizes is where average people and other calorie counting methods often fall short.”
By crosschecking those measurements against an extensive database of foods, the app calculates the calories, sugars, protein, fats, vitamins and other nutritional content on the plate. The NutriRay3D app can identify basic foods — such as a banana or spaghetti or oatmeal — on its own but allows users to either speak into the phone or manually enter details about more complicated meals.
Users can rely on the app’s database of 9000 different foods or use the phone’s keyboard or voice recognition software to provide detailed nutritional and caloric data about what they are eating.NutriRay3D
With that input, the app can differentiate between a piece of grilled salmon with a lighter yogurt hollandaise sauce or a higher-calorie one, or between a peanut butter or soy butter sandwich. It uses standard nutritional information for meals with mixed ingredients, such as lentil soup. For even more accurate estimates, though, users can enter and share detailed recipes for meals they commonly make.
The UW’s laser-based technology was originally developed to assist cancer researchers studying the links between food intake and disease, which required participants in their clinical studies to painstakingly record and track the nutritional content of the food they consumed.
“Traditionally, they gave people a pen and paper and asked them to record everything they ate and fill out detailed questionnaires,” said Alexander Mamishev, a UW electrical engineering professor who oversaw the development of the NutriRay3D device. “But it’s been shown scientifically that people generally aren’t diligent enough or they forget or sometimes they just lie because it’s too much work.”
To help minimize those errors, the research team from the UW Sensors, Energy and Automation Laboratory employed a 3-D mapping technique that’s been used on larger spaces such as a room or a car but that had been difficult on such a small scale as a carrot or cupcake. They also had to account for quirks of certain foods, including calculating the ratio of air to actual food in a bowl of potato chips.
Additional funding will allow the NutriRay3D team, which includes Mamishev and 5 students, to do more extensive user testing, make additional changes to the device based on that feedback and begin the production process.
“Once you start measuring something, it becomes different from a simple observation. In personal fitness, for instance, once people start measuring how many steps or miles they walk, it helps provide important feedback and build in new habits,” said Mamishev. “By turning general, vague estimates about how much people are eating into precise data, we can do the same thing here.”
For more information, contact Makhsous at sosper30@gmail.com or (206) 499-4618 or Mamishev at Mamishev@uw.edu or (206) 353-3568.
Tag(s): College of Engineering • Department of Electrical & Computer Engineering
