Integrated Sensor Systems

Institute of
Integrated Sensor Systems
Department of Electrical and Computer Engineering
© 2014 Andreas König, ISE, Spectronet 2014 Presentation
Color Sensors in a Lab-on-Spoon System for Home-Based
Food Quality and Safety Monitoring
Andreas König and Kittikhun Thongpull
Institute of Integrated Sensor Systems
TU Kaiserslautern, 67663 Kaiserslautern
E-Mail: [email protected]
Outline of the talk:
¾ Background
¾ Lab-on-Spoon Concept
¾ Embedded Color Sensing
¾ Experiments & Results
¾ Conclusions
© 2014 Andreas König, ISE, Spectronet 2014 Presentation
Background
¾ Smart Homes or Intelligent Houses find widespread interest to
improve comfort, energy efficiency, safety & AAL
¾ Relevant subtask Smart-Kitchen requires qualitative & quantitative
assessment of food quality and food safety
¾ Obstacles: lack of experience, acquired perception deficiency
(age/injury) or assessment beyond human abilities
¾ Assistance system for sensing
enhancement/restauration
¾ ´´Electronic Tongue´´ in Spoon
as front-end
Early MIT-work
(Dr. Ted Selker)
Source: Connie Cheng and Leonardo
Bonannii. MIT Counter Intelligence group.
Intelligent-Spoon (T, pH, σ, viscosity).
© 2014 Andreas König, ISE, Spectronet 2014 Presentation
Lab-on-Spoon Concept
Autonomous/Self-Sufficient Wireless Integrated Multi-Sensor System
© 2014 Andreas König, ISE, Spectronet 2014 Presentation
Lab-on-Spoon Concept
First Unsealed Prototype (Arduino pro mini) with USB-Host Communication
¾ Multi-Sensor-System: Color, Impedance Spectroscopy, T
¾ pH, viscosity, IR, … in preparation
¾ Integrated/Embedded low-power solution employing 3D-Packaging
¾ Helps to scale, identify, and grade (fresh, rotten, contaminated, ...)
food by elaborated Computational Intelligence approach
¾ Extension to energy scavenging (Solar cell, vibration, ...)
© 2014 Andreas König, ISE, Spectronet 2014 Presentation
Embedded Color Sensing
¾ Sensing modalities: MaZET color sensors (MCS3AS), Impedance
Spectroscopy (AD 5933), T by UST pt10k
¾ Color sensor is emerged in the liquid contained in the spoon
¾ Active illumination & optional gain control provided
© 2014 Andreas König, ISE, Spectronet 2014 Presentation
Experiments and Results
Data Acquisition by Orange
Tap water
Visualisation & Automated
Feature Selection with QuickCog
© 2014 Andreas König, ISE, Spectronet 2014 Presentation
Experiments and Results
Lab-on-Spoon Life-Demo on Orange
¾ Training and evaluation of a recognition system (SVM)
¾ Life-acquisition from one of the LoS-demonstrators
© 2014 Andreas König, ISE, Spectronet 2014 Presentation
Experiments and Results
¾ Beer map
¾ Example of the
discernment of
different food/
nutritional liquids
¾ Sensor fusion of color
and impedance
spectrum
¾ Temperature context
© 2014 Andreas König, ISE, Spectronet 2014 Presentation
Experiments and Results
¾ Wine map
¾ Example of the
discernment of
different food/
nutritional liquids
¾ Sensor fusion of
color and impedance spectrum
¾ Temperature
context
© 2014 Andreas König, ISE, Spectronet 2014 Presentation
Experiments and Results
¾ State of frying oil
¾ Example of the
discernment of
identical food
differing in use or
contamination
¾ Here: only color
information
¾ Possibly device
internal sensor !
© 2014 Andreas König, ISE, Spectronet 2014 Presentation
Conclusions
¾ Food related applications (AAL/safety) require multi-sensory
context information and assessment capability
¾ Smart-Kitchen/Cookbook with sensory context support challenged/
unskilled persons, restoring (providing) judgement on food
¾ Category, quantity, and quality/toxicity to be detected
¾ Multi-sensor Lab-on-Spoon works towards such a logger ….
¾ Color sensors are valiant sources of information fusion in LoS
¾ Targets: Self-sufficient, Self-x, wireless, low-power, …
¾ Numerous spin-off applications, e.g., oil quality sensor, ….
¾ Sensory extensions: Multi-spectrum color, IIS, pH, viscosity,…
© 2014 Andreas König, ISE, Spectronet 2014 Presentation
Thank you !
Project Sponsoring:
© 2014 Andreas König, ISE, Spectronet 2014 Presentation