IAS group     UvA Web



Alumni
Contact info
Events
IAS-Knowledge centre
M.Sc. projects
No Title
People
Publications
Research
  Learning
    
    Aircraft recogniti...
    Ambient intelligen...
    Dumpers
    Environment learni...
    Learning Concepts
    Nonlinear projecti...
    Reinforcement lear...
  Multiagent systems
  Perception
  Principles
Reservations
Site Map
Software
Teaching
Vacancies
(See ISLA for the new IAS website. Most maintenance activities on this old website have stopped.)


Environment learning
Active map building and sensoric representations

Objective

Our goals are:
  • To develop algorithms for the extraction of optimal features from high-dimensional sensor patterns, algorithms for probabilistic environment modeling and navigation algorithms.
  • Implement these algorithms as a software library for a mobile robot which uses vision from an omnidirectional camera for goal-directed,  planned navigation. The global model (map) of the environment should be learned by the robot itself.
  • To test the software under a wide range of environment conditions.

Research group members

Prof. dr. F.C.A. Groen (groen@science.uva.nl) 
Visual navigation, , Optic flow, Implementation and testing on mobile robot
dr. ir. B.J.A. Kröse (krose@science.uva.nl) 
Neural methods for representation of the environment, Incremental learning of representation
dr. ir. S. ten Hagen (stephanh@science.uva.nl) 
Exploration strategy for the mobile robot
dr. N. Vlassis (vlassis@science.uva.nl) 
Probabilistic models for localization. Conditional density estimation. Optimal feature extraction
drs. R. Bunschoten (roland@science.uva.nl) 
Implementation and testing on mobile robot, Visual homing, Stereo

Research Achievements

Our work on reactive navigation focuses on the use of vision. In particular we use the spatiotemporal structure available in the image sequences. We have developed robust methods for optic flow
estimation, which outperform other methods. Based on the spatial structure derived from the optic flow a robot is able to perform simple reactive navigation tasks, such as wall following. The "structure from motion" task is usually solved by looking at the spatial structure of the optic flow field. We showed that the temporal structure in the optic flow can be used for a "wall following" task (Dev, Kröse, Groen, 97). Instead of first deriving the spatial structure of the environment it is also possible to use features from the optic flow directly to avoid collisions with obstacles (Dev, Kröse, Groen 98). This is an important
step in the integration of reactive and planned behavior. At the moment we are using our expertise of optic flow in a visual-based homing of the robot.
  Our work on environment modeling concentrates on making a model in the sensor space, instead of making a model in the world space. We worked on this earlier (Kröse and Eecen 94}) using a neural network to model measurements from ultrasonic sensors, and use that model to localize the robot. Recently we started  using a vision system to model the environment ("appearance modeling"). Experiments with on a real robot have been carried out. This robot had a standard camera, and by rotating the robot, new views of the environment could be obtained. An active vision strategy was developed (Kröse and Bunschoten 99}.

Because the vision system provides high- dimensional images, an important task is to find an optimal set of features. A schematical set-up of the Markov robot localization approach can be depicted as follows:
 
 
 

 
 

We investigated Principal Component Analysis for linear feature extraction and tested this on robot localization using range data (Vlassis and Krose 99) and data from an omnidirectional vision system (Kröse, Bunschoten, Vlassis and Motomura 99}. An information-theoretic performance measure was presented (Vlassis and Kröse 99) which can be used to evaluate the individual features.

Apart from the features which are selected, the performance also depends on the method which is used to model the relation between the location of the robot and the sensor values. We developed methods for probability density function approximation using Gaussian mixture models, in particular method to find the correct number of Gaussian kernels (Vlassis and Likas, 99). We also developed methods to model conditional density functions with mixture models using EM (Vlassis and Kröse 99).
  Closely related to the representation in the sensor space is the modeling of uncertainty and the use of this for navigation. The degree of uncertainty in the robot localization can be used to select those features or those robot action which reduces this uncertainty maximally. Feature selection is also a topic of joint interest with the group of Matsui at ETL (Motomura, Vlassis and Krose 99b). The role of exploration in learning has already been long a research item in our group and we plan to incorporate our knowledge of exploration
in Reinforcement Learning in the project.
  Developed methods are first tested in our robot simulator. This simulator is unique in the sense that it is very flexible in incorporating new sensor models or other autonomous robot agents. A description of the architecture of the simulator is given in (Corten, Dorst and Kröse 98). We also test our methods on data from the MEMORABLE robot database. This database is provided by Tsukuba Research Center, Japan,
for the Real World Computing Partnership and contains a dataset of about 8000 robot positions and associated measurements from sonars, infrared sensors and camera images.
 
 
 
 
For the experiments on "appearance modeling" we use a Nomad Scout robot (see figure). In this way we try to achieve a good compatibility with the other "Autonomous Learning" groups in RWI. The robot is equipped with an omnidirectional vision system. Processing is done on-board.
back to top