The ERL Consumer Service Robots (previously known as ERL Service Robots) is composed of multiple Local Tournaments, held in different research labs across Europe, with certified test beds, and a few competitions as part of Major Tournaments, such as RoboCup. Teams participate in a minimum of 2 tournaments (Local and/or Major) per year and get scores based on their performances. A final end of year score is computed for each team, per Task Benchmark (TBM) and Functionality Benchmark (FBM), using the best two participations in tournaments, and teams are ranked based on their final score.
The final scoring and standings for the ERL Consumer Service Robots Challenge Season 2016/2017 are the ones below.
Prizes for the top teams (per TBM and per FBM where they participated) were awarded during the European Robotics Forum (ERF) 2017 in Edinburgh, 22-24 March.
Task Benchmarks
TBM1: Getting to know my home
A - Achievements
P - Penalties
Yellow indicates the team has the minimum required (2) participations
TBM4: Visit my home (Navigation)
TBM5: GPSR
Functionality Benchmarks
FBM1: Object Perception
FBM3: Speech Understanding
FCR - Full Command Recognition
AC - Action Classification
WER - Word Error Rate
SR acc - Speech Recognition Accuracy