Benchmarking in the European Robotics League (ERL) has been designed so as to minimise subjective evaluations and to allow for the quality of sub-system components to be recognised as well as success in performing the overall task. Though the careful design and revision of the challenge rules we hope to allow for the comparison of performances across years.

Tasks will be benchmarked against whether the robots successfully complete the required actions (i.e. understanding commands, correctly operating and/or identifying objects and devices, etc.) and how effectively they do so. Penalties or disqualification in the ERL will be given for actions such as damaging objects or the testbed.