Evaluation Runner
Record HiveBoard trials using the timer and trial form below. Select a condition, review its success criterion, and start the countdown. Begin the initial approach when the countdown reaches zero. The initial grasp is included in the trial time. For the key, drawer, and shock absorber, grasping remains stage 1. After each trial, enter the outcome, attempts, and regrasps. The evaluator determines success; the runner records time and stops at the task timeout.
For Thread (M8) and Thread (M30), start with the nut completely removed from the fixed screw. The reference images show the assembled mechanism. Alignment and initial thread engagement are part of the timed task.
Records are saved in this browser. Export the session to continue on another computer, or download the trial log as CSV. A complete submission requires five trials for each of the 13 conditions (65 trials). The results ZIP becomes available once all trial entries and required setup details are complete. Attach the setup photograph here or add it to the extracted folder, then add the 65 recordings before submission. Files are not uploaded to the organizers by this page.
Looking for recording-instructions.md? After completing all 65 trial records and the required setup details, open Review → Download results (.zip). Extract the ZIP and find this file inside the submission folder, beside trials_<submission_id>.csv and platform.md. It lists the required video filename for each trial. The CSV and Export session downloads do not include it. See where to find the recording instructions.
Collecting a learning dataset too? Use DataHive to record and annotate states, commands, and camera streams from the same trials. This website runner records timing and outcomes only. Dataset collection is encouraged but optional; see how to combine collection and evaluation.
To submit a complete evaluation, use Submit for review in the Review step. Share your completed package by a private download link, enter your contact details and publication permission, then prepare and send the email to the organizer. See submission and review instructions.