Intro:
Title: Improving Command Selection with CommandMaps
Reference Information: CHI '12 Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems,
Pages 257-266
Author bios:
Joey Scarr was a senior in Computer Science at the University of Canterbury in New Zealand. He has produced a number of miscellaneous but useful projects.
Andy Cockburn is a professor at the University of Canterbury; his interests are HCI and multimedia projects. According to his website, he is a bit of a thrillseeker and enjoys windsurfing and rock climbing.
Carl Gutwin is a professor in the department of computer science at the University of Saskatchewan in Canada. He is one of the faculty leaders of the Interaction Lab, specializing in HCI.
Andrea Bunt is an assistant professor in computer science at the University of Manitoba in Canada; she co-directs the HCI Lab there and has worked on projects including adaptive systems and interface personalization.
An example of CommandMap for Microsoft Office
Summary: Four different studies were conducted for one purpose: to show whether graphical menu interface is more effective than other interface types because of spatial memory. In the first study, experienced users of Microsoft Word 2007 (a ribbon interface) were asked to identify their frequently-used tasks; they were then asked to click on a blank ribbon where the task would be located and later asked to find the task on the real interface. This study showed that most of the users had fairly accurate spatial memory and were able to easily find the tasks. The second study involved familiarizing participants with a CommandMap interface (like a ribbon tiled across the screen that appears with a key press; see above illustration), then asking them to find tasks in the CommandMap interface, a ribbon interface, and a traditional menu interface. The CommandMap interface was found to reduce time taken to find tasks, frustration, and ease of use for experienced users. In the third study, the same tests were performed in the second study, but the participants were not familiar with any of the interfaces. In this case, ribbon and CommandMap interfaces were found to be faster to navigate than menu interfaces, but neither had a clear advantage. Because the first three studies were conducted on static screens (i.e. full-screen program windows), the fourth study observed how participants reacted to a scaling CommandMap and a constantly-sized popup CommandMap. The scaled CommandMap was observed at 1280 x 1024 resolution, 640 x 512 resolution, and at 320 x 256 resolution. All participants preferred the pop-up menu. Overall, experienced users preferred the CommandMap to ribbon or menu interfaces.
Related works:
2D vs 3D, Implications on Spatial Memory - Tavanti, Lind
An investigation of how spatial memory differs between 2-dimensional and 3-dimensional displays; spatial memory is crucial to the CommandMap study and the development of 3D displays will require additional interface research.
Spatial Memory in Hypertext Information Retrieval - Fajardo, Canas, Salmeron, Abascal
Investigating the use of spatial memory in information retrieval; CommandMap may be used for information retrieval purposes.
The Influence of Grids on Spatial and Content Memory - Leifert
A study about how visual grid overlays can affect spatial memory in some interfaces; could prove to be useful in spatial interfaces.
Pad: An Alternative Approach to the Computer Interface - Perlin, Fox
A discussion of a new computer interface in which the whole interface is a giant shared workspace, where zooming and motion allow information access. In this, each piece of information has a physical place, much like CommandMap (though CommandMap is not this extreme).
Query, Analysis, and Visualization of Hierarchically Structured Data Using Polaris - Stolte, Tang, Hanrahan
A presentation of a visualization of a hierarchically organized structure; in this case, it deals with a warehouse, but this could be expanded to deal with menus and the like (as CommandMap does).
Finding Information on a Menu: Linking Menu Organization to the User's Goals - Mehlenbacher, Duffy, Palmer
This 1989 paper is an example of relatively early menu development. Interesting to see that this paper, once at the height of technology, is describing a technology that CommandMap may replace.
Complementary menus: Combining adaptable and adaptive approaches for menu interface - Park, Han
A study of adaptable and adaptive menus shows that menus based on user preferences and frequency of task selection are more effective; similar to CommandMap.
Learning and retention with a menu and a command line interface - Durham, Emurian
A study of how well participants remember how to interact properly with a command-line interface or a menu interface; any interface easily remembered is relevant.
User-process model approach to improve user interface usability - Ju, Gluck
A study of menus reorganized based on users' preferences.
Design and evaluation of freehand menu selection interfaces using tilt and pinch gestures - Ni, Bowman, North, McMahan
The development of a new menu-based interface using gestures is discussed; any alternative interfaces are relevant to CommandMap.
According to the relevant research found, this is a fairly novel interface alternative, but alternatives to menu interfaces are not unheard of.
Evaluation: In the first study, only a quantitative objective analysis was performed. The number of familiar tasks, the accuracy of clicking in the blank ribbon, and the number of clicks taken to get to the task in the ribbon interface were all gathered. For studies two and three, a quantitative objective analysis was performed of the speed at which tasks were selected and the error rate. Additionally, a quantitative subjective analysis was performed to determine interface preferences (including categories like mental demand, temporal demand, and frustration). For the fourth study, a quantitative objective analysis was performed on accuracy rates, and a qualitative subjective analysis was performed after participants were asked for their opinions.
Discussion: CommandMap is a good alternative to keyboard shortcuts; one of the reasons referenced for its development is the fact that few "expert" users adopt keyboard shortcuts, preferring to stick to mouse commands. I much prefer using the keyboard and would probably find the screen real estate required for this system frustrating; perhaps that is due to my status as a programmer. The evaluation was appropriate and complete--concrete numbers were needed to determine its actual effectiveness, and user opinions are vital for the success of this project. This seems to be a fairly novel project.