May 26

The theory gives the answers, not the theorist.

-- Allen Newell

 
 

Featured chapter

Read the fascinating history of Wearable Computing, told by its father, Steve Mann

Read Steve's chapter !

 
 

Help us help you!

 
 

Nikola Banovic

Add description
Add publication

Publications by Nikola Banovic (bibliography)

 what's this?
2012
 
Edit | Del

Banovic, Nikola, Grossman, Tovi, Matejka, Justin and Fitzmaurice, George (2012): Waken: reverse engineering usage information and interface structure from software videos. In: Proceedings of the 2012 ACM Symposium on User Interface Software and Technology 2012. pp. 83-92.

We present Waken, an application-independent system that recognizes UI components and activities from screen captured videos, without any prior knowledge of that application. Waken can identify the cursors, icons, menus, and tooltips that an application contains, and when those items are used. Waken uses frame differencing to identify occurrences of behaviors that are common across graphical user interfaces. Candidate templates are built, and then other occurrences of those templates are identified using a multi-phase algorithm. An evaluation demonstrates that the system can successfully reconstruct many aspects of a UI without any prior application-dependant knowledge. To showcase the design opportunities that are introduced by having this additional meta-data, we present the Waken Video Player, which allows users to directly interact with UI components that are displayed in the video.

© All rights reserved Banovic et al. and/or ACM Press

2011
 
Edit | Del

Banovic, Nikola, Li, Frank Chun Yat, Dearman, David, Yatani, Koji and Truong, Khai N. (2011): Design of unimanual multi-finger pie menu interaction. In: Proceedings of the 2011 ACM International Conference on Interactive Tabletops and Surfaces 2011. pp. 120-129.

Context menus, most commonly the right click menu, are a traditional method of interaction when using a keyboard and mouse. Context menus make a subset of commands in the application quickly available to the user. However, on tabletop touchscreen computers, context menus have all but disappeared. In this paper, we investigate how to design context menus for efficient unimanual multi-touch use. We investigate the limitations of the arm, wrist, and fingers and how it relates to human performance of multi-targets selection tasks on multi-touch surface. We show that selecting targets with multiple fingers simultaneously improves the performance of target selection compared to traditional single finger selection, but also increases errors. Informed by these results, we present our own context menu design for horizontal tabletop surfaces.

© All rights reserved Banovic et al. and/or ACM Press

 
Add publication
Show this list on your homepage
 
 

Join the technology elite and advance:

 
1.

Your career

 
2.

Your network

 
 3.

Your skills

 
 
 
 
 
 

Changes to this page (author)

23 Nov 2012: Added
04 Apr 2012: Added

Page Information

Page maintainer: The Editorial Team
URL: http://www.interaction-design.org/references/authors/nikola_banovic.html
May 26

The theory gives the answers, not the theorist.

-- Allen Newell

 
 

Featured chapter

Read the fascinating history of Wearable Computing, told by its father, Steve Mann

Read Steve's chapter !

 
 

Help us help you!