Multi-Object Assistant Layout

Multi object assistant chat layout

Transparency in Multi object chat layout

In a setting of three objects and three assistants (text-aid for understanding the gestures) and only one space to display the text, I need a layout which makes clear which object is «currently» speaking.

The first image above depicts such a layout. The question is, if the subtle color differences and the label («Radio», «Lamp», «Ventilator») is enough to distinguish the different assistants. And what if one would like to read the comment of the lamp, which may already left the screen because of two quick messages of the radio?

Maybe the second picture makes it more clear, which object is currently active.

In a setup where object selection has to take place (with only one leap motion) (see Prototyping Object Selection) it would also be imaginable that only the chat of the currently active object is displayed.

An animation between the different object chats would be necessary and could maybe look like this:

multi object chat switch animation

Definition: Micro-Interactions

Microinteractions differ from features in both their size and scope. Features tend to be complex (multiuse case), time consuming, and cognitively engaging. Microinteractions on the other hand are simple, brief, and should be nearly effortless. A music player is a feature; adjusting the volume is a microinteraction inside that feature.

A definition of a micro-interaction in comparison with the bigger feature from:
Saffer, Dan. «Microinteractions». Beijing: O’Reilly, 2013.

The text further describes what microinteractions are good for:
• Accomplishing a single task
• Connecting devices together
• Interacting with a single piece of data, such as a stock price or the temperature
• Controlling an ongoing process, such as changing the TV channel
• Adjusting a setting
• Viewing or creating a small piece of content, like a status message
• Turning a feature or function on or off

Video Sketch: Movie Scrubbing

Video Sketch: Movie Scrubbing via Micro-Gesture from Jones Merc on Vimeo.

The video sketch attempts to convey the feeling of controlling a video via micro-gestures. Grabbing the playhead and sliding it back and forth.
Such a scenario could be used in presentations for example, where it’s inappropriate to head over to an attached computer and move the playhead via mouse or trackpad. To further explore the possibilities brought by such an interaction a prototype is indispensable.

Micro-gestures Library Video Sketch

Video Sketch: Micro gestures library from Jones Merc on Vimeo.

The video is an attempt to visualize the most important and easiest micro-gestures. During the making a few things got clear.
– First a gesture must preferably consist of a natural hand position. Otherwise executing the gesture is getting strenuous over time.
– Second, some points did not get clear by just executing the gesture. For example it will only get clear how useful and how exact those movements are to control machines or processes if a working prototype is available. (Is the scrolling gesture exact enough but still offers the possibility to scroll through a whole document quickly?)

All in all this video can still serve as a basic library and as a starting point to develop some gestures further in the prototyping step.