Sound Design: First Sounds

After playing around with the recordings and a lot of try outs in garageband (music instruments) and searching a sound database I came up with the sounds above.

  • Cancel: For the cancelling gesture (waving your hand saying no/stop)
  • Hover In: When entering the interaction field of the Leap
  • Hover Out: When leaving the interaction field of the Leap
  • Swipe Left: Selecting the next track
  • Swipe Right: Selecting the previous track
  • Thumb Up/Ok: Saying «Yes»/«OK» to the smart device during the dialogue
  • Volume Adjust: As long as adjusting the volume with a gesture grasping an invisible rotary knob

Interaction System: 1-2

1-2-Managing-and-Entertaining

1-2 Managing and Entertaining
The output of a self-regulating system becomes input for a learning system. If the output of the learning system also becomes input for the selfregulating system, two cases arise. The first case is managing automatic systems, for example, a person setting the heading of an autopilot—or the speed of a steam engine. The second variation is a computer running an application, which seeks to maintain a relationship with its user. Often the application’s goal is to keep users engaged, for example, increasing difficulty as player skill increases or introducing surprises as activity falls, provoking renewed activity. This type of interaction is entertaining—maintaining the engagement of a learning system. If 1-2 or 2-1 is open loop, the interaction may be seen as essentially the same as the open-loop case of 0-2, which may be reduced to 0-0.

Source: Dubberly Hugh, Pangaro, Haque. «What is Interaction?
Are There Different Types?»
. 2009. ACM 1072-5220/09/0100

Object Dialogue

Object-Wizard

The object above is a prototype for a smart computer, that is enabled to regulate things for the user. The user can interact with it via gestures and for simplicity the object has a display to «speak».
This object allows to test different scenarios with the «Wizard of Oz Method». The object just displays text which I am writing at a nearby computer. I can thereby present the object to a possible user and let him interact with it, controlling the objects feedback by myself.