This system using computer vision technology to track the movement of the hands of the performer in a designated performance space by following several points identified on the hands. This could be referred to as an "empty-handed" or "naked" gesture system. The boundaries of the performance space can be seen when the video shows the captured image of the hands.
The page does not provide a technical description of the synthesis or mapping system used other than to say that samples are used. A colleague and I theorized that it is likely to be some kind of granular synthesis algorithm performed on the samples, changing them to be unrecognizable from the original. For me there are times when it is extremely difficult to determine the sonic results of some of the gestures. The very small and delicate gesture beginning at 05:23 is particularly ambiguous to me. There are also clearly several sets of samples used throughout the piece from more ambient sounds to chime/bell like sounds with a more definite sense of pitch. It is unclear however how the choice of samples being controlled is changed through the piece. It is possible that this is being carried out by another individual off camera.

No comments:
Post a Comment