Responsive Environments

Responsive Environments

Responsive Environments

サウンドに関連するインターフェースの研究として、部屋に組み込まれた電子機器と音についての関係を考えてきました。 電子機器やセンサーがネットワークに繋げた応答環境を構築できるようになり、その技術をデザイン、作品に使う事ができるようになりました。今回、連動した電子機器を使い、動的に環境音と信号音を生成させ、応答する音と映像の空間をデザインしました。複数の小型端末からは、両端、真ん中と高速道路、神社、臨海公園などで録音された“都市の音”が再生され、同様にその間の端末からはそれらの場所を重ね合わせた音響合成音が再生されます。これらの音響合成音は、再生の繰り返しと合成により音楽の要素であるリズム、ピッチが生みだされ、連続的に変化していくことがわかります。また、カメラによって検知された人の動きに応じて、音の断片をリアルタイムに合成し変化させます。騒音や自然の音など足を運ぶとよく聞く都会の音がオーディエンスの動きによって、インタラクティブに音響合成され映像も変化し、言葉では表現することが難しい音や映像に変わっていく事がわかります。

At this time, we demonstrate a sound installation referred to as "Responsive Environments”. We have been thinking about the relationship between sound and embedded electric devices, and can easily apply the technology of electric devices and networks for design or art work. We designed a spatial and responsive environment that uses sound and image processing. Environmental sounds that had been recorded near a highway, in an open square and in a temple were assigned to eight mobile devices playing in an indoor space. Urban and suburban sounds from the mobile devices were repeated to generate a tempo, then mixed by granular synthesis and gradually changed in real time. The audience's movements were recorded using cameras, analyzed by the system, and used to generate signal tones. Thus, environmental noise from urban spaces and sinusoidal tones were mixed in the indoor space to produce ambient sound that could be listened to in a responsive environment.

Hardware PC, Smart Phone and projector
Software Max/MSP, Processing

Hardware PC, Smart Phone and projector
Software Max/MSP, Processing

http://yinteraction-design.com/event2/

https://vimeo.com/105726784

http://yinteraction-design.com/event2/

Takuya Yamauchi (Software Developer, Media Artist, Interaction Designer and UX Designer) Ph.D, Graduate School of Media and Governance, Keio University (2009)

(Exhibition)
“Tokyo”, Art Gallery, SIGGRAPH ASIA 2020
“River’s Edge”, Art Gallery, SIGGRAPH ASIA 2020

(Journal)
1 "Design of a process for interactive product in ubiquitous space " Takuya Yamauchi and Toru Iwatake International Journal on Interactive Design and Manufacturing (IJIDeM) Volume 2, Number 2 / 2008,5 Springer Verlag
2 "Sound Jewelry" Takuya Yamauchi and Toru Iwatake Leonardo Music Journal No 18 MIT Press
3 "Design of a process for Localization System in ubiquitous space " Takuya Yamauchi and Toru Iwatake International Journal on Interactive Design and Manufacturing (IJIDeM) Springer Verlag
(Conference)
1 "Designing Sound Representations for Responsive Environments" Takuya Yamauchi, The 22nd Annual International Conference on Audiotry Display (ICAD2016),Australian National University, Canberra 3-7 July 2016

Office Yamauchi 150-6090 Ebisu 4-20-4 Shibuya-ku Tokyo Japan Ebisu Garden Place, Portal POINT Ebisu E-mail: yamauchi@yinteraction-design.com

日本