-
作品タイトル（日本語）
Worldwide StRhyme
-
作品タイトル（英語）
Worldwide StRhyme
-
制作物のコンセプトを記載してください。
＜なにを＞本作は体を動かして言葉を選択することによって、多数の言語で゙韻を踏む体験である。意味によってなされた選択が、世界の言葉の音のデータベースによって、音楽的な心地よさを生む。
プロジェクションされた母国語の単語を移動によって選択すると、選択した語と同じ意味をもつ押韻可能な母国語以外を含む言語による読み上げ起こり、体験者は言語の壁を超えた押韻表現によってやり取りを行うことができる。この作品は外国語をきくときのように、意味があるが理解はできないという音を作り出す体験である。体験によって生まれる音は、インストのように意味がない言葉の羅列に聞こえるが、作者が意味をもって作ったという点でインストやハミングとは異なる。本作によって作られた音を聞く人は、その意味を考察する余地をもつのである。
＜なぜ、誰のために＞音として、記号としての言葉の両方の性質を利用した表現の可能性を、より音に向けて拡張する。古来の宗教的・儀式的な音の表現には、体の動きが伴っていた。これは体を動かすことと音を発することがリズムという観点において密接に関係しており、宗教・儀式において人がその身体性を重んじていたからだといえよう。本作は音の側面を重視した言語表現の拡張を、更に身体性を伴わせることでよりノることのできる新たな儀式的体験として行うことを試みる。
また、言葉のやり取りにおける言語の壁を平滑化する。本作の聴覚体験は言語の壁すなわち音と意味との結びつきから開放され、むしろ音と音との結びつきを重視した、どんな言葉の話者にもフラットで開かれた、誰に対しても平等な音の体験であり、同時に意味の体験である。異なる言語話者同士の共鳴はこれまで非言語的な手段で行われてきたが、音・意味の側面両方で言語を異なる言語話者に対して平等に提示する本作は、「言語的」であるにも関わらず異なる言語話者の間に新たな共鳴を生むことを試みる。 -
制作物のコンセプトを記載してください。（英語）
Worldwide StRhyme is an experience that rhymes in many languages by selecting words through stepping forward aiming to blur the boundary of words as sound and meaning.
The choices of words shown in his/her native language are always rhymable in pronunciation of one of many languages, so that participants can experience words’ exchange with the rhyming expression beyond the language barrier.
Although the experience is mainly performed by two people, bystanders also have an unprecedented auditory experience.
When hearing or producing a sound, there are two factors: whether it has a meaning and whether its meaning is understandable. This work is an experience of creating a sound that has meaning but is not understandable, just as when listening to a foreign language. The sounds created by the experience sounds like a series of words without meaning, like an instrumental or humming, but they are different from them in that the artist created them with meaning. Those who listen to the sounds created by this work have room to consider their meaning.
This work aims to blur the boundary between words as meaning (signifié) and as sound(signifiant).
The musical expression that emerges from this experience sublimates the selection by meaning into an auditory experience that emphasizes the comfort of sound. It is an expression with the same orientation as the rhyming in poetry in ancient times and rap in modern times.
This experience extends the possibilities of expression using the properties of both words as sounds and as symbols toward as sounds. Born as a sound, language expression was sometimes based on the comfort of sound rather than meaning in ancient times especially in religious or ritual situation. In addition, religious or ritual sound expressions were often accompanied by body movements. This is because moving the body and making sounds are closely related in terms of rhythm, and people valued their physicality in religion or ritual. This work tries to expand the linguistic expression that emphasizes the aspect of sound by further removing the boundary of meaning, the language barrier, through Machine-in-the-Loop, and to make it a new ritual experience that can be accompanied by physicality.
This work also smooth out the language barrier in the verbal exchange. The language barrier is the wall created by the connection between sound and meaning, and this connection makes the verbal exchange closed only to those who understand it. The auditory experience in this work is free from this connection, and rather emphasizes the connection between sounds, making it a flat and open experience for speakers of any language. This experience is equally open to speakers of almost any language, an experience of sound and at the same time that of meaning equal for everyone. Resonance between speakers of different languages has been achieved through non-verbal means (e.g. painting), but this work attempts to create a new resonance between speakers of different languages despite its "linguistic" nature. -
作品の素材・仕様
W 2.5m x D 1.5m x H 0.1m
体験者が選択した語はkinectを用いて判定し、単語のリストをUnityで読み込み、候補提示・描画・音（予めリストをもとにしてAmazon Polly , Google Speech API, parolで生成)の再生の処理を行っている。Touch DesignerのKantan Mapperで2台の Anker Nebula Solarからプロジェクションマッピングする。
脚韻を踏んでいるように聞こえる単語のリストをwonderwords,google-trans,ipa-dict,Part-of-speech(nltk, spacy)などのライブラリを用いて作成しているいる。 -
作品の素材・仕様（英語）
W 2.5m x D 1.5m x H 0.1m
The technical aspects of this work are described from two points of view: the method of creating the list of words to be presented, and the overall software and hardware configuration.
There are 15 languages that can be read aloud: Arabic, German, English, Esperanto, Spanish, Finnish, French, Indonesian, Icelandic, Japanese, Korean, Romanian, Swedish, Vietnamese, and Chinese.
First, the following steps were taken to create a list of words in these languages that rhymes. (The databases used are listed in [ ].)
1.Get random words (nouns, adjectives, verbs) in English. [wonderwords].
2.Translate the acquired word A. [google-trans].
3.Convert the translated word A' into IPA. (-> A")[ipa-dict].
4.Search the ipa-dict dictionary in a randomly specified language for a word B that matches A" in the last three vowels*. (*In addition to vowels, consonants that sound alone (e.g., /b//g/) are also included in the matching criteria for grouping to determine if the sounds are similar.)
5.Repeat step 4 for 14 languages** (not including the language used to translate to 'A')
6.Repeat steps 2~5 with 15 languages***.
7.Repeat steps 1~6
To this list of words that rhyme, we added information on part-of-speech (nltk, spacy) in order to present choices based on parts-of-speech so that they are not grammatically unnatural when used in a sentence.
The overall hardware and software configuration is as follows.
・The word selected by the experiencer is determined by identifying the person's position using kinect.
・The list of words is read by Unity on a Macbook Pro, and the process of presenting choices, drawing, and playing sounds (generated by Amazon Polly, Google Speech API, and parol based on the list in advance) is performed.
・The view created in Unity is projection-mapped using Touch Designer's Kantan Mapper.
・Projection is done with two Anker Nebula Solar. -
作品のリファレンスURL
https://minori-products.wixsite.com/minori/%E8%A4%87%E8%A3%BD-%E7%A7%81%E3%81%B8%E3%81%86%E3%81%A4%E3%82%8B-1
-
作品の映像URL
https://youtu.be/HtUMnTdcYUM
-
公式サイト、もしくはSNSのURL
https://minori-products.wixsite.com/minori
-
特別賞のテーマにどう作品が関連しているか説明文を記載
本作品は言語を用いた表現活動において、Machine-in-the-Loopによる機械と人間の協業によって、言語の壁すなわち意味と音との結びつきを曖昧にすることで、誰にでも分け隔てなく表現を行えるようにすることを目指している。これは、技術によって人と人との壁をなくし、特定の民族や文化圏ではなく、世界としての文化を生む試みである。
- 59
Worldwide StRhyme
その他
Worldwide StRhyme is an experience that rhymes in many languages by selecting words through stepping forward aiming to blur the boundary of words as sound and meaning.
The choices of words shown in his/her native language are always rhymable in pronunciation of one of many languages, so that participants can experience words’ exchange with the rhyming expression beyond the language barrier.
Although the experience is mainly performed by two people, bystanders also have an unprecedented auditory experience.
Three words appear in the participant's native language at the feet of the participant, and by stepping on one of the words, three more words appear, and the experience proceeds by repeating it. After one participant selects two words in turn to create a phrase like a question, the other participant selects two words like an answer, and an exchange is born. Repeating this exchange rhythmically, pronounced exchange are placed on a single musical phrase. The words that come at the same timing in the musical phrase (e.g. the first word of one participant's question and that of another person's question) always rhyme with each other as a sound. This creates a sense of rhyming between phrases, which leads to a sense of comfort in sound.
When hearing or producing a sound, there are two factors: whether it has a meaning and whether its meaning is understandable. This work is an experience of creating a sound that has meaning but is not understandable, just as when listening to a foreign language. The sounds created by the experience sounds like a series of words without meaning, like an instrumental or humming, but they are different from them in that the artist created them with meaning. Those who listen to the sounds created by this work have room to consider their meaning.
The choices of words shown in his/her native language are always rhymable in pronunciation of one of many languages, so that participants can experience words’ exchange with the rhyming expression beyond the language barrier.
Although the experience is mainly performed by two people, bystanders also have an unprecedented auditory experience.
Three words appear in the participant's native language at the feet of the participant, and by stepping on one of the words, three more words appear, and the experience proceeds by repeating it. After one participant selects two words in turn to create a phrase like a question, the other participant selects two words like an answer, and an exchange is born. Repeating this exchange rhythmically, pronounced exchange are placed on a single musical phrase. The words that come at the same timing in the musical phrase (e.g. the first word of one participant's question and that of another person's question) always rhyme with each other as a sound. This creates a sense of rhyming between phrases, which leads to a sense of comfort in sound.
When hearing or producing a sound, there are two factors: whether it has a meaning and whether its meaning is understandable. This work is an experience of creating a sound that has meaning but is not understandable, just as when listening to a foreign language. The sounds created by the experience sounds like a series of words without meaning, like an instrumental or humming, but they are different from them in that the artist created them with meaning. Those who listen to the sounds created by this work have room to consider their meaning.
