音声AR

Scroll

WHAT WE CAN

  • - Adopted as an exhibition guide application at the MIZKAN MUSEUM.
  • - Implemented an audio AR original contents, ‘Otogatari ~Natsumatsuri no yakusoku~’ at the annual summer festival of Horikoshi Shrine of Tennoji, Osaka.
  • - Implemented ‘Shibuya Wallout’ as a memorial release for Mission Impossible Wallout, which was the first collaboration of ‘Audio AR spy game’.
  • - Adopted to a hands-on attraction “Alice in Madland” of XFLAG PARK 2018.
  • - Adopted to FINAL FANTASY 30th ANNIVERSARY EXHIBITION ‘Wakareno monogatari’.

AR from "sight" to "auditory"

Until now, AR was meant to be an expansion
of the visual information
but what we aimed
was for an expansion of the auditory
information.
By combining new auditory information to
reality, our imagination is stimulated and thus,
all sorts of possible 'experience' will expand in dimension.

WHAT WE CAN

Example 1. Museum

By grasping the user locations precisely, an audio explanation or BGM set at each location will automatically play.
Unlike the manualized audio guidance before, this creates an environment where visitors can immerse deeply in the exhibition experience itself since the hands free audio transitions just by moving from one place to another. The scrupulous linkage between the exhibition and audio also broadens the possibility of performance like no other.

Example 2. Tourist Attraction

The best fit audio information and music can be distributed for each user by analytic learning of the user’s survey content and past behavior.It can play different explanations depending on the number of times visited, and corresponding languages. As well as this, by integrating each user behavior data, navigating the best route encompassing the traffic can be possible. Creating motivation to visiting Japan and inbound solution, this is the hospitality of technology.

Example 3. Spatial Presentation

Even places unable to play audio, can now be able to deliver sound to users. Locations where sound is prohibited can now present using audio, like fitting music to outdoor ads and merging music to illumination lights.

Example 4. Events

Push notification for inducing users is possible for the organizers.
Audio and music can be delivered at once or it can be individually delivered depending on location and attribute. Since it is a hands free audio AR system, there is no worrying about ‘text and walk’. Due to this, a new entertainment setting in the city such as escape room and treasure hunting can be created.

Example 5. PDCA Usage

Compared to the conventional exhibitions, it is now possible to record and analyze data of the user’s excursions and tracks. This can be useful for analyzing the visitor’s interest and also for testing the venue layout. Real time monitoring and mapping traffic can also be done.

TECHNOLOGY

ZU_PC_EN2

By grasping user location, pre-programed audio information and music is played.
Manual delivery to specific groups by the operator is possible.
A new system where user attribute and behavior history is stored within the smartphone app,
which can be used for venue presentation and PDCA for traffic flow.

WORKS

Planning & managing the app

app "MIZKAN MUSEUM"

ABOUT
MIZKAN MUSEUM opened in 2016, is a museum where visitors can enjoy and learn the history and charm of Mizkan’s vinegar making. For their renewal, one course (Daichi no Kura course) which was originally full attended with a tour guide was changed into free viewing. In order to not lose the deep experience offered at the tour like before, a sophisticated indoor positioning technique Quuppa was first implemented at permanent facilities. We developed and released an application which automatically plays an explanation audio linked to the visitor’s location.
NOTE
At times, placing captions can destroy the atmosphere of the exhibition’s unique storyline. Moreover, conventional AR which relies on visual information decreases the value of a ‘genuine’ exhibit due to having to see the monitor for an explanation. Automatically playing information only with sound can let visitors focus on the exhibited artwork itself and unique view as is, and offer a richer experience and awareness, which is highly effective for museums and exhibitions.

Planning & managing the atraction

atraction of audio story

ABOUT
Horikoshi Shrine in Osaka was built by Shoutoku Taishi (Prince Shoutoku) and is known as ‘the god who grants one wish in your lifetime’. At the annually held summer festival many people visit as a spiritual site, we held ‘Otogatari’ a hands-on story lead by sound. By walking from spot to spot guided by sound only audible to oneself, the story emerges dimensionally and one can encounter historic information coiled around the location. This is an all new entertainment.
NOTE
The location is a shrine that has history of more than 1,400 years. The storyline expands through each focus spot carefully enshrined from the past. The special atmosphere of the summer festival makes the borderline of the real world and the story world vague, creating a space where one can immerse deeper into the storyline. By maximizing the appeal of the location, a new storyline experience by audio AR is created.

Planning & managing the event

MISSION:IMPOSSIBLE
"SHIBUYA FALLOUT"

ABOUT
The newest to the hit spy action movie series ‘Mission:Impossible / Wallout’ starring Tom Cruise. Collaboration with the movie as the first original contents: ‘Audio AR spy game’. We held ‘Shibuya Fallout’ on July 13th, the day of Ethan Hunt, ahead of the movie release. A full-scale spy game event was held where 100 challengers try to deactivate a timed device within a limited time placed all around Shibuya. We proposed a new style of promotion, enjoying the movie through a real experience.
NOTE
With the help of environmental maintenance such as detailed creation of the story worldview, and of using earphones which doesn’t shut out sound, the event aroused over 100 challengers to take same actions. The event proved that even with only presenting sound, a great number of people could be moved to the same place. It also was a place to see massive potential in audio AR, which could be used for the government and community to cooperate for a tourist event.

Planning & managing amusement house

XFLAG PARK 2018
"Alice in Madland"

ABOUT
XFLAG PARK: a massive LIVE entertainment event produced by XFLAG of mixi, attracting more than 40k audience. For the 4th year of XFLAG PARK 2018, audio AR system was introduced at the first ever fee paid experience attraction ‘Alice in Madland’. Similar to the game, a group of 4 challenge tricks relying on sound. We succeeded in deepening the engagement to the game characters through actual experience.
NOTE
At this attraction, both individual experience, where the player can hear a characters voice depending on their action and the surroundings, and cooperative experience, where all four players hear the same audio and proceed are implemented through headphones. We were able to get a glimpse of a new entertainment by audio AR, guaranteeing each players sense of immersion as well as creating unity within the players.

Planning & managing the exhibition

FINAL FANTASY 30th
ANNIVERSARY
EXHIBITION
–Memories of You–

ABOUT
The ultimate RPG ‘Final Fantasy’ series: having over 135 million being shipped and downloaded. Welcoming its 30th anniversary audio AR was introduced at the culmination exhibition ‘Wakareno monogatari’, held at Mori Arts Centre Gallery of Roppongi Hills. With a personalized audio, such as automatically having music played when standing in front of an art work, an introductive experience was done as if it speaks to the individual’s memory and emotions. This caused a stir to the conventional exhibition style.
NOTE
At this exhibition we purposely created an area with less visual information and instead with more auditory information that speaks to the visitor’s emotion. It is said that about 80% of human information is from sight. When it lacks the visual information, we tend to compensate with our own imagination. There were visitors who were emotional from the immersive experience which reminisce their own memory by visual information. We believe the exhibition reconfirmed the power of audio.

1/

TEAM

A production unit having audio AR at core, and specialists gathered from
Dentsu, Dentsu LIVE, and Bascule creating a never before experience and excitement.
We handle various works from Introduction of audio AR,
content creation rooted in auditory experience to creation production of exhibitions and events.

DENTSU LIVE

Shunsuke KagaCommunication Director /
Creative Director

Dai HiroseCopywriter

Kenji OzakiExperience Planner /
Producer

Kensuke MatsumotoExperience Planner /
Producer

Bascule

Nobuo HaraDigital Experience Director /
Creative Director

Seiki NakayamaTechnical Producer

Kazuhisa MaegawaTechnical Director /
Engineer

Taishi ChiharaEngineer

Megumu KasugaArt Director

PARTNER

PROGRESS TECHNOLOGIES

P.I.C.S.

CONTACT

Feel free to contact us regarding introduction,
usage of exhibitions and events etc.

©️ DENTSU LIVE / Bascule