border border

Tales Through Touch

Team members

Bryant Tay Yu Qin (EPD), Chua Jia Li Julia (EPD), Nga Jing Ting (EPD), Veda Alexandra (EPD), Adhi Narayan Tharun (ISTD), Tan Dao Rong Eugene (ISTD), Ma Teck Leck (ISTD)

Instructors:

Yeo Si Yong, Low Hong Yee

Writing Instructors:

Wong Yoke Chee Susan

Teaching Assistant:

Ardy Samsir Kartolo

Project Description

In museums, visitors primarily use the sense of sight to view artefacts. This deters people with visual impairment (PVI) from visiting museums. This lack of inclusivity unknowingly prevents PVI from enjoying the same forms of entertainment as sighted people.

Thererfore, our team came up with a device that is able to mimic the basic form of artefacts on display at the Asian Civilisations Museum, providing details of parts of them to create dynamic animations that enhances the audio tour experience for visitors with visual impairment through the sense of touch.

TALES THROUGH TOUCH

 

 

 

Interactive 3D Model

 

 

 

 

 

 

WHAT IT DOES

 

 

 

 

 

1

 

Replicate parts of artefacts

 

 

 

 

 

 

 

 

 

 

wave gif

 

 

 

HOW TO CREATE
THESE FRAMES/ANIMATIONS

 

 

WEB APPLICATION:

 

(1) Design Page -> To manually design frames or upload STL file to convert into frame.

(2) Animation Page -> Combine the designed frames to create animations.

(3) Device Management Page -> To send the animations to the physical device.

 

 

 

 

 

 

 

 

 

 

Physical Device

 

 

 

 

 

 

Design Process

 

 

 

 

 

Defining Problem and Solution Phase

1. Brainstorming for a proposal to be chosen by NHB.

2. Site (museum) visit, Asian Civilisations Musuem. (Photo 1)

2. Discussing ideas with industry mentors from ACM NHB.

3. Interviewing people from the community - Dr. Wong Meng Ee, Mr. Chong Kwek Bin. (Photo 2)

 

Prototyping Phase

4. Hardware (Video 3)

5. Software (Video 4)

6. Integration of hardware and software (Video 5)

 

 

 

 

 

 

logos final 4

Our Solution

 

Tales Through Touch is a device that provides tactile feedback through the use of 150 pins that can actuate vertically to:

1.  Replicate parts of artefacts.
2. Bring the story in the audio narration to life by creating movement of the pins in accordance with the audio tours provided. For example, creating a wave-like motion when the sound of waves is being played.

We have also developed a web application for the museum's staff to design the frames and animations to be sent to the physical device.

 

 

 

 

Project Poster

 

 

 

 


 

2

 

Bring the audio narration to life by animating the pins in accordance to the sound effects, such as the movement of crashing waves.

 

 

 

 

 

 

 

 

 

 

 

 

 

1. Pin Array - 150 Pins (10 rows 15 columns) which can actuate vertically to provide tactile feedback to our users alongside the audio tours.

2. Pin Guide - Acrylic guide to make sure the pins are not wobbly when actuating.

3. PCB - 15 Printed Circuit Boards for 10 pins, 10 motors, 10 encoders, 5 drivers, 2 Arduino Nanos, capacitors and resistors each.

4. Motors and Encoders - 10 motors held by a motors holder on 1 PCB. One motor is responsible for the actuation of one pin.

5. Arduino Nano(s) - Micro-controllers to control the motors through the encoders. 2 Arduino Nanos on 1 PCB

6. Drivers - 5 drivers on 1 PCB. 1 driver controls 2 motors.

7. RaspberryPi - Micro computer that controls all the 20 Arduino Nanos

 

 

 

 

 

 

Acknowledgement:

1. Faculty instructors: Dr. Yeo Si Yong, Prof. Low Hong Yee - Provided vital guidance and feedback throughout our design journey.

2. Mentors from the Asian Civilizations Museum - Advised our team on understanding the user needs better through meetings with the teams along with providing constant feedback for our ideas and progress.

3. SUTD Centre for Writing and Rhetoric: Dr. Wong Yoke Chee Susan - Guided our team in documenting the project so the contents are well communicated to the instructors, mentors and the public.

4.. SUTD Fab Lab - Provided us the space and means to work on our physical prototype along with technical aid for our work.

TEAM MEMBERS

student Bryant Tay Yu Qin Engineering Product Development
student Chua Jia Li Julia Engineering Product Development
student Nga Jing Ting Engineering Product Development
student Veda Alexandra Engineering Product Development
student Adhi Narayan Tharun Information Systems Technology and Design
student Tan Dao Rong Eugene Information Systems Technology and Design
student Ma Teck Leck Information Systems Technology and Design
border border