My Research Journey
Research Topic
Putting the Torn Page Back into the Book: How Sound Affects the Understanding of Historical and Emotional Information of Digitized Industrial Exhibits Removed from Their Historical Contexts.
Education Background
2021-Present
PhD – Media and Communications
University of Leeds
2019-2020
MA – Digital Media
University of Sussex
2017-2019
BA – Radio & Television Programming
Anyang Normal University (CN)
Research Aim
Understanding sounds’ ability in building understanding and connections for environment, cross-cultural, emotional information of museum collections. Enhancing the immersive experience, learning and inclusion in online museums by adding and archiving the sounds of the environments where the exhibits once were.
Research Commercialisation Project
Sustainable Virtual Exhibition Application for training, creation, archiving and participation in the cultural heritage sector (SVE Project)
PhD Research Practices
Year 1
Sound recording and 3D scanning at the Bradford Industrial Museum
• Tested the limitations of mobile 3D scanner apps for 3D model generation.
• Tested the dynamic information delivery ability of mono, stereo, and binaural sound formats.
Augmented Reality model with ambisonic sound creation
• Compared the differences in information display and multisensory engagement between 3D models with binaural sound and AR with ambisonic sound.
Year 2
The King’s Book (http://immersivenetworks.co.uk/Thekingsbook/)
It is a sound walk designed by Dave Lynch for Kirkstall Abbey, presented through voice actors along with background music and spatial ambisonic sound on the Echoes app.
• Led guided tours and conducted interviews (recording and transcribing).
• Designed questionnaires and collected, visualized, and analyzed data.
• Participated in a University of York masterclass for User Evaluation.
• Monitored equipment progress, managed loans and returns to ensure seamless event execution. Blueberry Academy Workshops
• Collaborated with Dave and Tom Jackson to provide 3D scanning workshops for autistic students.
Matterport online museum tour creation with audio and 3D models for the Calderdale Industrial Museum (ongoing)
• Scanned a four-floor museum with the Matterport app.
• Created 3D models of collections for embedding into the Matterport tour.
• Recorded sounds made by collections to support the 3D scan to represent the dynamics of objects’ movement and convey distant
information.
Year 3
Workshops for museum staff at the Calderdale Industrial Museum
• Taught volunteer-based museum staff to use technology for creating online museums.
• Interviewed and understood the attitudes of museum staff towards using technology in online museums and what their priorities are for the online museum era. Unreal Engine hearing-only tour creation (ongoing, will be presented on the Omni treadmill in May)
• Created a sound-only environment tour for participants to appreciate by walking on the Omni treadmill to understand how sound contributes to understanding the environment when vision is absent.
Verbal description of sound from disappearing and lost environments collection (ongoing)
• Inviting museum staff to describe their experience with machines in the museum they worked with, including sound volume, how it
sounds, feelings toward the machine when working, emotional connection to the environment, etc.
• Testing with participants with different industrial working backgrounds to understand how sound contributes to cross-cultural and emotional information understanding.
Research Topic
Putting the Torn Page Back into the Book: How Sound Affects the Understanding of Historical and Emotional Information of Digitized Industrial Exhibits Removed from Their Historical Contexts.
Education Background
2021-Present
PhD – Media and Communications
University of Leeds
2019-2020
MA – Digital Media
University of Sussex
2017-2019
BA – Radio & Television Programming
Anyang Normal University (CN)
Research Aim
Understanding sounds’ ability in building understanding and connections for environment, cross-cultural, emotional information of museum collections. Enhancing the immersive experience, learning and inclusion in online museums by adding and archiving the sounds of the environments where the exhibits once were.
Research Commercialisation Project
Sustainable Virtual Exhibition Application for training, creation, archiving and participation in the cultural heritage sector (SVE Project)
PhD Research Practices
Year 1
Sound recording and 3D scanning at the Bradford Industrial Museum
• Tested the limitations of mobile 3D scanner apps for 3D model generation.
• Tested the dynamic information delivery ability of mono, stereo, and binaural sound formats.
Augmented Reality model with ambisonic sound creation
• Compared the differences in information display and multisensory engagement between 3D models with binaural sound and AR with ambisonic sound.
Year 2
The King’s Book (http://immersivenetworks.co.uk/Thekingsbook/)
It is a sound walk designed by Dave Lynch for Kirkstall Abbey, presented through voice actors along with background music and spatial ambisonic sound on the Echoes app.
• Led guided tours and conducted interviews (recording and transcribing).
• Designed questionnaires and collected, visualized, and analyzed data.
• Participated in a University of York masterclass for User Evaluation.
• Monitored equipment progress, managed loans and returns to ensure seamless event execution. Blueberry Academy Workshops
• Collaborated with Dave and Tom Jackson to provide 3D scanning workshops for autistic students.
Matterport online museum tour creation with audio and 3D models for the Calderdale Industrial Museum (ongoing)
• Scanned a four-floor museum with the Matterport app.
• Created 3D models of collections for embedding into the Matterport tour.
• Recorded sounds made by collections to support the 3D scan to represent the dynamics of objects’ movement and convey distant
information.
Year 3
Workshops for museum staff at the Calderdale Industrial Museum
• Taught volunteer-based museum staff to use technology for creating online museums.
• Interviewed and understood the attitudes of museum staff towards using technology in online museums and what their priorities are for the online museum era. Unreal Engine hearing-only tour creation (ongoing, will be presented on the Omni treadmill in May)
• Created a sound-only environment tour for participants to appreciate by walking on the Omni treadmill to understand how sound contributes to understanding the environment when vision is absent.
Verbal description of sound from disappearing and lost environments collection (ongoing)
• Inviting museum staff to describe their experience with machines in the museum they worked with, including sound volume, how it
sounds, feelings toward the machine when working, emotional connection to the environment, etc.
• Testing with participants with different industrial working backgrounds to understand how sound contributes to cross-cultural and emotional information understanding.