Immersive Visualization
Term
Project
Partner
Program
Project
Partner
Program
Summer 2023
Harvard Art Museum
Individual Project
Unity, C#, Augmented Reality, Meta Spark
Harvard Art Museum
Individual Project
Unity, C#, Augmented Reality, Meta Spark
Museums play a vital role in preserving and showcasing artworks, providing visitors with an opportunity to engage with cultural heritage and artistic expressions. However, traditional museum experiences often lack interactive elements, hindering visitor engagement and limiting the depth of understanding. Augmented Reality (AR) technology offers a promising solution to augment the museum experience by providing interactive and immersive encounters with paintings. This research aims to investigate the use of AR as a tool to enhance user engagement and learning in museum settings, specifically focusing on paintings.
BACKGROUND
X-Radiography
Harvard graduate Alan Burroughs (Class of 1920) went on to become a research fellow and keeper of X-ray “shadowgraphs” at the Fogg Museum. Interested in how X-radiography could help distinguish areas that had been repainted after an artist completed an original work, between 1925 and 1944 Burroughs carried out the first systematic, large-scale X-ray documentation project for the technical study of paintings.
Learn more about Alan Burroughs Collection of X-Radiography
BACKGROUND
Augmented Reality
The project aims to design and develop an AR-based platform that allows users to explore the Alan Burroughs Collection of X-Radiographs. Leveraging AR technology, the platform will enable users to overlay virtual X-radiographic images onto physical artworks, providing a unique visual experience that reveals hidden layers and details, including areas of repainting and artistic techniques.
Prototype: Concept Diagram
BACKGROUND
Seleted Paintings
The project focued on works of iconic artists and paintings. Through a meticulous comparison of their distinct artistic styles, the research explored the use of both digital analysis and augmented X-radiography. By employing cutting-edge technologies, the project aimed to uncover hidden layers, artistic techniques, and unique characteristics that define each artist's masterpieces.
| Xray | Author | Title |
| xray_1.jpg | Vincent van Gogh | Three pairs of shoes |
| xray_2.jpg | Vincent van Gogh | Self portrait for Gaugin |
| xray_3.jpg | Vincent van Gogh | Madame Augustine Roulin Rocking a Cradle (La Berceuse) |
| xray_4.jpg | Vincent van Gogh | Self-Portrait with a Bandaged Ear and Pipe |
| xray_5.jpg | Pablo Picasso | La Soupe (1902–03) |
| xray_6.jpg | Pablo Picasso | The Blue Room |
| xray_7.jpg | Pablo Picasso | Woman with a Chignon |
| xray_8.jpg | Claude Monet | Red Boats at Argenteuil |
| xray_9.jpg | Claude Monet | portrait of madame paul |
| xray_10.jpg | Claude Monet | La Gare St. Lazare |
| xray_11.jpg | Frederick McCubbin | The North wind |
| xray_12.jpg | John Longstaff | Gippsland, Sunday night, February 20th,1898 |
| xray_13.jpg | Nicolas Régnier | Hero and Leander |
Original: Art Work by Selected Artists
X-Radiography: the Art Work by Selected Artists
PROJECT
Initial Prototype
The initial prototype focuses on utilizing image tracking to enhance the user experience in exploring X-radiography images and providing additional zoom-in details. Users will be able to point their phone/web AR devices at an art piece, and the system will overlay the X-radiography image on top of the artwork.
As the user moves their device closer to the artwork, the system will seamlessly zoom into specific areas of the X-radiography, revealing hidden details and layers. Moreover, hand tracking will allow users to access supplementary information about the artwork, such as its historical background, artist details, and other relevant descriptions. This interactive and immersive experience will enable art enthusiasts to gain a deeper understanding and appreciation of the art's hidden characteristics and historical context.
Activate effect by tapping screen
X-Radiography of Painting
Zoom-In Details
Zoom-In Details
Hand Tracking for additional information
PROJECT
Final Prototype
In the final prototype, I have refined the AR experience to provide more clarity and streamline the user interaction. I have removed the hand tracking function to avoid potential distractions and ensure a more straightforward user experience.
Now, users can access the X-radiography and zoom-in details directly by pointing their phone/web AR devices at the art piece. Multiple image tracking capabilities have been added, allowing users to explore and compare X-radiography images from different angles or even examine X-radiography of multiple art pieces simultaneously. This enhancement enriches the exploration process and provides a more comprehensive understanding of the artwork's conservation history, materials used, and any potential restorations. The final prototype not only simplifies the user interaction but also presents a more polished and refined platform for art enthusiasts, researchers, and curators to delve deeper into the hidden aspects of art through augmented reality.