Behind the Scenes: Pintoricchio Magnified

Video URL

Pintoricchio Magnified: An Immersive Conservation Experience 

Pintoricchio Magnified is a first-of-its-kind immersive conservation experience that invites visitors to move through layers of a conservation treatment and examine a painting in a way never before possible.

On view at the Cleveland Museum of Art from August 10, 2025, through August 23, 2026, the experience allowed visitors to use their own movement to reveal and explore the conservation of Pintoricchio’s Virgin and Child. AI-based tracking translated visitors’ movement into interactive control, allowing them to magnify views of the painting as if they themselves are looking through the microscope. They toggled between before and after treatment images, examining the conservation technique used to visually knit large areas of loss together. In the final interactive zone, 3D photogrammetry revealed the back of the painting, before transitioning to a CT scan that showed the painting’s structure. Visitors can then return to the physical artwork with a deeper understanding of its structure and the conservation process. 

Through technology and digital storytelling, Pintoricchio Magnified offers visitors a novel way to engage with the conservation treatment beyond traditional interpretive tools. 

Why This Painting?

Image
Julianna Ly
Julianna Ly, associate conservator of paintings, reconstructing the large area of damage on Virgin and Child

For nearly 50 years, Pintoricchio’s Virgin and Child was in storage at the Cleveland Museum of Art (CMA), its last original layers of paint hidden beneath a mask of restoration and conservation treatments from the 1900s.

Although considered one of the most significant paintings in the early Italian collection, its complicated treatment history and poor physical state rendered it unable to be publicly displayed. During the last century, two dramatically different approaches were used to resolve the largest area of damage within the Virgin’s robe. First, in the early 1900s, the Virgin’s robe was painted brown with added folds. In the 1990s, in a different approach, a dark blue was applied over all areas of loss, resulting in a robe without folds. 

Image
A black and white photo of man and a woman standing in the CMA storage surrounded by paintings.
Sherman Lee and Emery May Holden Norweb pictured with Virgin and Child. Cleveland Museum of Art Archives, 1966

In the latest treatment, conservators took a more holistic approach to the inpainting. They focused on revealing the original blue paint beneath, allowing it to guide the reconstruction of the damaged area. This complex treatment goal presented conservators with challenging ethical questions: What happens when a large portion of a painting is damaged or lost? How can conservation treatment assist in ethically reconstructing these areas? Solutions to these questions came by combining technical discoveries with firsthand examinations of Pintoricchio paintings in collections around the world. Both the analysis and examinations helped provide a conceptual framework for a newer interpretation of the painting. The abundance of research, imaging, and technical analysis during the treatment made this story uniquely suited to an immersive digital experience. 

How Does the Experience Work?

Video URL

The experience unfolds across a sequence of nine zones. As visitors move through the gallery, the immersive display dynamically responds to their position, revealing different layers of the painting’s conservation and technical imaging. Each return to the beginning introduces a new set of magnified details, encouraging repeated self-guided exploration.

Image
Visitors explore details of Virgin and Child on the immersive display.
Visitors move through the gallery, revealing the before and after inpainting with each step

Zone 1: Attract Loop

    Zone 2: Takeover

      Zone 3–8: Zoom Details

        Zone 9: Photogrammetry and CT Scanning

          How Was It Made?

          Image
          A 2 by 2 grid of early concept drawings for the Pintoricchio Magnified interactive.

          Prototyping and Testing 

          Prototyping was integral to the development of Pintoricchio Magnified, providing opportunities to visualize the experience, test technical components, and refine the interaction before installation in the gallery.

          During concept and content development, we utilized a virtual prototype that featured a 3D demonstration of the interactive. Using the prototype, we made adjustments to the scene that allowed us to simulate various combinations of exhibition conditions. 

          Image
          A screenshot of the virtual prototype for the Pintoricchio Magnified interactive.
          The virtual prototype shows options to adjust the scene including artwork position, didactic panels, and people, among other conditions.

          Once an approach was selected, in-person prototyping helped us further assess nuances of the visitor interaction, exhibition design, and final hardware. The goal was to set up the prototype as similar as possible to the final exhibition space. 

          To assess the visitor interaction, we tested the experience in a compact 12-by-10-foot space, similar in size to the gallery. A moveable, to-scale version of the painting and its case was produced to test the positioning of the artwork relative to the immersive display. The final cameras and computing hardware were used to test camera tracking, system performance, and the overall interactive experience.

          Image
          The CMA team test a 1:1 prototype of the Pintoricchio interactive.
          The CMA team tests a 1:1 prototype of the interactive experience.

          To evaluate the visual content, assets were displayed on the museum’s north lobby digital signage, which used similar display technology and resolution as the planned installation. This provided an opportunity to assess image quality, detail, and readability.

          Image
          Pintoricchio's Virgin and Child displayed on a 20 foot wide digital display.
          The interactive content displayed on the north lobby digital signage.

          Together, virtual and on-site prototyping helped identify and address design and technical considerations early, reducing uncertainty ahead of installation.

          Immersive Display

          The immersive environment is driven by a large-scale 10-by-10-foot LED display that renders the painting with exceptional brightness and color fidelity. This level of quality was critical for presenting detailed conservation imaging and subtle differences between treatment stages. At this scale, the lines and dots used during the inpainting stages become visible, offering a closer look at the precision of the conservation process.  

          Unlike projection-based installations, the LED panels prevent the casting of shadow, ensuring every detail is visible to the viewer. The panels’ modular design also allows them to be reconfigured and reused for future projects. 

          AI-Based Visitor Tracking 

          The experience leverages machine-learning-based computer vision to track visitors’ movement within the gallery and translates that movement into precise interactive control. This allows visitors to navigate the conservation story through their position in the space, without the need for touchscreens or controllers. 

          Six cameras mounted to the ceiling capture visitor movement. That tracking data is processed locally, with the core AI model running on-device. This distributed approach to the most computationally intensive part of the computer vision pipeline allows the system to efficiently scale up without overloading network bandwidth or centralized processing. 

          When multiple people are in the space, the person closest to the immersive display controls the interactive content. 

          Image
          In the foreground, Virgin and Child is displayed in a glass case. In the background, two people observe the camera views of a tracking system on an immersive display.
          The CMA team tests the interactive experience during installation.

           

          Digital Team and Partners

          Creating Pintoricchio Magnified was a highly collaborative effort across the museum and with external partners, led by Jane Alexander, chief digital information officer (digital lead), in close collaboration with Julianna Ly (conservation lead and curator), Jim Engelmann (exhibition designer), and external partner Eric Mika (interactive experience designer). 

          Throughout the process, the team worked together to balance conservation scholarship, technology, and exhibition design, ensuring that the digital experience deepened visitors’ understanding of the painting and encouraged them to look closer and dive deeper into its conservation story. 

          From the Cleveland Museum of Art

          Digital Innovation and Technology Services: Jane Alexander (chief digital information officer), Seta Nagbe (technical project manager), Jeff Judge (director of digital program management and media services)

          Curatorial and Conservation: Julianna Ly (associate conservator of paintings), Dean Yoder (Lapis Senior Conservator of Paintings and Head of Paintings Conservation), Gerhard Lutz (Robert P. Bergman Curator of Medieval Art)

          Design: Jim Engelmann (exhibition designer), Peter Kratcoski (graphic designer)

          Interpretation: Stephanie Foster (senior manager)

          External Partners

          Contractor: Eric Mika (interactive designer)

          Zenith Systems: Doug Fortney, Dominique Boaeuf, Jeremy Weatherford (AV planning and installation)