How AI speech technologies helped revive a poet’s dream at Ziedonis Museum   

In celebration of the Latvian poet Imants Ziedonis’ 90th birthday, Ziedonis Museum decided to honour his unfulfilled dream of becoming a gardener with the help of AI. To achieve this, Tilde used advanced text-to-speech and speech-to-text technology. The museum now offers a guided tour in the garden featuring Ziedonis’ synthesised voice, thus providing visitors with a unique, immersive experience.   

Fulfilling the poet’s dream of becoming a gardener 

The goal of this project was to commemorate Ziedonis in a way that resonates with his passions and dreams. Despite his profound love for gardening, Ziedonis was unable to pursue a career as a gardener due to health issues. The museum, established in the poet’s summer house, sought to fulfil Ziedonis’ dream through an AI solution, allowing him to guide visitors through the garden of his summerhouse and share his story of the flora found in the backyard, which was originally his own. By using AI to recreate his voice, the museum not only communicates Ziedonis’ legacy and his connection to the garden but also demonstrates the potential of AI as a powerful creative instrument.   

Meticulous data collection and processing

The development of this AI solution involved a meticulous process of collecting and processing various audio and video files and selecting the right synthesis method. To develop Ziedonis’ voice, over eight hours of audio and video recordings were collected from archives and museums. With limited resources due to Ziedonis’ passing in 2013, these recordings were thoroughly processed to ensure clarity and remove background noise. Some audio files were also transformed into text, which is essential for producing a high-quality AI voice. After processing and post-editing, all these files were used to replicate Ziedonis’ unique voice, including the phonetic nuances and peculiarities of Ziedonis’ pronunciation as a speaker of the particular dialect.   

Experiencing the garden through the poet’s voice 

This extensive development process resulted in the creation of a voice synthesiser that replicates Imants Ziedonis’ voice.

Museum visitors can now enjoy a self-guided tour of the garden, equipped with a booklet and headphones. As they explore the garden, they hear Ziedonis’ voice providing commentary and botanical insights on five key plants.   

After generating the voice, Tilde took careful steps to protect the integrity of the synthesised voice, ensuring it wasn’t misused and that all data remained securely stored. Additionally, it was crucial to maintain transparency by clearly disclosing that the voice the visitors hear is an AI-generated imitation, not the original voice of Ziedonis. This information is conveyed at least three times during the visit – by the staff who greet visitors, in the accompanying booklet, and on labels at the headphone stands. 

As the poet’s voice is now successfully synthesised, the museum can order new additional speech samples as needed.   

Recognition for a harmonious blend of past and present 

In 2024, the museum received the prestigious Latvian Museum Association Annual Award (Latvijas Muzeju biedrības Gada balva) for the “Muzeja ceļa piezīmes” tour that includes the synthesised Ziedonis’ voice. The project has been praised for its innovative approach to integrating technology with cultural heritage, successfully bridging the gap between tradition and modernity.   

Leaving an eternal trail behind for future generations  

Building on the success of this initiative, Ziedonis Museum plans to expand its visitor experience offerings further over time. Upcoming dinner events will feature segments of Ziedonis’ synthesised voice, adding a personal touch. Additionally, there may be plans for implementing a similar AI-driven project in Tukums’ cherry tree garden – another beloved place of the poet. The long-term vision includes establishing various touchpoints across different locations where visitors can learn more about the poet and what was dear to him by listening to his narrative.  

Merging cultural values with technology can fulfil dreams 

The AI solution developed for Ziedonis Museum is a clear example of how technology can enhance cultural experiences and fulfil unrealised dreams. By merging traditional values with modern solutions, the project honours Imants Ziedonis’ legacy and sets a precedent for others in the cultural sector.