JMIR Publications

ABSTRACT

Background:

Reminiscence, a therapy that uses stimulating materials such as old photos and videos to stimulate long-term memory, can improve the emotional well-being of older adults. However, providing personalized reminiscence therapy can be challenging for caregivers and family members.

Objective:

This study aimed to achieve two objectives: (1) design and develop GoodTimes, an interactive multimodal photo album that utilizes AI to engage users in personalized conversations and storytelling about their pictures, encompassing family, friends, and special moments; and (2) examine the app’s functionalities in various scenarios using use case studies and assess the app's usability through pilot testing.

Methods:

We utilized state-of-the-art AI technologies including image recognition, natural language processing, knowledge graph, logic, and machine learning to develop GoodTimes. First, we constructed a comprehensive knowledge graph that models the information required for effective communication, including photos, people, locations, time, and stories related to the photos. Next, we developed a voice assistant that interacts with users by leveraging the knowledge graph and machine learning techniques. Then we created various use cases to examine the functions of the system in different scenarios. Finally, to evaluate GoodTimes' usability, we conducted a study with older adults (N = 13; age range: 58-84 years old; Mean = 65.8). The study period started from January-March, 202.

Results:

The use case tests demonstrated the performance of GoodTimes in handling a variety of scenarios, highlighting its versatility and adaptability. For the pilot test, the feedback from our participants was highly positive, with 93.85% reporting a positive experience conversing with GoodTimes. All participants mentioned that the app invoked pleasant memories and aided in recollecting loved ones, resulting in a sense of happiness for the majority (84.61%). Additionally, a significant majority (88.47%) found GoodTimes to be helpful and user-friendly. Most participants (69.29%) expressed a desire to use the app frequently, although some (30.71%) indicated a need for technical support to navigate the system effectively.

Conclusions:

Our AI-based interactive photo album, GoodTimes, was able to engage users in browsing their photos and conversing about them. Preliminary evidence supports GoodTimes’ usability. Future work is needed to explore its potential to serve as a useful tool for emotional and mental support for users.