MnemoCity Task: Assessment of Childrens Spatial Memory Using Stereoscopy and Virtual Environments

Abstract

This paper presents the MnemoCity task, which is a 3D application that introduces the user into a totally 3D virtual environment to evaluate spatial short-term memory. A study has been carried out to validate the MnemoCity task for the assessment of spatial short-term memory in children, by comparing the children's performance in the developed task with current approaches. A total of 160 children participated in the study. The task incorporates two types of interaction: one based on standard interaction and another one based on natural interaction involving physical movement by the user. There were no statistically significant differences in the results of the task using the two types of interaction. Furthermore, statistically significant differences were not found in relation to gender. The correlations between scores were obtained using the MnemoCity task and a traditional procedure for assessing spatial short-term memory. Those results revealed that the type of interaction used did not affect the performance of children in the MnemoCity task.

Fig 1. Stereoscopy scheme.

The two projectors send polarized images to the screen. The filters placed in the glasses allow each eye to get the correct image.

Fig 2. General scheme of MnemoCity task.

An explanation of the elements that appear in overhead views can be found in Fig 6.

Fig 3. A child performing the interaction adaptation level.

Fig 4. The progression bar with the five stars needed to complete the game.

Fig 5. An example of one of the objects that appears on the table.

Fig 6. The virtual environment as seen from above.

Fig 7. System architecture.

Fig 8. The testing room.

Fig 9. The Wii Balance Board and Wii Mote used to create the NUI interaction.

Fig 10. The gamepad used to create the standard interaction.

Fig 11. Procedure of the task.

Fig 12. The Correlation plot.

Fig 13. The Matrix plot for correlations between traditional tests and the MnemoCity task.

The distributions of the variables show the MnemoCity Score, the Direct CBTT Score, and the Reverse CBTT Score. The interactions between the three variables are shown in the other plots of the matrix. The red lines represent the mean and the standard deviation for each value, and the green lines represent the regression line of the correlation.