Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Aug 9:2022:1665021.
doi: 10.1155/2022/1665021. eCollection 2022.

Neural Network Model for Perceptual Evaluation of Product Modelling Design Based on Multimodal Image Recognition

Jie Wu  1 , Long Jia  2
Affiliations

Neural Network Model for Perceptual Evaluation of Product Modelling Design Based on Multimodal Image Recognition

Jie Wu et al. Comput Intell Neurosci. .

Retraction in

Abstract

With the homogenization of product function and performance, the design technology for product appearance quality has been increasingly valued by academia and industry and has become an effective technical way to meet the continuously growing diversified and personalized needs of consumers. The appearance quality attribute of a product can be characterized or described by its appearance image. Data-driven product appearance image design is based on the quantitative data of product appearance and consumer emotional needs and completes the product appearance through computer-aided design technology and intelligent algorithms. Design innovation can help companies quickly respond to consumers' emotional needs and effectively improve design quality and product competitiveness. When visual objects are disturbed in complex scenes, the issues such as how the human brain coordinates multisensory information processing and what neural processing mechanisms follow are still unclear. In this paper, a visual object recognition experiment in a complex scene was designed and the brain activation signals of three modalities of noise, added audio-visual (AVd), single visual noise and noise (Vd), and single-audio (A), were recorded. The properties and neural processing mechanisms of multisensory modulation of auditory stimuli during noisy image recognition were explored. Using the conjunction method combined with the classic "max criterion" rule, it was found that only when a certain amount of noise was added to the visual stimulus, the integration area changed. The product appearance has a decisive influence on the user's product perceptual attribute preference and greatly affects the consumer's satisfaction. The importance of product appearance image design is increasingly prominent. In addition, pattern analysis of brain activation signals confirmed that semantically consistent sounds can facilitate the recognition of noisy images and this facilitation shows a certain category selectivity when subdivided into categories. Using the analysis method of functional connectivity, a functional connectivity network containing nodes at different integration levels was constructed to explore the overall characteristics and processing patterns of the multisensory network. Through the analysis of the network connection relationship, it is found that the prefrontal cortex, STS, and lateral occipital lobe are the nodes with more aggregation in the network, and their functions are similar to the hub in the network. The brain functional network was constructed, and functional connectivity was used to explore the connection characteristics of the network and the multisensory modulation mechanism between different processing levels of the brain.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no conflicts of interest or personal relationships that could have appeared to influence the work reported in this paper.

Figures

Figure 1
Figure 1
Multimodal modeling design of product modeling.
Figure 2
Figure 2
BP neural network input data.
Figure 3
Figure 3
Multiple value additions and enhancements.
Figure 4
Figure 4
Product image positioning. (a) Image. (b) Modeling image.
Figure 5
Figure 5
Classification results of different feature selection methods.
Figure 6
Figure 6
Comparison of classification accuracy under two feature selections.
Figure 7
Figure 7
Brain regions significantly activated by the three ROIs.
Figure 8
Figure 8
Comprehensive quantification of product 3D modeling. (a) Appearance. (b) Target. (c) Prediction.
Figure 9
Figure 9
Appearance intention prediction model.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Battleday R. M., Peterson J. C., Griffiths T. L. From convolutional neural networks to models of higher‐level cognition (and back again) Annals of the New York Academy of Sciences . 2021;1505(1):55–78. doi: 10.1111/nyas.14593. - DOI - PMC - PubMed
    1. Durstewitz D., Koppe G., Meyer-Lindenberg A. Deep neural networks in psychiatry. Molecular Psychiatry . 2019;24(11):1583–1598. doi: 10.1038/s41380-019-0365-9. - DOI - PubMed
    1. Hammad M., Liu Y., Wang K. Multimodal biometric authentication systems using convolution neural network based on different level fusion of ECG and f. IEEE Access . 2019;7:26527–26542. doi: 10.1109/access.2018.2886573. - DOI
    1. Holzinger A., Malle B., Saranti A., Pfeifer B. Towards multi-modal causability with Graph Neural Networks enabling information fusion for explainable AI. Information Fusion . 2021;71:28–37. doi: 10.1016/j.inffus.2021.01.008. - DOI
    1. Hu C., Wang Y. An efficient convolutional neural network model based on object-level attention mechanism for casting defect detection on radiography images. IEEE Transactions on Industrial Electronics . 2020;67(12):10922–10930. doi: 10.1109/tie.2019.2962437. - DOI

Publication types