Development and validation of Japanese version of Divergent Association Task
DOI:
https://doi.org/10.51094/jxiv.721Keywords:
divergent thinking, creativity, semantic distance, computational scoring, validationAbstract
Divergent thinking (DT) has long been studied as a part of creative potentials; however, the extensive scoring process for DT poses issues. A recent solution gaining attention is automated scoring by calculating semantic distance. The Divergent Association Task(DAT), a simplified version of the existing DT task, allows participants to engage in DT tasks within a shorter time, with immediate and automatic scoring. This study developed and validated the Japanese version of the DAT (DAT-J). Twelve candidate word vectors derived from the Japanese corpus were prepared to calculate DAT scores, and three surveys were conducted to examine the validity and reliability of the DAT-J. In Survey 1, 95 art majors completed an online questionnaire, including the DAT-J and creativity-related scales. Because Survey 1 revealed that the DAT-J may include inappropriate responses for automatic scoring, we modified the DAT-J instructions and developed a web application to validate inappropriate responses. In Survey 2, 358 students participated in the modified version of the DAT-J, the existing DT tasks, and the creativity-related questionnaire. The DAT-J was retested two weeks later. In Survey 3, an experiment was conducted comparing DAT-J responses by handwritten, web app, and web app with validation. Survey results demonstrate the basic validity and reliability of the DAT-J, underscoring its potential utility for assessing DT. Furthermore, the DAT-J answering format did not affect DAT scores. Finally, limitations of the DAT-J and future improvements for measurement accuracy were discussed.
Conflicts of Interest Disclosure
The authors have no conflicts of interest to report.Downloads *Displays the aggregated results up to the previous day.
References
Acar, S., & Runco, M. A. (2014). Assessing associative dis- tance among ideas elicited by tests of divergent thinking. Creativity Research Journal.26(2), 229–238. https://doi.org/10.1080/10400419.2014.901095
Acar, S., & Runco, M. A. (2019). Divergent thinking: New methods, recent research, and extended theory. Psychol- ogy of Aesthetics, Creativity, and the Arts.13(2), 153–158. https://doi.org/10.1037/aca0000231
秋山 哲史・内海 彰. (2010). 概念間の関係に関する単語の意味空間の性質–コーパス, 構築手法, 文章単位によ る影響– 認知科学, 17(1), 110-128. https://doi.org/10. 11225/jcss.17.110
Batey, M. (2007). A psychometric investigation of everyday creativity. Unpublished Doctoral Thesis. University Col- lege London.
Batey, M. & Furnham, A. (2008). The relationship between measures of creativity and schizotypy.Personality and Individual Differences, 45, 816-821. https://doi.org/10. 1016/j.paid.2008.08.014
Beaty, R. E., & Johnson, D. R. (2021). Automating creativity assessment with SemDis: An open plat- form for computing semantic distance. Behavior Re- search Methods.53(2), 757–780. https://doi.org/10.3758/ s13428- 020- 01453- w
Beaty, R. E., Zeitlen, D. C., Baker, B. S., & Kenett, Y. N. (2021). Forward flow and creative thought: As- sessing associative cognition and its role in divergent thinking. Thinking Skills and Creativity.41, 100859. https://doi.org/10.1016/j.tsc.2021.100859
Dumas, D., Organisciak, P., & Doherty, M. (2021). Mea- suring divergent thinking originality with human raters and text-mining models: A psychometric compari- son of methods.Psychology of Aesthetics, Creativity, and the Arts,.15(4), 645–663. https://doi.org/10.1037/ac a0000319
Grabe, E., Bojanowski, P., Gupta, P., Joulin, A., & Mikolov, T. (2018). Learning word vectors for 157 languages. Proceedings of the 11th International Conference on Language Resources and Evaluation. https://doi.org/10. 48550/arXiv.1802.06893
Grajzel, K., Acar, S., & Singer, G. (2023). The Big Five and divergent thinking: A meta-analysis. Personality and Individual Differences.214, Article 112338. https: //doi.org/10.1016/j.paid.2023.112338
Guilford, J. P. (1967). The nature of human intelligence. McGraw-Hill.
Haase, J., Hoff, E. V., Hanel, P. H., & Innes-Ker, ̊A. (2018). A meta-analysis of the relation between creative self- efficacy and different creativity measurements. Creativity Research Journal, 30(1), 1–16.
Hubert, K. F., Awa, K. N. & Zabelina, D. L. (2024). The current state of artificial intelligence generative lan- guage models is more creative than humans on divergent thinking tasks. Scientific Reports, 14(1), Article 3440. https://doi.org/10.1038/s41598-024-53303-w
猪原 敬介・楠見 孝. (2011). 潜在意味解析に基づく概 念間類似度の心理学的妥当性―言語統計解析アプ ローチの効用と限界― 心理学評論, 54(12), 101–122. https://doi.org/10.24602/sjpr.54.2 101
Ishiguro C, Sato Y, Takahashi A, Abe Y, Kato E, Takagishi H (2022) Relationships among creativity indices: Creative potential, production, achievement, and beliefs about own creative personality. PLoS ONE.17(9), Article e0273303.https://doi.org/10.1371/journal.pone.0273303
Ishiguro, C., Matsumoto, K., Agata, T., & Okada, T. (2022). Development of the Japanese Version of the Short Scale of Creative Self. Japanese Psychological Research. https://doi.org/10.1111/jpr.12418
Ishiguro, C., Matsumoto, K., Agata, T., & Okada, T. (2024).Development of the Japanese Version of the Inventory of Creative Activities and Achievements. [Manuscript submitted for publication]. Department of Psychology, University of the Sacred Heart.
石黒 千晶・鈴木 崇太朗 (2022). 拡散的思考課題の採点自動化の試み:Divergent Association Task 日本語版の開発 日本電子情報通信学会技術報告, 122(166), HCS2022- 39, 18–20.
Lakens, D. (2017). Equivalence tests: A practical primer for t tests, correlations, and meta-analyses. Social Psycho- logical and Personality Science, 8(4), 355–362. https: //doi.org/10.1177/1948550617697177
真鍋 陽俊・岡 照晃・海川 祥毅・髙岡 一馬・内田 佳孝・ 浅原 正幸 (2019). 複数粒度の分割結果に基づく日本語 単語分散表現 言語処理学会第 25 回年次大会発表論 文集, 1407–1410.
松野 省吾・水木 栄・榊 剛史 (2019). 日本語大規模 SNS+Web コーパスによる単語分散表現のモデル構築 第 33 回 人工知能学会全国大会論文集, 1–3. https://doi.org/10. 11517/pjsai.JSAI2019.0 4Rin113
Olson, J. A., Chmoulevitch, N. D., Cropper, S. J., & Webb, M. E. (2021). Naming unrelated words predicts creativ- ity. Proceedings of the National Academy of Sciences, 118(25), Article e2022340118. https://doi.org/10.1073/ pnas.2022340118
小塩真司, & 阿部晋吾. (2012). 日本語版 Ten Item Personal- ity Inventory (TIPI-J) 作成の試み. パーソナリティ研究, 21(1), 40–52. https://doi.org/10.2132/personality.21.40
Patterson, J. D., Merseal, H. M., Johnson, D. R., Agnoli, S., Baas, M., Baker, B. S., Barbot, B., Benedek, M., Borhani, K., Chen, Q., Christensen, J. F., Corazza, G. E., Forthmann, B., Karwowski, M., Kazemian, N., Kreisberg-Nitzav, A., Kenett, Y. N., Link, A., Lubart, T., ... Beaty, R. E. (2023).Multilingual semantic distance: Automatic verbal creativity assessment in many lan- guages.Psychology of Aesthetics, Creativity, and the Arts, 17(4), 495–507. https://doi.org/10.1037/aca0000618
Pennington, J., Socher, R., & Manning, C. (2014). GloVe: Global Vectors for word representation. Proceedings of the 2014 Conference on Empirical Methods in Natu- ral Language Processing (EMNLP). 1532–1543. https: //doi.org/10.3115/v1/D14-1162
Puvia, E., Taibi, D. ., & Tressoldi, P. (2022).The role of masked solutions in the accuracy of an insight problem- solving task. Journal of Anomalous Experience and Cognition, 2(1), 144–157. https://doi.org/10.31156/jaex .23304
Puryear, J. S., Kettler, T., & Rinn, A. N. (2017). Rela- tionships of personality to differential conceptions of creativity: A systematic review. Psychology of Aes- thetics, Creativity, and the Arts, 11(1), 59–68. https: //doi.org/10.1037/aca0000079
Reiter-Palmon, R., Forthmann, B., & Barbot, B. (2019).Scoring divergent thinking tests: A review and sys- tematic framework. Psychology of Aesthetics, Creativity, and the Arts, 13(2), 144–152. https://doi.org/10.1037/ac a0000227
Runco, M. A., & Acar, S. (2012). Divergent thinking as an indicator of creative potential.Creativity research jour- nal, 24(1), 66–75. https://doi.org/10.1080/10400419. 2012.652929
Said-Metwaly, S., Taylor, C. L., Camarda, A., & Barbot, B. (2022). Divergent thinking and creative achievement— How strong is the link? An updated meta-analysis. Advance online publication. https://doi.org/10.1037/ac a0000507
創造性心理研究会(編)(1969). S-A 創造性検査〈A 版〉 東京心理
Suzuki, M., Matsuda, K., Sekine, S., Okazaki, N., & Inui, K. (2018). A joint neural model for fine-grained named entity classification of wikipedia articles. IEICE Trans- actions on Information and Systems, E101.D(1), 73–81. https://doi.org/10.1587/transinf.2017SWP0005
田口 雄哉・田森 秀明・人見 雄太・西鳥羽 二郎・菊田 洸 (2021). 同義語を考慮した日本語の単語分散表現の学 習 情報処理学会研究報告, 2017-NL-233(17), 1–5.
Takeuchi H, Taki Y, Sassa Y, Hashizume H, Sekiguchi A, Fukushima A, et al. (2010). Regional gray matter volume of dopaminergic system associate with creativity: evi- dence from voxel-based morphometry. Neuroimage.51, 578–585 https://doi.org/10.1016/j.neuroimage.2010.02. 078
Torrance, E. P. (1966). The Torrance Tests of Creative Think- ing: Norms, technical manual. Research Edition. Verbal and figural tests (Forms A and B). Prentice Hall.
Downloads
Posted
Submitted: 2024-05-19 02:52:29 UTC
Published: 2024-05-23 11:27:57 UTC — Updated on 2024-06-19 07:10:08 UTC
Versions
- 2024-06-19 07:10:08 UTC (2)
- 2024-05-23 11:27:57 UTC (1)
Reason(s) for revision
"doi" is added to the header of the top page. (c) was added to the footer of the top page. Fixed misplaced asterisks and extra periods in Table 5. Corrected incorrect formatting of the bibliography. The ORCID of one of the authors was added.License
Copyright (c) 2024
Chiaki Ishiguro
Sotato Suzuki
Masasi Hattori
Lisa Abe
Kunhao Yang
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.