Accessibility settings

This paper is in the following e-collection/theme issue:

Artificial Intelligence (4705) Medicine 2.0: Social Media, Open, Participatory, Collaborative Medicine (2666) Artificial Intelligence, Machine Learning, and Natural Language Processing for Public Health (155) Social Media in Public Health informatics (91) Generative Language Models Including ChatGPT (1492)

Published on in Vol 27 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/75347, first published .
LLM image: Large Language Model with text describing traits like introverted, optimistic, creative.

Psychometric Evaluation of Large Language Model Embeddings for Personality Trait Prediction

Psychometric Evaluation of Large Language Model Embeddings for Personality Trait Prediction

Authors of this article:

Julina Maharjan1 Author Orcid Image ;   Ruoming Jin1 Author Orcid Image ;   Jianfeng Zhu1 Author Orcid Image ;   Deric Kenne2 Author Orcid Image
Article Authors Cited by (16) Tweetations (1) Metrics

Journals

  1. Wang X, Ye J, Zhang G, Guo H. PersonalityLens: Visualizing in-depth analysis for LLM-driven personality insights. Computers & Graphics 2025;133:104452 View
  2. Maharjan J, Jin R, Zhu J, Kenne D. Intersection of Big Five Personality Traits and Substance Use on Social Media Discourse: AI-Powered Observational Study. Journal of Medical Internet Research 2025;27:e79454 View
  3. Kratzke N, Beuter N, Drews A, Janneck M. PSYCH—Psychometric Assessment of Large Language Model Characters: An Exploration of the German Language. Analytics 2026;5(1):5 View
  4. Schroeder S, Freeman M, Cuatlacuatl G, Cunningham J, Jordan N, Occhiuto A. Do children with language impairment tell depressing and anxious stories? An emotion-based narrative language sample analysis of over 1000 children. Language and Health 2026;4(1):100079 View
  5. Sarikaya B, Küçükmanısa A. TB5I: A Multimodal Turkish Interview Dataset and AI-Based Big Five Personality Trait Prediction. IEEE Access 2026;14:38038 View
  6. Hill C, Dahil A, Simpson G, Hardisty D, Keast J, Pinn C, Dambha-Miller H, Winter M. Large language models for thematic analysis in healthcare research: A blinded mixed-methods comparison with human analysts. PLOS Digital Health 2026;5(4):e0001189 View
  7. Tshimula J, Galekwa R, Chikhaoui B. A critical analysis of MBTI-based personality profiling with large language models. Frontiers in Computational Neuroscience 2026;20 View
  8. Sasaki K, Kawaguchi S, Miyano S, Nishide S. Quantitative Evaluation of Personality-Driven Short Dialogue Generation for Game NPCs Based on the Five-Factor Model. Electronics 2026;15(10):2030 View
  9. Raetano J, Gregor J, Tamang S. A Survey and Computational Atlas of Personality Models. ACM Transactions on Intelligent Systems and Technology 2026;17(5):1 View
  10. Russell-Lasalandra L, Christensen A, Golino H. Generative psychometrics via AI-GENIE: Automatic item generation and validation with network-integrated evaluation. Behavior Research Methods 2026;58(8) View
  11. Fassbender P. Compliance without coherence: fluent failure and the ethics of alignment evaluation in multi-agent language models. AI and Ethics 2026;6(4) View
  12. Ryumina E, Ryumin D, Markitantov M, Karpov A. ExPAM: Explainable Personality Assessment Method Using Heterogeneous Linguistic Features and Off-the-Shelf LLMs. Big Data and Cognitive Computing 2026;10(8):254 View
  13. Koch T, Harari G, Gosling S, Marrero Z, Schoedel R, Bühner M, Stachl C, Fischer R. Brief speech samples reveal emotional states in daily life. PNAS Nexus 2026;5(8) View

Conference Proceedings

  1. Farhad M, Masud M, Abdul Rasheed A, Musthfa N. Proceedings of the 2026 Australasian Information Security Conference. How Linguistic Variation Shapes Hallucination Risk in Large Language Models: A Psychometric Perspective View
  2. Eslami Z, Cheetham M, Valizadeh S. 2026 International Interdisciplinary Conference on Artificial Intelligence: Engineering, Health, Finance and Humanities (IICAI). ChatGPT 4 and personality prediction View
  3. Sundaram I, Bikdash M, Pandey V. 2026 6th International Conference on Electrical, Computer and Energy Technologies (ICECET). Behavioral Trait Extraction and Clustering from Transit User Text Using Large Language Models View