{"id":106492,"date":"2025-08-30T10:14:07","date_gmt":"2025-08-30T10:14:07","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/106492\/"},"modified":"2025-08-30T10:14:07","modified_gmt":"2025-08-30T10:14:07","slug":"validation-of-the-art-education-in-medical-education-questionnaire-aemeq-integrating-medical-sciences-with-the-humanities-bmc-medical-education","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/106492\/","title":{"rendered":"Validation of the art education in medical education questionnaire (AEMEQ): integrating medical sciences with the humanities | BMC Medical Education"},"content":{"rendered":"<p>A literature review was performed to clarify art education as a tool of medical humanities integration into medical education. a literature search was conducted in databases such as Google Scholar, PubMed, Iran Medex, Elsevier, Springer, Embase, Scopus, PsycINFO, and ERIC using keywords medical humanities\/humanities, medical education, teaching, integration, art, learning, medicine, and clinical skills. After determining the dimensions and items of the instrument, the interview and expert focus group were conducted to match the participants\u2019\/respondents\u2019 conceptualization of the construct. Finally, the initial instrument of AEME was developed with 53 items and scored on a five-point Likert response. The corresponding author completed the item generation as part of the NASRME project No. 972,475. Certain steps should be taken to evaluate the questionnaire\u2019s validity. This study used the AMEE Guide for designing high-quality questionnaires. Addressing each step systematically will improve the probability that the survey designed will accurately measure what it intends to measure [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 16\" title=\"Artino AR Jr., Rochelle L, Dezee JS, Gehlbach KJ. Developing questionnaires for educational research: AMEE guide 87. Med Teach. 2014;36(6):463\u201374.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR16\" id=\"ref-link-section-d285970336e535\" rel=\"nofollow noopener\" target=\"_blank\">16<\/a>]. According to the AMEE guide 87, the survey scale design process has 7 steps. After item development, which includes the first four steps, the next three steps are expert validation, cognitive interviews, and pilot testing, as expressed below.<\/p>\n<p>Participants<\/p>\n<p>This study was conducted on medical students at Birjand University of Medical Sciences. Based on Krejcie and Morgan\u2019s table from 923 studying medical students in different stages, the sample size was determined to be 555. Then, three incomplete questionnaires were excluded. The sample size determination based on Krejcie and Morgan\u2019s Table [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 17\" title=\"Krejcie RV, Morgan DW. Determining sample size for research activities. Educ Psychol Meas. 1970;30(3):607\u201310.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR17\" id=\"ref-link-section-d285970336e545\" rel=\"nofollow noopener\" target=\"_blank\">17<\/a>] was deemed sufficient for the psychometry of the tool according to previous studies [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 18\" title=\"Murray J. Development of a medical humanities program at Dalhousie university faculty of medicine, Nova Scotia, Canada, 1992\u20132003. Acad Med. 2003;78(10):1020\u20133.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR18\" id=\"ref-link-section-d285970336e548\" rel=\"nofollow noopener\" target=\"_blank\">18<\/a>]. Samples were allocated based on the number of students in basic medical sciences (n\u2009=\u2009350), clinical preparations (n\u2009=\u2009146), and internships (n\u2009=\u2009427). The questionnaire was prepared in electronic format. At the beginning of the questionnaire, students were asked to provide their consent to participate, and upon informed acceptance, they were presented with the electronic form. Participants were informally invited to take part in the study through convenience sampling, and the questionnaire link was shared with university students (<a href=\"https:\/\/survey.porsline.ir\/s\/MIG2vGxJ\" rel=\"nofollow noopener\" target=\"_blank\">https:\/\/survey.porsline.ir\/s\/MIG2vGxJ<\/a>).<\/p>\n<p>Expert validation-face and content validity<\/p>\n<p>Face validity is the lowest level of content validity, which is used after the tool preparation. Without considering specific statistical analysis, it quickly determines whether the tool is visually suitable for the desired variable [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 19\" title=\"Vandsadeqpour A, Bahrami A, Abedi F, Atabati E, Farrokhfall K. Art in medical education from the viewpoint of Birjand university of medical sciences students. J Neyshabur Univ Med Sci. 2020;8(3):12\u201322.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR19\" id=\"ref-link-section-d285970336e576\" rel=\"nofollow noopener\" target=\"_blank\">19<\/a>].<\/p>\n<p>Content validity is related to an aspect of the questionnaire that indicates whether the stated questions cover all important and necessary domains of the variable of interest. Usually, the more items in the questionnaire, the better. Content validity better reflects the concept domain of the variable [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 20\" title=\"Sekaran U, Bougie R. Research Methods for Business: A Skill Building Approach. Wiley; 2010.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR20\" id=\"ref-link-section-d285970336e582\" rel=\"nofollow noopener\" target=\"_blank\">20<\/a>]. The criteria for an expert are often based on experience or knowledge of the survey field and, practically, dependent on the individual\u2019s willingness and availability [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 21\" title=\"McKenzie JF, Wood ML, Kotecki JE, Clark JK, Brey RA. Establishing content validity: using qualitative and quantitative steps. Am J Health Behav. 1999;23(4):311\u20138.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR21\" id=\"ref-link-section-d285970336e585\" rel=\"nofollow noopener\" target=\"_blank\">21<\/a>]. In this way, the 20 faculty members informed of artistic education with various specialists (medical education, biostatistics, and professors of basic and clinical sciences) were included. The criterion for the item acceptability should be determined in advance. The content validity ratio (CVR) and the content validity index (CVI) are common metrics used in decision-making for individual items. In addition to collecting quantitative data, the expert\u2019s free-text comments were considered to elucidate existing items in which its construct is not well-represented. The Content Validity Ratio (CVR) was employed to quantify the perceived essentiality of individual items, as originally proposed by Lawshe [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 22\" title=\"Lawshe CH. A quantitative approach to content validity. Pers Psychol. 1975;28(4):563\u201375.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR22\" id=\"ref-link-section-d285970336e588\" rel=\"nofollow noopener\" target=\"_blank\">22<\/a>]. Experts independently rated each item as \u201cessential,\u201d \u201cuseful but not essential,\u201d or \u201cnot necessary.\u201d CVR values were then calculated to reflect the proportion of experts identifying an item as essential. Items exceeding the critical threshold determined by the number of raters were considered to demonstrate acceptable content validity. To complement this assessment, the Content Validity Index (CVI) was calculated to evaluate the overall clarity and relevance of the items.<\/p>\n<p>Cognitive interview<\/p>\n<p>The interview (7 medical students) was performed with immediate retrospective verbal probe questions designed to elicit specific information [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 23\" title=\"Willis GB, Artino AR Jr. What do our respondents think we\u2019re asking?? Using cognitive interviewing to improve medical education surveys. J Grad Med Educ. 2013;5(3):353\u20136.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR23\" id=\"ref-link-section-d285970336e599\" rel=\"nofollow noopener\" target=\"_blank\">23<\/a>]. The common verbal probes were (1) Restate the item in your language, and (2) What do you think this item means? (3) Could you provide an example?<\/p>\n<p>Information gathered from the cognitive interview was incorporated into the overall questionnaire, and each item was refined. The student\u2019s responses were analyzed thematically and continued until data saturation was reached (no new codes emerged).<\/p>\n<p>Pilot testing<\/p>\n<p>The questionnaire pilot test collected valid evidence (members of the target population, namely medical students, n\u2009=\u2009552) based on two main approaches: internal structure (factor analysis) and reliability analysis (internal consistency by Cronbach\u2019s alpha coefficient). The details are described in Sect.\u00a02.5-7.<\/p>\n<p>Exploratory factor analysis<\/p>\n<p>To validate the factor structure identified in the exploratory factor analysis (EFA), the remaining half of the dataset (n\u2009=\u2009276) was used for confirmatory factor analysis (CFA). This method, using principal component analysis with Varimax rotation, considering eigenvalues above 1, and the scree plot, was employed. The quality of the dataset was evaluated using the Kaiser-Meyer-Olkin (KMO) measure and Bartlett\u2019s test of sphericity. The KMO value exceeded 0.67, suggesting that the sample size was sufficient and that multicollinearity among items was within an acceptable range (values above 0.50\u20130.60 are generally considered adequate). Bartlett\u2019s test produced a statistically significant result (p\u2009&lt;\u20090.05), indicating that the correlation matrix was not an identity matrix and that meaningful shared variance existed among the items. Together, these results supported the suitability of the dataset for factor analysis and affirmed the robustness of the underlying factor structure [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 24\" title=\"Plichta SB, Kelvin E. Munro&#039;s Statistical Methods for Health Care Research 6th Edition , London. Wolters Kluwer Health\/Lippincott Williams &amp; Wilkins, 2013, 1-563.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR24\" id=\"ref-link-section-d285970336e631\" rel=\"nofollow noopener\" target=\"_blank\">24<\/a>, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 25\" title=\"Supe A. Medical humanities in the undergraduate medical curriculum. Indian J Med Ethics. 2012;9(4):263\u20135.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR25\" id=\"ref-link-section-d285970336e634\" rel=\"nofollow noopener\" target=\"_blank\">25<\/a>].<\/p>\n<p>Confirmatory factor analysis (CFA)<\/p>\n<p>CFA was performed using AMOS software, employing the maximum likelihood (ML) estimation method. This technique is widely adopted in cases where the data approximately satisfy the assumption of multivariate normality. The assumption of multivariate normality was examined using skewness and kurtosis statistics. Various statistics are available for assessing goodness-of-fit. Hu &amp; Bentler [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 26\" title=\"Hu L-t, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling Multidiscip J. 1999;6:1\u201355.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR26\" id=\"ref-link-section-d285970336e645\" rel=\"nofollow noopener\" target=\"_blank\">26<\/a>] recommended multiple fit indices and their corresponding cut-off values for evaluating data: Tucker\u2013Lewis Index (TLI) with a cut-off of TLI\u2009\u2265\u20090.90, Comparative Fit Index (CFI) with a cut-off of CFI\u2009\u2265\u20090.90, Root Mean Squared Error of Approximation (RMSEA) with a cut-off of less than 0.08 [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 27\" title=\"Marsh HW, Grayson D. Latent variable models of Multitrait-Multimethod data. In: Hoyle RH, editor. Structural equation modeling: concepts, issues, and applications. Thousand Oaks, CA: Sage; 1995. pp. 177\u201398.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR27\" id=\"ref-link-section-d285970336e648\" rel=\"nofollow noopener\" target=\"_blank\">27<\/a>]. The parsimonious Normed Fit Index (PNFI) with a cut-off value of PNFI\u2009\u2265\u20090.5. Furthermore, some other indices, such as Goodness-of-Fit-Index (GFI)\u2009\u2265\u20090.9 and Parsimonious Comparative Fit Index (PCFI)\u2009\u2265\u20090.6, were suggested [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 28\" title=\"Brown TA. Confirmatory factor analysis for applied research. 2nd ed. New York, NY: Guilford; 2015.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR28\" id=\"ref-link-section-d285970336e651\" rel=\"nofollow noopener\" target=\"_blank\">28<\/a>].<\/p>\n<p>Discriminant analysis validity was assessed using the Average Variance Extracted (AVE) index. The average variance extracted indicates the proportion of variance in the indicators explained by the latent constructs, providing a more cautious assessment of the measurement model\u2019s validity. Typically, values above 0.5 for Average Variance Extracted (AVE) are accepted [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 29\" title=\"Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Mark Res. 1981;18(1):39\u201350.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR29\" id=\"ref-link-section-d285970336e657\" rel=\"nofollow noopener\" target=\"_blank\">29<\/a>]. Also, acceptable CR values indicate that the measurement items exhibit high levels of internal reliability. CR values greater than 0.7 are required for confirmation [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 29\" title=\"Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Mark Res. 1981;18(1):39\u201350.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR29\" id=\"ref-link-section-d285970336e660\" rel=\"nofollow noopener\" target=\"_blank\">29<\/a>]. Another approach to evaluating discriminant validity is by using the Heterotrait-Monotrait (HTMT) correlation ratio [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 30\" title=\"Henseler J, Ringle CM, Sarstedt M. A new criterion for assessing discriminant validity in variance-based structural equation modeling. J Acad Mark Sci. 2015;43(1):115\u201335.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR30\" id=\"ref-link-section-d285970336e663\" rel=\"nofollow noopener\" target=\"_blank\">30<\/a>]. A value approaching 1 suggests insufficient discriminant validity. To assess this using the HTMT method, its value is compared against a set cut point. If the HTMT exceeds that cut point, it implies that discriminant validity may not be present. Gold et al. challenged this approach and recommended setting the threshold at 0.90 [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 31\" title=\"Gold AH, Malhotra A, Segars AH. Knowledge management: an organizational capabilities perspective. J Manage Inform Syst. 2001;18(1):185\u2013214.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR31\" id=\"ref-link-section-d285970336e666\" rel=\"nofollow noopener\" target=\"_blank\">31<\/a>].<\/p>\n<p>Reliability assessment<\/p>\n<p>The internal consistency method using Cronbach\u2019s alpha was utilized to assess reliability. A value greater than 0.70 indicates good reliability [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 32\" title=\"Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155\u201363.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR32\" id=\"ref-link-section-d285970336e677\" rel=\"nofollow noopener\" target=\"_blank\">32<\/a>, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 33\" title=\"van Griethuijsen RALF, van Eijck MW, Haste H, den Brok PJ, Skinner NC, Mansour N, Savran Gencer A, BouJaoude S. Global patterns in students\u2019 views of science and interest in science. Res Sci Educ. 2015;45(4):581\u2013603.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR33\" id=\"ref-link-section-d285970336e680\" rel=\"nofollow noopener\" target=\"_blank\">33<\/a>]. Additionally, the test-retest method is employed to evaluate reliability over time, with a threshold of 0.75 considered acceptable [<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 32\" title=\"Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155\u201363.\" href=\"http:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-025-07815-2#ref-CR32\" id=\"ref-link-section-d285970336e683\" rel=\"nofollow noopener\" target=\"_blank\">32<\/a>].<\/p>\n<p>Statistical analysis<\/p>\n<p>Quantitative data were described using central tendency and dispersion criteria, while qualitative variables were described using counts and percentages. Given the normality of the quantitative variables, Pearson\u2019s correlation coefficient was applied to assess the relationships among them.<\/p>\n<p>Exploratory factor analysis was conducted using SPSS 26 software, while confirmatory factor analysis was performed using AMOS software 4.5.0, with the semTools package for McDonald\u2019s Omega was used.<\/p>\n","protected":false},"excerpt":{"rendered":"A literature review was performed to clarify art education as a tool of medical humanities integration into medical&hellip;\n","protected":false},"author":2,"featured_media":106493,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[11480,64,63,58209,1679,76507,105,74923,76506],"class_list":["post-106492","post","type-post","status-publish","format-standard","has-post-thumbnail","category-technology","tag-art","tag-au","tag-australia","tag-medical-education","tag-medicine","tag-surveys","tag-technology","tag-theory-of-medicine-bioethics","tag-validation-study"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/106492","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=106492"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/106492\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/106493"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=106492"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=106492"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=106492"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}