Artificial Intelligence (AI) Literacy Questionnaire with Confirmatory Factor Analysis

Davy Tsz Kit Ng, Wenjie Wu, Jac Ka Lok Leung, Samuel Kai Wah Chu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

15 Citations (Scopus)

Abstract

In recent years, schools started to incorporate artificial intelligence (AI) into computer science/STEAM curricula. However, few validated measurements have been designed to examine how secondary students develop AI literacy and perceive their learning outcomes. AI literacy has been measured from students' knowledge and skill acquisition, and behavior and attitudes. This research aims to develop and validate an instrument to assess AI literacy for secondary students. A questionnaire with 25 items measured in a 5-point Likert scale was created. In a pilot study, the questionnaire was administered to a sample of 363 secondary school students from two different schools in Hong Kong. Confirmatory factor analysis was conducted and grouped into six factors: (1) intrinsic motivation, (2) self-efficacy, (3) behavioral intention, (4) behavioral engagement, (5) know and understand, and (6) use and apply AI. The questionnaire showed a good fit model to support internal consistency reliability in most of the factors, with Cronbach's Alpha levels ranging from.58 to.88. A less-parsimonious model was proposed that help educators measure a wider AI literacy skill set with an acceptable model fit, with Cronbach's Alpha levels ranging from.91 to.94 based on affective, behavorial, cognitive and ethical (ABCE) learning framework. Further studies are needed to confirm the factor structure.

Original languageEnglish
Title of host publicationProceedings - 2023 IEEE International Conference on Advanced Learning Technologies, ICALT 2023
EditorsMaiga Chang, Nian-Shing Chen, Rita Kuo, George Rudolph, Demetrios G Sampson, Ahmed Tlili
Pages233-235
Number of pages3
ISBN (Electronic)9798350300543
DOIs
Publication statusPublished - 2023
Externally publishedYes
Event23rd IEEE International Conference on Advanced Learning Technologies, ICALT 2023 - Hybrid, Orem, United States
Duration: 10 Jul 202313 Jul 2023

Publication series

NameProceedings - 2023 IEEE International Conference on Advanced Learning Technologies, ICALT 2023

Conference

Conference23rd IEEE International Conference on Advanced Learning Technologies, ICALT 2023
Country/TerritoryUnited States
CityHybrid, Orem
Period10/07/2313/07/23

Keywords

  • AI
  • AI literacy
  • machine learning
  • psychometric measurement

Fingerprint

Dive into the research topics of 'Artificial Intelligence (AI) Literacy Questionnaire with Confirmatory Factor Analysis'. Together they form a unique fingerprint.

Cite this