AI Conversational Quality
Information SystemsReliability: alpha 0.924 sample items
About this scale
A multi-item measure of perceived quality of AI conversational interactions — fluency, coherence, helpfulness, and naturalness.
Sample item(s)
“The AI's responses flow naturally”
“The AI's responses stay on topic”
“The AI's responses are genuinely helpful”
“Conversing with the AI feels natural”
Reliability
Reported internal consistency: alpha 0.92. As a rule of thumb, Cronbach’s α ≥ .70 is considered acceptable, ≥ .80 good, and ≥ .90 excellent for established measures.
Notes
Increasingly relevant for LLM-based product research.
Source & citation
Liu, B. (2024): Measuring users' perceptions of conversational AI quality: Development of a multi-item scale. International Journal of Human-Computer Studies, Vol. 184, Article 103212.
Source. Scale details are summarised from the publication cited above. Always consult the original source for the full item set, scoring, and permission to use.
Use it in your research
Need to check the reliability or psychometrics of this scale in your own data? Use the free DrAIStudio research tools:
Cronbach’s alpha calculator
All statistical calculators
Search the full Scale Atlas
Academic writing humanizer