DC Field | Value | Language |
---|---|---|
dc.contributor.advisor | 김주호 | - |
dc.contributor.author | Kim, Yoonsu | - |
dc.contributor.author | 김윤수 | - |
dc.date.accessioned | 2024-07-30T19:30:35Z | - |
dc.date.available | 2024-07-30T19:30:35Z | - |
dc.date.issued | 2024 | - |
dc.identifier.uri | http://library.kaist.ac.kr/search/detail/view.do?bibCtrlNo=1096048&flag=dissertation | en_US |
dc.identifier.uri | http://hdl.handle.net/10203/321343 | - |
dc.description | 학위논문(석사) - 한국과학기술원 : 김재철AI대학원, 2024.2,[iv, 38p. :] | - |
dc.description.abstract | Large language models (LLMs) with chat-based capabilities, such as ChatGPT, are widely used in various workflows. However, users often experience difficulties in using this technology and various dissatisfactions. Researchers have introduced several methods, such as prompt engineering, to improve model responses. However, they focus on crafting one prompt, and little has been investigated on how to deal with the user’s dissatisfaction during the conversation. Therefore, we examine end users’ dissatisfaction and their strategies to address it. After organizing users’ dissatisfaction with LLM into seven categories based on a literature review, with ChatGPT as a case study, we collected 511 instances of dissatisfactory ChatGPT responses from 107 users and their detailed recollections of dissatisfied experiences, which we released as a dataset. Our analysis reveals that users most frequently experience dissatisfaction with ChatGPT not grasping intent, while accuracy-related dissatisfactions are the most serious. We also identified four tactics users employ to address their dissatisfaction and their effectiveness. We found that users often do not try to address dissatisfaction, and even when they do, 72% remains unresolved, especially those with low knowledge of LLM. We also found that they tended to put minimal effort into resolving dissatisfaction. Based on these findings, we propose design implications for minimizing user dissatisfaction and enhancing the usability of chat-based LLM. | - |
dc.language | eng | - |
dc.publisher | 한국과학기술원 | - |
dc.subject | 인간 중심 인공지능 | - |
dc.subject | 대규모 언어 모델▼a채팅 기반 인터페이스▼a사용자 경험 조사▼a데이터셋 | - |
dc.subject | Dataset▼aHuman-centered AI | - |
dc.subject | Large language models▼aChat-based interface▼aUser experience survey | - |
dc.title | Understanding users' dissatisfaction with chatgpt responses: types, resolving tactics, and the effect of knowledge level | - |
dc.title.alternative | 대규모 언어 모델의 답변으로부터 유저가 경험하는 불만족에 대한 이해: 불만족 유형, 해결 전략 및 대규모 언어 모델에 대한 지식 수준이 미치는 영향 | - |
dc.type | Thesis(Master) | - |
dc.identifier.CNRN | 325007 | - |
dc.description.department | 한국과학기술원 :김재철AI대학원, | - |
dc.contributor.alternativeauthor | Kim, Juho | - |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.