Effect of Rubric Rating Scale on the Evaluation of Engineering Design Projects

Cited 1 time in webofscience Cited 0 time in scopus
  • Hit : 274
  • Download : 0
DC FieldValueLanguage
dc.contributor.authorThompson, Mary Kathrynko
dc.contributor.authorClemmensen, Line Harderko
dc.contributor.authorAhn, Beung-ukko
dc.date.accessioned2014-08-29-
dc.date.available2014-08-29-
dc.date.created2014-02-10-
dc.date.created2014-02-10-
dc.date.issued2013-
dc.identifier.citationINTERNATIONAL JOURNAL OF ENGINEERING EDUCATION, v.29, no.6, pp.1490 - 1502-
dc.identifier.issn0949-149X-
dc.identifier.urihttp://hdl.handle.net/10203/188641-
dc.description.abstractThis paper explores the impact of the rubric rating scale on the evaluation of projects from a first year engineering design course. A small experiment was conducted in which twenty-one experienced graders scored five technical posters using one of four rating scales. All rating scales tested produced excellent results in terms of inter-rater reliability and validity. However, there were significant differences in the performance of each of the scales. Based on the experiment's results and past experience, we conclude that increasing the opportunities for raters to deduct points results in greater point deductions and lower overall scores. Increasing the granularity of the scale can reduce this effect. Rating scales that use letter grades are less reliable than other types of scale. Assigning weights to individual criteria can lead to problems with validity if the weights are improperly balanced. Thus, heavily weighted rubrics should be avoided if viable alternatives exist. Placing more responsibility for the final score on the grader instead of the rubric seems to increase the validity at the cost of rater satisfaction. Finally, rater discomfort can lead to intentional misuse of a rating scale. This, in turn, increases the need to perform outlier detection on the final scores. Based on these findings, we recommend rating scale rubrics that use simple 3 or 4-point ordinal rating scales (augmented checks) for individual criteria and that assign numerical scores to groups of criteria.-
dc.languageEnglish-
dc.publisherTEMPUS PUBLICATIONS-
dc.subjectOPTIMAL NUMBER-
dc.subjectLIKERT-SCALE-
dc.subjectRELIABILITY-
dc.subjectALTERNATIVES-
dc.subjectVALIDITY-
dc.subjectCOURSES-
dc.titleEffect of Rubric Rating Scale on the Evaluation of Engineering Design Projects-
dc.typeArticle-
dc.identifier.wosid000329815000017-
dc.identifier.scopusid2-s2.0-84891930884-
dc.type.rimsART-
dc.citation.volume29-
dc.citation.issue6-
dc.citation.beginningpage1490-
dc.citation.endingpage1502-
dc.citation.publicationnameINTERNATIONAL JOURNAL OF ENGINEERING EDUCATION-
dc.contributor.localauthorAhn, Beung-uk-
dc.contributor.nonIdAuthorThompson, Mary Kathryn-
dc.contributor.nonIdAuthorClemmensen, Line Harder-
dc.type.journalArticleArticle-
dc.subject.keywordAuthorengineering design-
dc.subject.keywordAuthorevaluation-
dc.subject.keywordAuthorrating scale-
dc.subject.keywordAuthorrubric-
dc.subject.keywordAuthorpsychometrics-
dc.subject.keywordPlusOPTIMAL NUMBER-
dc.subject.keywordPlusLIKERT-SCALE-
dc.subject.keywordPlusRELIABILITY-
dc.subject.keywordPlusALTERNATIVES-
dc.subject.keywordPlusVALIDITY-
dc.subject.keywordPlusCOURSES-
Appears in Collection
RIMS Journal Papers
Files in This Item
There are no files associated with this item.
This item is cited by other documents in WoS
⊙ Detail Information in WoSⓡ Click to see webofscience_button
⊙ Cited 1 items in WoS Click to see citing articles in records_button

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0