Loading...

Construction and Validation of an Analytic Rubric for Human Translation Quality Assessment: A Mixed Methods Study

Jafari, Rasoul | 2018

504 Viewed
  1. Type of Document: M.Sc. Thesis
  2. Language: Farsi
  3. Document No: 51300 (31)
  4. University: Sharif University of Technology
  5. Department: Languages and Linguistics Center
  6. Advisor(s): Salehi, Mohammad
  7. Abstract:
  8. Translation quality assessment (TQA) as a systematic field of inquiry has been under scholarly investigation over the past decades. In spite of the challenges appeared in the path to success, theoretical and practical developments have already been made in translation studies. One of the unsettled and challenging problems concerning translation assessment, yet, is the subjectivity that is inherent in the process of scoring test-takers’ translation performances. In the absence of any granular objective criteria which includes all the subcomponents of translation as a multi-layer rather than unitary construct, the raters inevitably bring their intuition and will to the act of measurement. Therefore, in order to bridge the aforementioned gap, in the current research the ultimate goal was to construct an analytic rubric to bring objectivity to translation assessment. In doing so, contrary to previous scholars, in this study we built our translation quality model based on a three-fold qualitative and quantitative design. Accordingly, in the qualitative phase by conducting two interview sessions, unstructured and semi-structured ones, with 30 experts in the field of translation, an analytical rubric was constructed with five levels of subcomponents. These subcomponents consist of accuracy property, textual typology, formal property, lexical property, and culture/pragmatics property. Each of the subcomponents is composed of five levels of descriptions accounting for different levels of proficiency concerning each subcomponent. After having developed the rubric and in order to check the psychometric property of it as crucial and sensitive aspect, a questionnaire was constructed based on items that existed in the developed rubric and distributed among 100 professionals in translation. Then, construct validity of the rubric was investigated by running internal correlations among the five subcomponents and the inter-rater reliability was measured at rab= 0.9, rac= 0.9, and rbc= 0.9 among the three experienced raters through running a Pearson-product moment correlation coefficient
  9. Keywords:
  10. Validation ; Reliability ; Analytical Rubric ; Translation Quality Assessment

 Digital Object List

 Bookmark

No TOC