Mon10Jun20132pm - 3pmLancaster University, FASS Meeting Room 3
UCREL Corpus Research Seminar: "Boring, pompous and arrogant" or "funny, interesting, and HOT!" What university students really think of their professors!
The evaluation of the effectiveness of teaching in universities most commonly involves asking students for feedback - so called Student Evaluations of Teaching (SETs). These are typically written questionnaires comprising predominantly Likert-scale type items. As such, the responses that students can provide are heavily constrained by the design of the instrument. Although SETs often contain opportunities for free-text comments, to date, there have been no large-scale analyses of the perceptions, opinions and beliefs that the students themselves choose to express. Systematic analyses of free-text responses have the potential to inform our understanding of what students value in teaching, what constitutes effective teaching and how we might best assess it.
This presentation reports a large-scale analysis of over half a million free-text comments on the popular review website RateMyProfessors.com (RMP). Principal components analysis (PCA) of adjectives was used to identify how students commonly perceive their instructors. Seven principal components were extracted and categorized based on component loadings:
- HELPFULNESS (e.g. helpful, willing, approachable)
- FUNNINESS (e.g. funny, hilarious, entertaining)
- INTELLIGENCE (e.g. brilliant, intelligent, knowledgeable)
- RUDENESS (e.g. rude, condescending, arrogant)
- INCOMPETENCE (e.g. disorganized, confusing, not_clear)
- TOUGHNESS (e.g. tough, difficult, not_easy)
- HOTNESS (e.g. hot, gorgeous, sexy)
Secondary analyses explored the relationship between these dimensions and (1) corresponding Likert scale ratings, and (2) the Five Factor model of personality traits. It is argued that the components reflect latent dimensions along which commonly perceive their instructors. Discussion of the results raises practical implications for educational assessment and teaching, and methodological implications for the use of questionnaire data in the social sciences.