Quality Matters rubric categories

need for rubric

Resources

Links and resources from the second half of the chat and Q&A:

• TAG Feedback Protocol via https://learninginhand.com/blog/feedbackchat
• Robin DeRosa's OER pedagogical endeavor
• Annotation Rubrics
• Faculty Focus Live - A Hyflex Course: Bridging the Gap Between Online and In-person Students
• Bringing Theories to Practice: Universal Design Principles and the Use of Social Annotation to Support Neurodiverse Students by Christian Aguiar, Fatma Elshobokshy, and Amanda Huron
• Compass Points rubric

Video

<iframe width="560" height="315" src="https://www.youtube-nocookie.com/embed/KkgXkJZXa0E" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe>

Watch on YouTube

The challenge here seems to be about implementing human-centered practices in classrooms situated within a culture or larger system that does not prioritize or support humanity or human relationships. Assignment rubrics are often sold to instructors as a time-saving tool (to avoid students contesting their grades), while we could instead highlight the value of rubrics as a guide to help students focus on the important learning points.

Compass Points, a routine for examining propositions.

via https://pz.harvard.edu/sites/default/files/Compass%20Points_0.pdf

• E- excited
• W- worrisome
• N - need to know
• S - stance or suggestion for moving forward

These could be used as a simple set of rules for thumb for evaluating and expanding on ideas in note taking or social annotation settings.

Compare these with the suggestions of Tiago Forte in his book Building a Second Brain. Which is better? More comprehensive? Are there any ideas missing in a broader conceptualization? Is there a better acronymization or analogy for such a technique?

https://docs.google.com/document/d/1N4LYLwa2lSq9BizDaJDimOsWY83UMFqqQc1iL2KEpfY/edit

P.R.O.B.E. rubric participation (exceeds, meets fails), respectful, open, brave, educational

Mentioned in the chat at Hypothes.is' SOCIAL LEARNING SUMMIT: Spotlight on Social Reading & Social Annotation

in the session on Bringing the Margins to Center: Introduction to Social Annotation

---

Looking at the idea of rubrication, I feel like I ought to build a Tampermonkey or Greasemonkey script that takes initial capitals on paragraphs and makes them large, red, or even illuminated. Or perhaps something that converts the CSS of Hypothes.is and makes it red instead of yellow?

What if we had a collection of illuminated initials and some code that would allow for replacing capitals at the start of paragraphs? Maybe a repository like giphy or some of the meme and photo collections for reuse?

Clear framework for quality criteria

Evaluation is not the same as feedback. Evaluation is almost always directed at unsolicited advice. Feedback may praise or criticize, but usually seeks value in something.

Interesting implication about rubrics. Advocates do find them humane. Yet it's probably fair to say that not all rubrics appear humane to those who are submitted to them.

My hunch is that both can be quite useful as starting points.

"Too often" is interesting here. It leaves the door open for rubrics which do provide guidance and aspirational goals. That's an intriguing challenge.

Does a rubric still create the same sense of arbitrariness, though? That's been one of my main challenges of ungrading:

• how to not shift the burden of the responsibility of judgment from me to my students?
• how to avoid rubrics that simply re-inscribe the values I'm trying to eschew?

https://www.alfiekohn.org/article/trouble-rubrics/

bookmark

The Rubric for E-Learning Tool Evaluation offers educators a framework, with criteria and levels of achievement, to assess the suitability of an e-learning tool for their learners' needs and for their own learning outcomes and classroom context.

Engineering focus, but a very detailed rubric of how to rank different personnel levels. Could maybe be generalized/adapted for other fields.

How neat would it be if Hypothesis supported rubrics as annotations?