Help Center

How to quickly get up and running with Kritik

What is Kritik

peer-to-peer interactive learning platform designed for professors to engage students in a twenty-first-century way. Students can make online submissions for assigned activities and be evaluated based on a rubrics designed to help students emulate a professor-standard grading process. Students will also receive constructive written feedback from their peers. When you assess your peer’s work, you receive a credit for critical thinking based on the fairness of your evaluation and effectiveness of your written comment. This is called the Kritik Score. The credit is calculated and adjusted automatically by Kritik’s scoring system.Kritik is an online

Through a gamified experience, Kritik allows students to develop higher-order thinking skills through creating assignments, analyzing and evaluating peers’ submissions. Besides, students will develop the skills necessary to deliver feedback to their peers through a feedback-on-feedback system.

How Kritik Works

The teacher creates a HOTS (Higher Order Thinking Skills) activity with a grading rubric. Each Activity goes through three stages: Create >> Evaluate >> Feedback. Each stage is designed to help you develop a deeper understanding of a topic or subject matter.

Create

In the Create stage, you will follow the Activity instructions and the provided rubric to create your submission. This submission is called a Creation.

Why is my submission called a Creation?
In Kritik, we encourage Activities to be designed in a way to deepen your understanding of a topic by having you create something new with what you have learned.

Evaluate

In the Evaluate stage, you play the role of an evaluator. You will be assigned up to 5 peer creations to evaluate. Similarly, your Creation will also be evaluated by up to 5 of your peers. 

Note: Evaluations are done anonymously. You will not see who you are evaluating, and your peer will not know who evaluated them. 

You will evaluate your peers in two ways. You will score your peers based on a rubric provided in the Activity as well as give a written evaluation.

Why evaluate my peers?
By evaluating your peer's Creations, you will be learning a new skill set. And through this learning experience, develop a stronger understanding of the subject matter. 

  • By seeing how your peer's approached the Activity, you will gain new insights and knowledge that you can apply in the future
  • By evaluating your peer's Creations, you will develop essential skills on how to self evaluate and improve the overall quality of your work

Feedback

In the Feedback stage, you are given the opportunity to provide evaluators feedback on how they evaluated you. Similarly, your peers will give you feedback on how you evaluated them.

During this stage, you will be helping each other learn how to become stronger evaluators. You will score the peer evaluator on two different aspects of their written evaluations. 

  • Motivational: How motivating was the written evaluation
  • Critical: How helpful was the written evaluation

Tying it all together

Finally, at the end of the three stages, you will be given three scores. You will be scored on your Creation (Creation Score). You will be scored on how strong of an evaluator you are (Kritik Score). And you will be given points for participating in each stage of the Activity.

How does my instructor participate in the Activity?
Throughout the three stages, your instructor has full visibility of all Creations and Evaluations at any time. They may choose to interject, send you a note or edit peer evaluations as they see necessary.

How Scoring Works

Kritik ultimately evaluates three things: a Creation Score, Kritik Score, and Participation Score

Creation Score

The Creation Score is essentially the weighted average of your peer evaluations given to your Creation.

Particpation Score

The Participation Score is a percentage of the assigned peer evaluations and feedback that you have completed

Kritik Score

Kritik Score represents how strong of an evaluator you are. It is a combination of how well you graded your peers (Grading Skill), and how strong your written evaluation was (Feedback Skill). 

Kritik Score Rankings

Everyone starts with a Kritik Score of 2000 (Rank 2). When you complete an Activity, you gain or lose Kritik Score based on your performance as an evaluator. At every 1000 point gain, you go up in rank, and your profile border changes. Below is a list of all the ranks and their respective Kritik Score ranges.

Krtik Score Breakdown

Grading Skill

Grading skill is defined by how accurately you score your peer's Creations. Grading skill is calculated by comparing the score you gave a peer's Creation to the weighted average of the scores your peers gave. The closer you are to the weighted average, the more points you get for Grading Skill.

For example, if your peers score a creation on average a 2, but you scored it a 4, you would be off by a factor of 2 and would lose Grading Skill points.

What is the weighted average?
The higher your Kritik Score, the more influence or weight the score you give has.


Feedback Skill

The quality of your written evaluation scored by the peer you evaluated. During the feedback stage of an activity, the peer you evaluated will score your written evaluation based on how Motivational and Critical you were.

Motivational
As an evaluator, was your evaluation motivating or discouraging? 

A good motivationally written evaluation focuses on an area of improvement in the work created, not the creator. Avoid making assumptions on the creator's intent and subjective comments. 

Critical
As an evaluator, how helpful was your written evaluation?

A good critically written evaluation explains the impact of the mistake your peer made, as well as what they can do differently to improve.  

How to Evaluate a Peer

Scoring

For rubric evaluation, carefully follow the descriptions provided in the rubric cells. In the comment section, try to bring up one or a maximum of two important things that your peers could do to improve, but don’t forget to mention any great things about their work to reinforce those actions. Make your points clear and actionable and if possible, provide specific examples.

Written Evaluation

It is crucially important to keep a positive and constructive tone and avoid using words that may demotivate the readers or offend them. Our brain has evolved to remember negative feedback much longer than positive ones. Therefore, for every critical feedback on areas of improvement, you should mention two or more things that are positive about your peers’ submission, so reading your feedback will leave them with a net neutral or positive feeling and keep their motivation.

Starting out

Don’t worry at the beginning when you are still uncertain how to evaluate or provide comments. It is your participation that matters. After completing a few activities and peer evaluations through the semester, and by paying careful attention to the changes to your Kritik Score as well as any potential comments you may have received from peers you have evaluated, you will soon learn how to fairly evaluate others work just like a TA!


Note: Evaluations are done anonymously. You will not see who you are evaluating, and your peer will not know who evaluated them.

How to Give Feedback on Feedback

In the Feedback stage, all the comments from your peers along with their Kritik Score will be revealed to you, while their identity remains anonymous. You have the opportunity to give feedback to the evaluators based on the quality of their comments and help them adjust their feedback delivery in future evaluations.

Feedback Scoring

You are required to give your feedback by plotting their comments on a motivational (ranging from Very Discouraging to Very Motivational) and critical scale (ranging from Incorrect Direction to Very Helpful). You may also submit a comment for further instruction.

For example, If you feel the evaluation comment is not only unhelpful but also instructs you in the wrong direction, pick the point “Incorrect Direction”. If you feel the comment is simply too soft and does not challenge you to improve, pick the point “unhelpful” on the left side of the critical spectrum. Similarly, if you feel the tone is harsh and or doesn’t acknowledge any positive aspect of your submission, you may choose a point on the left side of the motivational scale.

How to Dispute and Flag

After you have received the evaluations from your peers, and while the activity is still in the "Feedback" stage, you may dispute your grade only if you believe your overall grade doesn’t fairly reflect your submission based on the rubric. You may also flag your peers’ comments if you think they are offensive or inappropriate. You must provide a reason why you are flagging a comment or disputing your grade.

When you dispute an item, your teacher or TA of the course will be notified. He/she will review your work and resolve the dispute by either increasing, decreasing or keeping your grade. Keep in mind that your action to dispute is a reflection of your evaluation skills. Therefore, you may lose your Kritik Score if the teacher doesn’t agree with your dispute.

The Science behind Kritik

Lower Levels of Cognitive Learning

According to the paper published by Benjamin Bloom in 1956, the complete cognitive functioning in learning must include six core elements. First, Memorization which is remembering and recalling names, and labels. Secondly, Comprehension, understanding how a concept works and being able to explain it beyond the mere vocabulary we initially memorized. Third is Application, which is applying the concept that we understand in a real-life situation. Above are the first three stages of Bloom's Taxonomy. Furthermore, up until Application, we have completed the lowest half of the cognitive levels.

Higher Levels of Cognitive Learning

Next, we are going to deepen our learning by entering the higher order thinking realm following with Analysis. Analysis consists of breaking down ideas or objects into smaller components, drawing connections and finding evidence to support generalizations. Next, Evaluation is rejecting or defending a stand or decision based on Analysis. Finally, at the highest level is Creation, which is an individual being able to produce a new idea or object by compiling components in a creative and innovative way. Kritik focuses on strengthening students' higher order of thinking skills (HOTS), also referred to as critical thinking skills.

How Marks are Calculated

  • Creation mark: your total rubric grade for the HOTS activities: It is typically the weighted average of the rubric grades given by your peers, unless the instructor has edited it.
  • Kritik Score: Your most recent Kritik Score, displayed by the border around your profile photo or in your dashboard.
  • Feedback Delivery Score: Average feedback-on-feedback points you received from students you peer evaluated in the last completed activity.
  • Participation to peer evaluation: It is the percentage of completed peer evaluations during Evaluate stage
  • Participation to Feedback on Feedback: it is the the percentage of your completed Feedback-on-Feedback task you have completed during Feedback stage
  • Your Kritik Score and Feedback Delivery Score (FDS) are always available in your dashboard while the other grades can be accessed by downloading your gradebook excel file.

How Marks are Calculated

  • How to reset your password