Menu

Eli Review Learning Resources

Making the Process Count

Eli Review does not include a gradebook. Eli is a workshop space where students improve their drafts alongside peers; it’s not showcase space where finished products are assessed. Using Eli’s analytics, instructors see evidence of learning and coach students accordingly.

The work students do in Eli Review as writers and reviewers, however, is valuable enough to grade.

Consider making Eli Review tasks worth 10-15+% of the course grade.

If you are assigning rapid feedback iterations such that they are writing smaller bits, reviewing those bits for a few criteria, and revising some of those drafts using a revision plan and/or a resubmission, students will do a lot of work in Eli. For example, the course dashboard for Bill Hart-Davidson’s Technical Writing course includes 4 modules and 51 tasks; John Holland’s first-year writing course includes 14 distinct projects and 57 tasks. Make sure that the course grade reflects the proportion of work you are assigning in Eli Review.

As described below, three approaches can be used to calculate this percentage:

Grading on Task Completion

1) Completion within a single assignment

Eli’s purpose is to help students get better at giving feedback and revising, and they need deliberate practice in order to improve. Grading a single instance of that practice on its quality penalizes students for engaging in the learning process. If you encourage students to use all of Eli’s features, they can complete the following elements for points:

Eli Review Activities Points if Review and Revision are Required Points if No Revision is Required
Write/Upload the draft 1 2
Review assigned peers 1 2
Rate the helpfulness of the comments received 1 1
Make a revision plan 1 not required
Re-submit revised draft 1 not required
Total 5 5

Of course, instructors can vary point values as they see fit, but this example shows how to keep the points earned consistent whether the assignment includes revision or not.

2) Completion across an entire term

For classes where Eli is used to provide low-stakes peer feedback without a strong instructional emphasis on better commenting strategies or on revision, assessing completion is a good option. The Engagement Highlights report provides a quick snapshot:

  1. Click “Roster” from anywhere in your course.
  2. Click the name of any student.
  3. Click the “Highlights tab.
student-engagement

These analytics show how a student’s completion of tasks compares to the top 30%, average, and bottom 30% of the class. For ease, instructors might decide to use students’ completion rates to assign grades.

Engagement

Assess engagement in feedback and revision across multiple reviews.

This strategy works well for instructors who are emphasizing better commenting and revision. At the end of a project that has included multiple write-review-revise cycles or at the end of the term, instructors can use Eli’s Analytics to assess students’ engagement with the process. Again, as a formative feedback tool, Eli measures “engagement” as completing assigned writing, review, and revision tasks as well as counting various aspects of that work (word count, quantity of comments, quantity of endorsed comments, etc). To simplify, instructors can get an overall sense from the “Engagement Data” analytics per student.

  1. Click “Roster” from anywhere in your course.
  2. Click the name of any student.
  3. Click the “Engagement Data” tab.

These analytics show how a student’s engagement compares to the top 30%, average, and bottom 30% of the class. For ease, instructors might decide that students who consistently fall in

NOTE: In a class full of similarly capable and engaged students, the difference between the top and bottom 30% may be negligible. So, the grading scale might go from B+ to A+.

grading-engagement-data

 

This screenshot from the “Engagement Data” report shows how instructors can make a quick assessment of a student’s work as a writer and reviewer over the term; for Anika, we can tell:

The other reports in the student-level analytics provide more ways to assess individual student engagement and quality, if this snapshot is insufficient.

Reflection

Students’ completion of review and revision tasks in Eli are acts of learning; asking them to reflect on that body of work is a way of seeing how explicit their knowledge is.

Ask students to reflect on their growth as writers.

Reflections about how writers have grown over the term are common in portfolios*. If students have been working on revision plans throughout the term, their course dashboards have a rich archive of the decisions they’ve made along the way. In an end-of-term reflection, instructors can offer a prompt along these lines:

Look back over the feedback you’ve received and your revision plans. What were the three most important comments you received from peers, and how did they affect the revisions you completed? Explain the comments, your reactions to them, why they were helpful, your revisions, and how these comments may impact your future work.

*See portfolio principles from NCTE and CCCC as well as resources from AAEEBL.

Ask students to reflect on their growth as reviewers.

Eli’s unique features in review tasks aggregate all the comments reviewers’ give peers in a single digest. The comment digest plus helpfulness ratings makes it easy for instructors to explicitly teach students to give helpful comments and to treat comments as a genre.  Through deliberate practice over time, reviewers should improve. If instructors have emphasized the qualities of helpful feedback, then students can look back over their work as reviewers and find evidence of their growth.

Because it is unusual to assign reflection specifically about review work, we offer several examples. Consider this directive prompt that asks reviewers to connect their performance with the criteria of helpful feedback:

Eli Review helps you become a better reviewer because the review task helps you read drafts according to criteria and then guides you in giving better feedback as you explain to writers what you see. Write a 300-word reflection that begins “My work in Eli Review helped me become a (slightly better/better/much better) reviewer because I improved my ability to (explain).” In your reflection, use evidence from the “Review Feedback” tab in the “review tasks” you’ve completed this term to show you improved in at least three of the following areas:

Asking students to argue for the grade their work as reviewers deserves can also facilitate meaningful reflection:

Eli Review’s analytics aggregate your helpfulness ratings over the whole term; on the “Review Feedback” tab in the “review tasks,” you can also access all the comments you’ve given to your peers this term. Write me a letter in which you argue for the grade you think your work as a reviewer deserves, and use your helpfulness rating and examples from the comments you gave in Eli to support your claim.

Another type of reflective prompt asks students to describe helpful feedback using only comments they’ve made this term:

We’ve spent a lot of time this term discussing the qualities of helpful feedback. Using only three comments you gave reviewers this term (locate them on the “Review Feedback” tab in the “review tasks”), write a set of guidelines for giving helpful feedback that would be appropriate for me to share with my students next term. Be sure to connect your advice to specific aspects of the comments and to explain why comments that follow your suggestions will be helpful for writers.


Digging Deeper

This tutorial covers ways to assess the work students complete in Eli. Related resources include:

Other resources for learning about teaching with Eli Review include:

[resource-table]

You can also find human support to help you learn how to use Eli Review effectively. You can contact Melissa Meeks, Eli’s director of professional development, and:

Have any additional questions about how to use Eli Review? Contact us at [email protected].

 

upward arrow button