Where have we been? What were the problems/struggles that made you look for an auto-grader?

Where are we? Demo and play. 

Where are we going? Future thinking the field and our own college needs

7:30am - 9:00am   Registration and Coffee

9:00am - 9:30am   Welcome and Introduction
Speakers: 
Erin DeSilva, Instructional Designer, Dartmouth College
Tammie Patten, Educational Technologist, Dartmouth College

Group sharing about questions on everyone’s mind re: auto-grading.

9:30am - 11:30am   Where Have We Been?
Speakers:    
Erin DeSilva, Instructional Designer, Dartmouth College
Tammie Patten, Educational Technologist, Dartmouth College

Schools that have been working with this technology, at various stages of implementation, will present some answers to the following questions:

What are the problems you are trying to solve with auto-grading technology? How did you conduct a product review? Those in the early stages, what will be your signs of success? Those in later stages, what are the results you’re seeing so far? (20 mins presentation, 5 mins Q&A, 5 mins transition)

9:30am - 9:50am   Amherst: Gradescope:  Using Gradescope for Mathematics and Programming Assignments
Speaker:  Nathan Pflueger, Assistant Professor of Mathematics, Amherst College

 have used Gradescope for electronic grading of homework, exams, and programming assignments for several mathematics courses at Amherst College. For my courses, most work is handwritten and must be scanned by students or staff. Recently I've also begun using it to automatically grade programming assignments, which offers instant feedback to students but requires significant prep work. I will discuss the nuts and bolts of the workflow for me, the course staff, and the students, and a few lessons I've learned along the way about how to keep the process efficient and delivering useful feedback to students.

10:00am - 10:20am   Tufts: Gradescope-Supporting Department-specific Adoption of a Tool from a Central IT Perspective
Speaker: Jake Dempsey, Educational Technology Specialist, Tufts University

When a department initiates the adoption of an auto-grading tool on their own, how does central IT help facilitate the on-boarding, support the tool, and negotiate interest from other departments? I will talk about how we helped our Computer Science department adopt and roll-out Gradescope and how we are evaluating the tool for potential wider adoption across the university. 
 

10:20am - 10:40am   Assumption: Quickeval
Speaker:  Beth Peterson, Instructional Technology Specialist, Assumption College

10:40am - 10:50am   Break

10:50am - 11:10am   WPI:  Replacing Self-Paced Polling with Gradehub
Speaker:  Lindsey Van Gieson, Instructional Technology Systems Manager, Worcester Polytechnic Institute

WPI is phasing out the use of physical clicker devices. Poll Everywhere covered the majority of our use cases, but we still needed a solution for large classes using the self-paced polling tool. We piloted Gradehub for this in the Fall term and will share our experiences.

11:10am - 11:30am   ETS: Writing:  Automated Writing Evaluation -- looking back, looking forward
Speaker:  Beata Beigman Klebanov, Senior Research Scientist, Educational Testing Service

In this presentation, we will look at the history of the automated evaluation of essays and reflect on what has been achieved and on the outstanding challenges.

11:30am - 12:10pm   Growing Your Own Solution

What happens when the commercial solutions developed don’t work for you? Two schools that have developed their own solutions will share their cases. Michigan and Dartmouth have both coded applications to meet the needs of their faculty.

You Write Tests, We Run Them: Building a Secure Autograder for CS Courses with Diverse Needs (University of Michigan)
Speakers:  James Perretta, Instructional Learning Senior, University of Michigan

Developed at the University of Michigan, Autograder.io supports the diverse needs of 13 CS courses with 4600 students enrolled each term. In this presentation, we’ll explore the technologies and abstractions that keep basic tasks simple but still leave room for advanced usage, all while ensuring the security of the system and the integrity of the test cases.

When Building IT makes more sense than buying it (Dartmouth College)
Speakers:  Jane Reynolds and Ben Servox, Thayer School of Engineering at Dartmouth College

Over the past several years, the Thayer School of Engineering at Dartmouth has built several tools for class polling, coding, slide editing, and others. We’ll discuss our decision process for building versus buying, along with the rewards and unforeseen consequences this unusual approach have yielded.
 

12:15pm - 1:15pm   Lunch

1:15pm - 2:15pm   Where Are We Now?
Speakers:   
Erin DeSilva, Instructional Designer, Dartmouth College
Tammie Patten, Educational Technologist, Dartmouth College

For an hour of sandbox time, each of the presenters from the morning will set up a table to do some show and tell of their implementation of their tools. Participants will be encouraged to float among these presenters, asking questions and getting a deeper look at the technology.

2:15pm - 3:00pm   Where are we going?
Speakers:   
Erin DeSilva, Instructional Designer, Dartmouth College
Tammie Patten, Educational Technologist, Dartmouth College

Individual brainstorm about next steps followed by group brainstorm on working with vendors in this area, potential white paper authors recruited.

 

3:00pm   End