Exploring, analyzing and improving existing student web-based peer review systems has led Arizona State University's David Tinapple to a research award of nearly $2 million from the National Science Foundation.
Tinapple, an assistant professor in the School of Arts, Media + Engineering in the Herberger Institute for Design and the Arts, applied for the grant under the NSF program "Improving Undergraduate STEM Education."
In conjunction with the Division of Undergraduate Education, this program is geared toward advancing the improvement of undergraduate STEM (science, technology, engineering and math) education by supporting the development of innovative learning technologies “through funding research on design, development and wide-spread implementation of effective STEM learning and teaching knowledge and practice, as well as foundational research on student learning,” according to the website.
“Our project will identify ... core design concerns common to all peer review systems and build web services available for use in any peer-review system,” Tinapple explains. “These web services will include algorithms for intelligently assigning student reviewers to specific peers, determining reviewer reputation, assessing review quality and measuring the credibility of student reviews.”
The project is titled "Collaborative Research: Research in Student Peer Review: A Cooperative Web-Services Approach."
Tinapple had already laid down the groundwork for the project with his work on an internal peer-review system with fellow Arts, Media + Engineering faculty member Loren Olson, who leads the school’s instructional technology team.
“David Tinapple and Loren Olson’s work on CritViz started as a clever response to the serious problem of how to retain some of the quality of feedback available in a studio-based course when the student to faculty ratios are up to 10 times greater than a typical studio," said Sha Xin Wei, director of the School of Arts, Media + Engineering. "The web-based peer critique system is a set of techniques for peer critique that shows promise to elevate the level of student-centered learning. This sort of work has tremendous potential for scaling aspects of quality studio critique to large numbers of students in creative practice courses in ‘nearline’ learning, and to greatly amplify their learning experience in the classroom itself as well.”
Under Tinapple’s direction, the three-year project will bring together five researchers in academic peer review, including several who have developed peer-review systems, and an advisory board that includes developers of the largest online peer-review systems in North America. The team’s larger goal is to advance the state of the art in peer assessment, which is increasingly important not only in traditional classroom settings, but also in online courses and massive open online courses.