ANGEL Testing Team

From ETS

Jump to:navigation, search

Contents

Charge

Innovative Uses of ANGEL Quizzing Team

Comprised of instructors and instructional support staff from around Penn State, the ANGEL Quizzing Team is exploring new and powerful ways to use ANGEL Quizzes. In particular, the team identified several potential areas of growth regarding the use of ANGEL quizzes. These areas include the opportunity for instructors to (1) increase the use of question banks and question pools, e,g, materials from publishers, (2) incorporate third party applications such as Captivate and Softchalk, and (3) embed multimedia files (images, sounds and movie clips) into quiz questions.

The team is compiling this information and intends to share this with instructors and support staff throughout the university via publications, virtual presentations, and video tutorials. We'll use the ETS marketing team to promote these events. Some of our avenues for promoting quiz use include:

Town Hall Meetings. These are open forums facilitated by ANGEL support staff within ITS. The town hall is held via Connect and is available to all the campuses. Town Halls focus on a single topic thus allowing for in depth discussion. These events are recorded and posted on the ANGEL Community Hub. To date our Town Hall recordings have been viewed over 4,500 times.

ANGELshorts. These are one-page documents covering a specific point of interest in ANGEL. They cover the five most essential things you need to know about the topic in order to maximize its use. To date we have published 10 ANGELshorts and they have been viewed over 5,000 times.

Video Tutorials. This is a new feature we plan to do this year in conjunction with the publication of the ANGELshorts. These will be brief tutorials, approximately 2 to 3 minutes in length, focusing on the "how to" component, For example, there could be a video tutorial on how to upload questions from a textbook publisher into ANGEL.

We plan to begin these events after the upgrade to version 7.2 on July 19. Most likely we will start around the middle of August when faculty are back in town and preparing for the semester.

Members

Meeting Times and Location

We're reconvening with weekly meetings beginning June 30th. I've scheduled 210B for an hour every Monday morning through the end of September (9:30-10:30).

Proposed Deliverables

The plan is to have two deliverables over the fall semester.

1) An ANGELshort

What: Mastery Learning is the idea that students will learn best if they fully understand, or master, one concept before going on to the next. The quiz feature in ANGEL can be used to apply the mastery learning concept.


Method: Give students learning experiences (in class learning, reading assignment, homework, etc.) followed by a quiz to assess their learning. If they haven't "mastered" the concept (i.e., if they don't reach a certain score, such as 85%), they can have additional learning experiences (such as reviewing textbook material) and re-take the quiz. Grading can be accomplished for this in various ways - a student could receive a certain point value (such as 5 points) once they have reached the required percentage. You can determine if you will count the student's latest score, or their highest score out of all attempts. Often, faculty members utilizing the mastery quizzing concept decide to have the highest score (or the "maximum submission") count. [This could be achieved via Action Editor.]

Tip: In order for Mastery Quizzing to be successful, it is recommended that you carefully choose the feedbqack you give to the students. It is recommended that you show them what answer they chose and provide feedback comments that will refer them back to a certain area of the text, or give them a hint to help in their understanding of the concept. However, it is recommended that you do not reveal to them what the correct answer actually is - the mastery learning concept will only be achieved if additional learning takes place between quiz attempts.

Note: Shorts can be turned into short video tutorials and place on the ANGEL Community Hub.

2) A Town Hall

Note: ANGEL Community Hub Town Halls are two hour sessions that focusing on a particular topic. Participants can attend in person or via Adobe Connect. Town Halls are recorded and posted on the ANGEL Community Hub for additional viewing.

Uses for ANGEL Quizzes

ANGEL quizzes have several powerful uses. They can be given at the beginning of a lesson to assess the student's prior knowledge of the topic thus enabling instructors to adopt their lesson plan accordingly. This can be followed by a lesson post test to both measure learning and determine next steps. They can be used by students as a learning tool through the practice and feedback mechanisms. Low-stakes quizzing can increase students' awareness of their progress and provide instructors with the opportunity to monitor the progress of their students' learning.

From "Engaging Students with Learning" ANGEL group The quiz feature is a prominent way to prepare students for class and to monitor their progress.

Pre-class quizzes function to prepare students for class, enabling instructors to cover more in-depth materials during the class time. Administering quizzes online also saves the time it would take to give them in class. Thus, ANGEL quizzes can improve the overall quality of the time a student spends in the classroom via increased communication, better preparation for class, and essentially providing more class time.

Note: Provide concrete examples of uses. Perhaps even mini tutorials or video samples.

Key Features of ANGEL Quizzes

ANGEL quizzes support the creation of several different question types. Additionally, each question type is capable of incorporating multimedia into the body of a question. Students can examine a photograph, listen to audio, or watch a video embedded into a question and respond. Instructors can randomize questions and answers, set beginning and end dates for quizzes, set time limits, enable or disable other items depending on student results, create mastery quizzes, limit the number of student attempts, and combine online and offline items into a single quiz. Additionally, instructors can utilize the testing center for higher stakes quizzes and have the student results populate to the gradebook.

Quiz Question Types

There are eleven types of questions available to faculty:

Pedagogical Rationale

What kind(s) of learning is best suited for each question type?

What is the assessment's objective(s)?

What is the timing of the assessment?

Pedagogical Settings

Quiz Resources

Place links to valuable reference sites here

TLT Learning Design Hub: Effective Quiz Questions http://ets.tlt.psu.edu/learningdesign/effective_questions and
Grading & Assessment http://ets.tlt.psu.edu/learningdesign/assessment Editor: Vicki Williams

9 Principles of Good Practice for Assessing Student Learning http://www.iuk.edu/~koctla/assessment/9principles.shtml

Assessment and Evaluation - links from University of Maryland's Instructional Services http://www.oit.umd.edu/units/as/cats.html

Assessment as Feedback by Grant Wiggins http://www.newhorizons.org/strategies/assess/wiggins.htm

Authentic Assessment Toolbox by Jon Mueller http://jonathan.mueller.faculty.noctrl.edu/toolbox/index.htm

Matching Objectives and Assessment - TLT http://tlt.its.psu.edu/suggestions/research/Objectives_assessment.shtml

EDUCAUSE resources: Oblinger, D. (July 2006). Technology and learning: Defining what you want to assess. Educause Learning Initiative. Retrieved October 24, 2006 at http://www.educause.edu/LibraryDetailPage/666?ID=ELI3005

Caruso, J. B. (2006). Measuring student experiences with course management systems. Educause Center for Applied Research Bulletin. Vol. 2006, Issue 19, September 12, 2006. Retrieved on October 23, 2006 at http://www.educause.edu/LibraryDetailPage/666?ID=ERB0619

Schreyer Institute Links: Classroom Assessment Techniques http://www.schreyerinstitute.psu.edu/Resources/class_assessment.asp Assessment that Promotes Learning http://www.schreyerinstitute.psu.edu/Resources/Assessment-Learning.asp Using Tests that Teach http://www.schreyerinstitute.psu.edu/Services/Assessment/Testing/ Using Mid-semester Feedback http://www.schreyerinstitute.psu.edu/Services/Assessment/MidsemesterFeedback/ Schreyer Blog: Test Better Teach Better http://www.blog.schreyerinstitute.psu.edu/index.php?q=node/10

Suggestions and Enhancement Ideas

We'll use this to document suggestions to submit to the ANGEL Team here at Penn State as well as share them with ANGEL Learning

Quiz Tags

What are the keywords we should use for easy user aggregation?


Meeting Notes 6/30

Examples of quiz uses

Common question types used

Incorporating Applications and Content Outside of ANGEL

Team Decisions

Meeting Notes 7/7/08

Team Charge

Three Items of Focus

Next Steps

Before next Monday's meeting:


Meeting Notes 7/21/08


Summary of the 9/22/08 Meeting

Retrieved from "http://ets.tlt.psu.edu/wiki/ANGEL_Testing_Team"
Navigation
Toolbox