Tuesday, November 6, 2012

Computer-adaptive Testing


Computer-adaptive testing is a form of computer-based test that adapts to the examinee's ability level. For this reason, it has been called tailored testing, according to wiki. CAT selects questions so as to maximize the precision of the exam based on what is known about the examinee from previous question. Based on students response, the computer program adjusts the difficulty of the questions throughout the whole assessment. If the examinee performs well on an item of intermediate difficulty, he or she will be presented with a more difficult question. Or if he or she performs poorly, he or she will be presented with an easier item. As the assessment adapts to students' ability, the assessment can identify the skills that students mastered effectively and provide more accurate scores for all students. 




The strength and pitfalls of it
According to Smart Balanced Assessment Consortium website,  computer-adaptive testing can provide more clear picture to teachers of what students are good at and what students still need help and additional support.And also by using this program teachers,parents and principals can get the result more quickly compared with traditional testing.CAT also provides teachers and schools a more accurate way to evaluate students' ability. And also, students love this type of exam.
However,CAT can also be costly to be developed as it needs lots of test items and many pilot-testings must be conducted. Smarted Balanced estimates that once its adaptive tests are fully developed, its test bank will contain at least 30.000 items across all grades. But I still think it is worth as students can have a more accurate and fair assessment for their achievement and readiness of college and their future.



Reference:
http://www.edweek.org/dd/articles/2012/10/17/01adaptive.h06.html
http://www.smarterbalanced.org/smarter-balanced-assessments/computer-adaptive-testing/
http://en.wikipedia.org/wiki/Computerized_adaptive_testing


2 comments:

  1. Adaptive testing
    -My question is as the test adapts through the shadow tests on the students answers, how does that make sure that they too are getting challenged? Could it not in a way lead to undermining a child's potential? Or for instance only assist students who are already intrinsically motivated? Also what age group would these tests target?

    -On the other hand, not for testing the child but instead as an evaluation tool of a child's current understanding and knowledge (as you equally pointed out) on a specified topic, it could be very useful.

    -As you mentioned there may be an issue in terms of costs for certain institutions and countries; but equally to make sure that students are comfortable with the testing technique in the first place. It is stressful enough usually on a student to be tested, without additional pressure of not being sure how one is tested and the tools compounding on top of that.

    Online Testing in General
    Following the topic of online testing I thought It would be interesting to highlight the following two articles:

    1. This article shows a current online assessment dilemma in Northern Ireland at schools, resulting in their inability to complete tests on a large scale:
    > http://www.bbc.co.uk/news/uk-northern-ireland-19917228

    2. More relevant to universities- and particularly our type of courses approach of a blended and online learning design. This article looks at how and what tools we have to prevent online cheating when test-taking as well as the benefits/failures of online courses and grading.

    "It's a common problem across the sector - how do you know that the individual taking the exam is the right person?" (Peter Taylor, chair of the Open University's academic conduct group).

    The topic is addressed with reference to growing interest, keystroke measurements, iris recognition, grading discrepancies, computer lockdown, and webcams to name a few.
    > http://www.bbc.co.uk/news/business-19661899

    References
    BBC - School computer problem examined (05 OCTOBER 2012), NORTHERN IRELAND: http://www.bbc.co.uk/news/uk-northern-ireland-19917228
    Sean Coughlen (last updated 31st October, 2012) - How do you stop online students cheating?: http://www.bbc.co.uk/news/business-19661899

    ReplyDelete
    Replies
    1. I think the aim of computer-based testing is to identify whether that students mastered the skills effectively and provide more accurate scores for all students, not to challenge students. However, it could be possible to undermining a child's potential. And there is no age group limitation of using computer-based testing according to CITO http://www.cito.com/en/research_and_development/computer_webbased_testing.aspx

      Delete