Caveon Data Forensics™ (View PDF)

Cheaters often leave clues, in the form of hard-to-detect patterns that can appear on individual tests, within a specific testing site, or worldwide. For some time there has been a significant need for technologies that can quickly and continuously quantify, verify, and control exam compromise to protect both the value of the test and the reputations of the test publisher or administrator. Until recently, however, no adequate avenue was available for spotting the aberrant patterns that indicate cheating or test fraud.

Caveon’s patent-pending Data Forensics system utilizes sophisticated, statistical analyses of test-response data to identify patterns indicative of test fraud, including cheating and piracy. In addition to its sophisticated analysis of item responses and, for test administrations that are delivered via computer, Data Forensics examines the responses from all possible pairs of examinees within and across test administration sites to assess the extent to which examinee response patterns are so similar that they may be indicative of organized cheating, or collusion (e.g., use of common “test prep” materials obtained from a braindump site or test prep course).

What Are Caveon Data Forensics?
Caveon statisticians and psychometricians have developed and continue to develop proprietary statistical tools and methods that are particularly sensitive to aberrant test-taker patterns. These tools turn cheaters’ clues into useful information about the data so you can secure your tests.

Caveon Data Forensics returns three basic types of detailed reports to give you a snapshot of what is happening once your test is “out there.” You have control of your program because you can track and measure its performance:

Temporal Report
Provides periodic data so you can see when natural test drift occurs and when results become aberrant, indicating the possibility of piracy and cheating. If the program is in good shape—it’s not drifting too far—tests won’t have to be redeveloped as early as you had planned. If the test results are aberrant, it may be in your best interests to pull and redevelop the tests earlier than planned. Either way, you can make an informed decision about the best course of action.

Geographical Report
Identifies in which locations aberrant test scores are appearing. For example, if hundreds of examinees in a certain geographic area score well above the norm on the same test, you should be suspicious and investigate further.

Examinee Report
Indicates who may be compromising your tests. Proxy test-takers leave clues, like cheaters do, and the Examinee report helps you identify them.

Aberrance shows up in many ways, and with Caveon Data Forensics you’ll see it. And because the reports you receive are detailed, they provide needed documentation and evidence should you pursue legal action against individuals or entities that pirate or cheat on your tests.

What If I Need More?
Beyond Caveon Data Forensics, Caveon also offers Advanced Analysis Services. This includes access to Caveon Security Directors who drill into critical data to understand the nature of the suspected test compromise. The services provide you with access to psychometricians and statisticians to formulate and estimate detailed models for gaining a deeper view of the potential compromise.

> Recent Innovations in Data Forensics - 2006

> Defensibility of Caveon's Statistics

Send this page to a friend.