The Cognitive Reflection Test (CRT) measures cognitive processing – specifically the tendency to suppress an incorrect, intuitive answer and come to a more deliberate, correct answer. The test is comprised of six questions, for example: (1) A bat and a ball cost $1.10 in total. The bat costs $1.00 more than the ball. How much does the ball cost? _____ cents (2) If it takes 5 machines 5 minutes to make 5 widgets, how long would it take 100 machines to make 100 widgets? _____ minutes (3) In a lake, there is a patch of lily pads. Every day, the patch doubles in size. If it takes 48 days for the patch to cover the entire lake, how long would it take for the patch to cover half of the lake? _____ days The measure is scored as the total number of correct answers.
The CRT measures the tendency to suppress prepotent responding and engage in deliberative processing. In the CRT (Frederick, 2005), cognitive ability is thought to tap into two different systems. System 1 is concerned with instant and effortless responding, whereas system 2 concerns more effortful responses, thereby requiring cognitive resources, including, motivation, effort, and so on. Each question in the test has a (wrong) impulsive answer and a right answer that requires more deliberative computation (e.g., the answer to question 1 is five cents, but most people impulsively will answer ten cents).
[+] PMCID, PUBMED ID, or CITATION
Text Citation: Frederick, S. (2005). Cognitive reflection and decision making. The Journal of Economic Perspectives, 19(4), 25-42.
This measure has not been measured yet.
This measure has not been influenced yet.
This measure has not been validated yet.
|Cognitive Reflection Survey||Visit Link|
The Science of Behavior Change (SOBC) program seeks to promote basic research on the initiation, personalization and maintenance of behavior change. By integrating work across disciplines, this effort will lead to an improved understanding of the underlying principles of behavior change. The SOBC program aims to implement a mechanisms-focused, experimental medicine approach to behavior change research and to develop the tools required to implement such an approach. The experimental medicine approach involves: identifying an intervention target, developing measures to permit verification of the target, engaging the target through experimentation or intervention, and testing the degree to which target engagement produces the desired behavior change.
Within the SOBC Measures Repository, researchers have access to measures of mechanistic targets that have been (or are in the processing of being) validated by SOBC Research Network Members and other experts in the field. The SOBC Validation Process includes three important stages of evaluation for each proposed measure: Identification, Measurement, and Influence.
The first stage of validation requires a measure to be Identified within the field; there must be theoretical support for the specific measure of the proposed mechanistic target or potential mechanism of behavior change. This evidence may include references for the proposed measure, or theoretical support for the construct that the proposed measure is intended to assess. The second stage of validation requires demonstration that the level and change in level of the chosen mechanistic target can be Measured with the proposed measure (assay). For example, if the proposed measure is a questionnaire, the score on the measure should indicate the activity of the target process, and it must have strong psychometric properties. The third stage of validation requires demonstration that the measure can be Influenced; there must be evidence that the measured target is malleable and responsive to manipulation. Evidence relating to each stage includes at least one peer-reviewed publication or original data presentation (if no peer-reviewed research is available to support the claim) and is evaluated by SOBC Research Network Members and experts in the field.
Once a measure has gone through these three stages, it will then either be Validated or Not validated according to SOBC Research Network standards. If a measure is Validated, then change in the measured target was reliably associated with Behavior Change. If a measure is Not validated, then change in the measured target was not reliably associated with Behavior Change. Why would we share measures that are not validated? The SOBC Research Network values open, rigorous, and transparent research. Our goal is to make meaningful progress and develop replicable and effective interventions in behavior change science. Therefore, the SOBC sees value in providing other researchers in the field with information regarding measures that work and measures that fall short for specific targets. Further, a measure that is not validated for one target in one population may be validated in another target or population.
Want to learn more? For any questions regarding the SOBC Validation Process or Measures Repository, please email firstname.lastname@example.org.
Has the mechanism been identified as a potential target for behavior change? This section summarizes theoretical support for the mechanism.
Have the psychometric properties of this measure been assessed? This section includes information such as content validity, internal consistency, and test-retest reliability.
Has a study manipulation led to change in the mechanism? This section addresses evidence that this measure is modifiable by experimental manipulation or clinical intervention.
Has a change in this mechanism been associated with behavior change? This section addresses empirical evidence that causing change in the measure reliably produces subsequent behavior change.