Statistics of Reason - Revision 2008

© Paul Cooijmans

Scores on Reason - Revision 2008 as of 12 September 2019

Contents type: Logical.   Period: 2008-present

1 *
4 *
6 *
24 *
27 *
28 **
47 *
49 *
53 *
56 **
57 *
59 *
60 ***
62 ***
63 *
67 *
68 *
69 *
70 *
71 *
72 ****
73 *
74 *
75 *
76 *
78 *****
79 ****
80 **
82 *
83 **
84 ******
85 **
86 ****
87 *****
88 ********
89 *
91 *
92 ***
93 *
94 **

Scores by males

n = 76

1 *
4 *
6 *
24 *
27 *
28 *
47 *
49 *
53 *
56 **
57 *
59 *
60 ***
62 ***
63 *
67 *
69 *
70 *
71 *
72 ***
73 *
74 *
75 *
76 *
78 *****
79 ****
80 **
82 *
83 **
84 *****
85 *
86 ****
87 *****
88 ********
89 *
91 *
92 ***
93 *
94 **

Scores by females

n = 5

28 *
68 *
72 *
84 *
85 *

Correlation of Reason - Revision 2008 with other tests by Paul Cooijmans

(Test index) Test name n r
(21) Psychometric Qrosswords60.94
(82) Reason110.89
(40) Reason Behind Multiple-Choice - Revision 2008780.88
(30) Verbal section of The Marathon Test100.79
(48) Narcissus' last stand120.78
(0) Test of the Beheaded Man170.78
(109) The Bonsai Test - Revision 2016120.78
(47) Psychometrically Activated Grids Acerbate Neuroticism50.77
(111) Test For Genius - Revision 201680.71
(29) Words80.71
(36) Reflections In Peroxide130.71
(110) Cooijmans Intelligence Test 570.70
(31) Numerical section of The Marathon Test120.69
(45) Numerical and spatial sections of The Marathon Test120.68
(66) Test For Genius - Revision 2004160.67
(41) The LAW - Letters And Words80.67
(42) The Marathon Test80.66
(105) Space, Time, and Hyperspace - Revision 2016110.66
(112) Combined Numerical and Spatial sections of Test For Genius - Revision 2016100.64
(33) Problems In Gentle Slopes of the first degree90.64
(1) Cartoons of Shock210.63
(32) Spatial section of The Marathon Test120.63
(84) Bonsai Test50.61
(7) The Final Test170.59
(35) Intelligence Quantifier by assessment270.59
(68) Numbers70.55
(27) Spatial section of Test For Genius - Revision 2004300.55
(28) The Test To End All Tests150.55
(37) Problems In Gentle Slopes of the third degree120.51
(2) Cooijmans Intelligence Test - Form 3310.50
(3) Qoymans Multiple-Choice #5790.47
(57) Space, Time, and Hyperspace70.46
(87) Cooijmans Intelligence Test - Form 2100.45
(16) Lieshout International Mesospheric Intelligence Test270.45
(75) Analogies of Long Test For Genius50.44
(4) A Paranoiac's Torture: Intelligence Test Utilizing Diabolic Exactitude150.44
(117) The Hammer Of Test-Hungry - Revision 2013100.43
(26) Verbal section of Test For Genius - Revision 2004270.43
(23) Gliaweb Riddled Intelligence Test - Revision 2011230.41
(62) Reason Behind Multiple-Choice100.40
(44) Associative LIMIT220.40
(18) The Nemesis Test130.39
(104) The Final Test - Revision 2013100.38
(108) Verbal section of Test For Genius - Revision 201680.37
(54) Test of Shock and Awe50.37
(25) The Sargasso Test220.36
(12) Cooijmans On-Line Test - Two-barrelled version170.36
(10) Genius Association Test260.35
(80) Qoymans Multiple-Choice #4150.32
(106) Cooijmans Intelligence Test - Form 4180.23
(19) Numerical section of Test For Genius - Revision 2010270.23
(39) Combined Numerical and Spatial sections of Test For Genius - Revision 2010180.21
(15) Letters90.19
(103) Problems In Gentle Slopes of the second degree100.18
(43) Test For Genius - Revision 2010120.15
(53) Qoymans Multiple-Choice #370.12
(116) Gliaweb Riddled Intelligence Test (old version)100.11
(11) Isis Test250.07
(55) Spatial Insight Test50.06
(107) The Alchemist Test70.00
(5) Daedalus Test10-0.01
(79) Association subtest of Long Test For Genius5-0.08
(46) Labyrinthine LIMIT6-0.16

Weighted average of correlations: 0.492 (weighted sum: 477.52)

Conservatively estimated minimum g loading: 0.70

Ranking in above table is based on the unrounded correlations. All available data is present in this table, no tests are left out except for those with less than 5 score pairs. All known pairs are used, including possible floor/ceiling scores or outliers.

Correlation of Reason - Revision 2008 with tests by others

(Test index) Test name n r
(239) Titan Test70.91
(238) 916 Test70.62
(235) Nonverbal Cognitive Performance Examination60.35
(225) Logima Strictica 3690.27
(211) Culture Fair Numerical Spatial Examination - Final version50.26
(231) Mysterium Entrance Exam90.16
(242) Unknown and miscellaneous tests320.16
(234) Strict Logic Sequences Exam I170.13
(240) Strict Logic Spatial Exam 4880.08

Weighted average of correlations: 0.258 (weighted sum: 25.76)

Ranking in above table is based on the unrounded correlations. All available data is present in this table, no tests are left out except for those with less than 5 score pairs. All known pairs are used, including possible floor/ceiling scores or outliers.

Please be aware that correlations with these external tests are in most cases affected (depressed, typically) by one or more of the following: (1) Little overlap with the object test because of the much lower ceilings and inherent ceiling effects of the tests used in regular psychology; (2) Candidates reporting scores selectively, for instance only the higher ones while withholding lower ones; (3) Candidates reporting, or having been reported by psychometricians, incorrect scores.

Correlation of Reason - Revision 2008 with other tests by Paul Cooijmans - for females

(Test index) Test name n r
(1) Cartoons of Shock21.00
(2) Cooijmans Intelligence Test - Form 321.00
(7) The Final Test21.00
(10) Genius Association Test21.00
(16) Lieshout International Mesospheric Intelligence Test21.00
(19) Numerical section of Test For Genius - Revision 201021.00
(26) Verbal section of Test For Genius - Revision 200421.00
(44) Associative LIMIT21.00
(106) Cooijmans Intelligence Test - Form 421.00
(109) The Bonsai Test - Revision 201621.00
(18) The Nemesis Test31.00
(40) Reason Behind Multiple-Choice - Revision 200850.92
(3) Qoymans Multiple-Choice #550.59

Weighted average of correlations: 0.925

Conservatively estimated minimum g loading among females: 0.96

Ranking in above table is based on the unrounded correlations. All available data is present in this table, no tests are left out except for those with less than 2 score pairs. All known pairs are used, including possible floor/ceiling scores or outliers.

Estimated loadings of Reason - Revision 2008 on particular item types

These are estimated g factor loadings, but against homogeneous tests (containing only particular item types) as opposed to non-compound heterogeneous tests. Although tending to surprise the lay person, it is not uncommon for tests to have high loadings on item types they do not actually contain themselves. Such loadings reflect the empirical fact that most tests for mental abilities measure primarily g, regardless of their contents; that the major part of test score variance is caused by g, and only a minor part by factors germane to particular item types. It is of key importance to understand that this is a fact of nature, a natural phenomenon, and not something that was built into the tests by the test constructors.

Typeg loading of Reason - Revision 2008 on that type
Verbal0.68
Numerical0.63
Spatial0.71
Logical0.68
Heterogeneous0.66

Compound tests have been left out of this table to avoid overlap.

Balanced g loading = 0.67

National medians for Reason - Revision 2008

Country n median score
Portugal285.5
Germany584.0
United_States2084.0
Sweden283.5
China483.0
Spain580.0
South_Africa279.5
Finland479.0
Canada378.0
Bulgaria273.5
Greece972.0
United_Kingdom370.0
Korea_South260.5
India255.5

For reasons of privacy, only countries with 2 or more candidates are included in this table. Ranking is based on the medians, and then alphabetic.

Correlation with national I.Q.'s of Reason - Revision 2008

Correlation of this test with national average I.Q.'s published by Lynn and Vanhanen:

Correlation of Reason - Revision 2008 with personal details

Personalia n r
Cooijmans Inventory of Neo-Marxist Attitudes100.51
Observed associative horizon100.46
P.S.I.A. Orderly220.19
P.S.I.A. Rational220.14
Mother's educational level760.14
Observed behaviour220.12
Father's educational level740.11
P.S.I.A. True220.11
Sex810.06
Year of birth800.05
P.S.I.A. Ethics factor280.02
Educational level770.02
P.S.I.A. Cruel220.02
Disorders (own)76-0.00
P.S.I.A. Introverted22-0.02
P.S.I.A. Cold22-0.08
Disorders (parents and siblings)76-0.10
P.S.I.A. Extreme22-0.13
P.S.I.A. Neurotic22-0.15
P.S.I.A. Rare22-0.17
P.S.I.A. Aspergoid22-0.23
P.S.I.A. Deviance factor28-0.26
P.S.I.A. Just22-0.32
Gifted Adult's Inventory of Aspergerisms18-0.32
P.S.I.A. Antisocial22-0.60
P.S.I.A. System factor25-0.63

Estimated g factor loadings upward and downward of particular scores

In parentheses the number of score pairs on which that estimated g factor loading is based. The goal of this is to verify the hypothesis that g becomes less important, accounts for a smaller proportion of the variance, at higher I.Q. levels. The mere fact of restricting the range like this also depresses the g loading compared to computing it over the test's full range, so it would be normal for both values to be lower than the test's full-range g loading.

Raw scoreUpward g (n)Downward g (n)
00.70 (970)NaN (0)
670.50 (721)0.56 (120)
790.35 (451)0.69 (512)
850.32 (229)0.67 (630)
88-0.24 (107)0.69 (809)
910.51 (22)0.70 (824)
96NaN (0)0.70 (970)

Remark: The test suffers somewhat from "ceiling bumping" due to the fact that some high scorers take much risk and give "dicey" answers, hoping to get a perfect score. This is similar to what happens on the Daedalus Test, and is inherent to these unusual tests. Some have pointed out that this could be solved by letting candidates send in multiple answer sets at once, and reporting on the highest scoring among those. However, that would give candidates feedback on the correctness or falseness of the various answer sets, and thus endanger the security of the test. The current policy will remain effective therefore: only one answer set is allowed, and the possible lower reliability and validity that result from this limitation is to be considered a price paid to keep the solutions secret.

Reliability

Remark: Crohnbach's alpha can not be computed for this test because some of its items give scores outside the range 0 to 1.

Error

Scores by age

Age class n median score
70 to 74183.0
60 to 64187.0
55 to 59254.5
50 to 54250.0
45 to 49880.0
40 to 44874.5
35 to 39780.0
30 to 341285.0
25 to 291774.0
22 to 241384.0
20 or 21475.5
18 or 19475.0
17169.0

Scores by year taken

Year taken n median score
2008787.0
2009865.5
20101084.0
2011779.0
2012572.0
2013787.0
2014573.0
2015378.0
20161076.5
2017875.0
2018677.0
2019580.0

ryear taken × median score = -0.09 (n = 81)

Robustness and overall test quality

Item analysis

Item statistics are not published as that would help future candidates. To detect bad items, answers and comments from candidates are studied, as well as, for each problem, the correlation with total score and the proportion of candidates getting it wrong (hardness of the item). Possible bad items are removed or revised, resulting in a revised version of the test.