Statistics of Reason

© February 2008 Paul Cooijmans

Norms

Scores

0 *
11 *
17 *
20 *
32 *
36 *
40 *
56 *
59 *
63 *
64 *
71 *
75 *
76 *
79 **
80 *
84 *
85 **
87 **
88 *
89 *
92 *
93 *
94 ***
95 *

Correlation with other tests

Test#cor
Cooijmans OnLine Test50.96
Reason Behind Multiple-Choice220.80
Bonsai Test50.63
Verbal section of Test For Genius - Revision 2004140.60
Test of Shock and Awe60.59
Analogies of Long Test For Genius50.58
Test of the Beheaded Man50.56
The Test To End All Tests50.53
Test For Genius - Revision 2004140.49
Cooijmans Intelligence Test - Form 280.46
Genius Association Test90.39
Space, Time and Hyperspace60.35
NVCPE50.33
Spatial section of Test For Genius - Revision 2004140.32
Spatial Insight Test100.31
Associative LIMIT Test80.28
Lieshout International Mesospheric Intelligence Test160.23
Qoymans Multiple-Choice #4220.16
Logima Strictica 3670.10
Qoymans Multiple-Choice #35-0.02
Culture Fair Numerical Spatial Examination - Final version5-0.04
KIT Intelligence Test6-0.04
Numbers5-0.18
Strict Logic Sequences Exam I8-0.20
Association subtest of Long Test For Genius5-0.33

Weighted average of correlations: 0.348

Conservatively estimated minimum g loading: 0.59

Ranking in above table is based on the unrounded correlations. All available data is present in this table, no tests are left out except for those with less than 5 score pairs. All known pairs are used to obtain the true, honest statistics; correlations are not artificially inflated by leaving out ceiling scores, outliers or other anomalies.

Additional statistics November 2014

© November 2014 Paul Cooijmans

Scores on Reason

Contents type: Logical.   Period: 2003-2008

0 *
11 *
17 *
20 *
32 *
36 *
38 *
40 *
56 *
59 *
63 *
64 *
71 *
72 *
75 *
76 *
79 **
80 ***
82 *
84 *
85 **
86 *
87 ****
88 *
89 *
92 *
93 *
94 ****
95 *

Correlation of Reason with other tests by Paul Cooijmans

(Test index) Test name n r
(74) Cooijmans On-Line Test50.96
(24) Reason - Revision 2008110.89
(62) Reason Behind Multiple-Choice310.80
(40) Reason Behind Multiple-Choice - Revision 2008110.75
(68) Numbers90.72
(7) The Final Test120.68
(84) Bonsai Test50.63
(11) Isis Test70.62
(18) The Nemesis Test60.61
(54) Test of Shock and Awe60.59
(75) Analogies of Long Test For Genius50.58
(35) Intelligence Quantifier by assessment120.56
(0) Test of the Beheaded Man80.54
(87) Cooijmans Intelligence Test - Form 2140.52
(66) Test For Genius - Revision 2004190.50
(26) Verbal section of Test For Genius - Revision 2004190.43
(27) Spatial section of Test For Genius - Revision 2004190.40
(57) Space, Time, and Hyperspace70.39
(10) Genius Association Test130.39
(3) Qoymans Multiple-Choice #5110.39
(1) Cartoons of Shock90.38
(44) Associative LIMIT120.38
(55) Spatial Insight Test100.31
(33) Problems In Gentle Slopes of the first degree50.31
(16) Lieshout International Mesospheric Intelligence Test200.27
(28) The Test To End All Tests100.22
(25) The Sargasso Test70.19
(80) Qoymans Multiple-Choice #4310.16
(53) Qoymans Multiple-Choice #35-0.02
(83) KIT Intelligence Test - first attempts6-0.04
(79) Association subtest of Long Test For Genius5-0.33

Weighted average of correlations: 0.458

Conservatively estimated minimum g loading: 0.68

Ranking in above table is based on the unrounded correlations. All available data is present in this table, no tests are left out except for those with less than 5 score pairs. All known pairs are used to obtain the true, honest statistics; correlations have not been artificially inflated by leaving out ceiling scores, outliers or other anomalies.

Correlation of Reason with tests by others

(Test index) Test name n r
(242) Unknown tests60.31
(235) Nonverbal Cognitive Performance Examination50.31
(211) Culture Fair Numerical Spatial Examination - Final version80.23
(225) Logima Strictica 3690.15
(234) Strict Logic Sequences Exam I9-0.15
(240) Strict Logic Spatial Exam 487-0.33

Weighted average of correlations: 0.070

Ranking in above table is based on the unrounded correlations. All available data is present in this table, no tests are left out except for those with less than 5 score pairs. All known pairs are used to obtain the true, honest statistics; correlations have not been artificially inflated by leaving out ceiling scores, outliers or other anomalies.

Please be aware that correlations with these external tests are in most cases affected (depressed, typically) by one or more of the following: (1) Little overlap with the object test because of the much lower ceilings and inherent ceiling effects of the tests used in regular psychology; (2) Candidates reporting scores selectively, for instance only the higher ones while withholding lower ones; (3) Candidates reporting, or having been reported by psychometricians, incorrect scores.

Estimated loadings of Reason on particular item types

These are estimated g factor loadings, but against homogeneous tests containing only particular item types, as opposed to non-compound heterogeneous tests. Although tending to surprise the lay person, it is not uncommon for tests to have high loadings on item types they do not actually contain themselves. Such loadings reflect the empirical fact that most tests for mental abilities measure primarily g, regardless of their contents; that the major part of test score variance is caused by g, and only a minor part by factors germane to particular item types. It is of key importance to understand that this is a fact of nature, a natural phenomenon, and not something that was built into the tests by the test constructors.

Typeg loading of Reason on that type
Verbal0.55
Numerical0.85
Spatial0.58
Logical0.95
Heterogeneous0.70

Compound tests have been left out of this table to avoid overlap.

Balanced g loading = 0.73

National medians for Reason

Country n median score
Canada394.0
Spain286.5
Finland386.0
Greece283.5
United_States1180.0
United_Kingdom275.0
Turkey243.5
Sweden226.5
Netherlands225.5

For reasons of privacy, only countries with 2 or more candidates are included in this table. Ranking is based on the medians, and then alphabetic.

Correlation of Reason with personal details

Personalia n r
Father's educational level370.30
P.S.I.A. Cold170.29
P.S.I.A. Cruel170.29
P.S.I.A. System factor140.24
Mother's educational level380.22
Year of birth380.17
P.S.I.A. Neurotic170.14
P.S.I.A. Introverted170.13
Observed associative horizon80.10
P.S.I.A. Deviance factor240.09
P.S.I.A. Antisocial170.07
P.S.I.A. Rare17-0.00
P.S.I.A. Aspergoid17-0.01
P.S.I.A. Orderly17-0.05
P.S.I.A. Rational17-0.05
Observed behaviour14-0.08
Disorders (parents and siblings)38-0.09
P.S.I.A. Just17-0.10
P.S.I.A. Extreme17-0.15
Disorders (own)38-0.21
P.S.I.A. Ethics factor24-0.21
P.S.I.A. True17-0.25
Educational level38-0.30
Gifted Adult's Inventory of Aspergerisms7-0.54
Cooijmans Inventory of Neo-Marxist Attitudes3-0.92

Correlation with national I.Q.'s of Reason

Correlation of this test with national average I.Q.'s published by Lynn and Vanhanen:

Estimated g factor loadings upward and downward of particular scores

In parentheses the number of score pairs on which that estimated g factor loading is based. The goal of this is to verify the hypothesis that g becomes less important, accounts for a smaller proportion of the variance, at higher I.Q. levels. The mere fact of restricting the range like this also depresses the g loading compared to computing it over the test's full range, so it would be normal for both values to be lower than the test's full-range g loading.

Raw scoreUpward g (n)Downward g (n)
00.68 (350)NaN (0)
660.56 (237)0.48 (49)
800.29 (153)0.67 (124)
87-0.17 (60)0.62 (242)
94NaN (0)0.66 (338)
96NaN (0)0.68 (350)

Remark: In the upper part of the range, say above the mid-80s, there was a problem with "ceiling bumping" on this test, and it has been attempted to repair that in the revised version of 2008.

Reliability

Remark: Crohnbach's alpha can not be computed for this test because some of the item scores are greater than 1.

Error

Scores by age

Age class n median score
60 to 64120.0
55 to 59156.0
50 to 54132.0
45 to 49480.0
40 to 44281.5
35 to 39882.0
30 to 34493.5
25 to 29371.0
22 to 24685.5
20 or 21584.0
18 or 19364.0

Scores by year taken

Year taken n median score
2003487.0
2004984.0
2005873.0
2006340.0
2007486.5
20081180.0

ryear taken × median score = -0.18 (n = 39)

Robustness and overall test quality

Item analysis

Item statistics are not published as that would help future candidates. To detect bad items, answers and comments from candidates are studied, as well as, for each problem, the correlation with total score and the proportion of candidates getting it wrong (hardness of the item). Possible bad items are removed or revised, resulting in a revised version of the test.