Statistics of Reason Behind Multiple-Choice - Revision 2008

Scores on Reason Behind Multiple-Choice - Revision 2008 as of 10 April 2026

Contents type: Verbal, logical. Period: 2008-2024

n: 126
Median: 146.3
Quartile deviation: 17.0
Maximum possible: 196
Minimum possible: -100
Male median: 146.5 (n = 121)
Female median: 118.5 (n = 5)
Proportion of males among candidates: 0.960
Hardness: 0.17
Resolution: 34.0

9	*
35	*
57	*
58.5	*
61	*
62	*
69	*
70.5	*
71	*
85	*
90	*
91	**
92	*
94.5	*
99	*
104	*
106	**
110	*
110.5	*
116.5	*
117.5	*
118.5	**
119	*
119.5	*
121	*
124	*
124.5	*
125	*
126	*
126.5	*
127	*
128	*
128.5	*
129	*
130	**
131	*
132.5	*
134.5	*
136	**
137	*
138	**
138.5	*
139	**
140	*
141	*
142	*
142.5	**
143	*
143.5	**
144	*
144.5	*
145.5	*
146	**
146.5	*
147	*
148.5	*
149	**
150	**
151.5	*
152	**
153	*
153.5	*
154	***
154.5	*
155	*
155.5	*
156	**
157	*****
158	***
158.5	*
159	**
160	**
160.5	*
161	****
161.5	*
162	*
163	**
164	**
164.5	**
165	*
166	*
167	*
168	**
168.5	**
169	*
170	*
170.5	*
173	*
174	*
174.5	*
176	*
177	*
179	*
190	*

Correlation of Reason Behind Multiple-Choice - Revision 2008 with other mental ability tests

Test name	n	r	p value
International High IQ Society tests (aggregate)	5	0.94	0.06
Mega Test (Ronald K. Hoeflin)	4	0.88	0.12
Numerical section of The Marathon Test	30	0.85	0.000005
Reason - Revision 2008	125	0.82	≈ 0
Numerical and spatial sections of The Marathon Test	30	0.81	0.00001
Words	8	0.81	0.03
The Marathon Test	19	0.80	0.0007
The LAW - Letters And Words	8	0.80	0.03
Qoymans Multiple-Choice #5	125	0.78	≈ 0
De Golfstroomtest - Herziening 2019	5	0.78	0.12
Epiq Tests (aggregate)	9	0.78	0.03
Narcissus' last stand	30	0.77	0.00003
Advanced Intelligence Test (Randy Myers)	4	0.77	0.18
Titan Test (Ronald K. Hoeflin)	9	0.77	0.03
Reason	11	0.75	0.02
The Test To End All Tests	30	0.75	0.00005
Psychometric Qrosswords	19	0.73	0.002
Cartoons of Shock	22	0.73	0.0009
Test of the Beheaded Man	33	0.71	0.00006
Spatial section of The Marathon Test	30	0.68	0.0002
Reason Behind Multiple-Choice	10	0.68	0.04
Psychometrically Activated Grids Acerbate Neuroticism	16	0.67	0.01
Test For Genius - Revision 2004	19	0.67	0.005
De Laatste Test - Herziening 2019	6	0.67	0.13
Problems In Gentle Slopes of the first degree	13	0.66	0.02
The Bonsai Test - Revision 2016	45	0.64	0.00002
Dicing with death	20	0.64	0.005
Cooijmans Intelligence Test - Form 3	53	0.63	0.000005
Divine Psychometry (Matthew Scillitani)	13	0.63	0.03
Non-Verbal Cognitive Performance Examination (Xavier Jouve)	8	0.63	0.10
Gliaweb Riddled Intelligence Test - Revision 2011	42	0.63	0.00006
Reflections In Peroxide	41	0.62	0.00008
The Alchemist Test (Anas El Husseini)	27	0.62	0.002
Space, Time, and Hyperspace - Revision 2016	40	0.61	0.0001
Random Feickery (Brandon Feick)	9	0.61	0.08
Only idiots	14	0.61	0.03
Combined Numerical and Spatial sections of Test For Genius - Revision 2016	39	0.61	0.0002
Spatial section of Test For Genius - Revision 2004	37	0.61	0.0002
Cooijmans Intelligence Test - Form 2	12	0.59	0.05
Test For Genius - Revision 2016	34	0.59	0.0008
The Final Test	18	0.59	0.02
Associative LIMIT	40	0.59	0.0002
Culture Fair Numerical Spatial Examination - Final version (Etienne Forsström)	6	0.56	0.20
Lieshout International Mesospheric Intelligence Test	51	0.56	0.00008
Verbal section of The Marathon Test	23	0.55	0.01
Problems In Gentle Slopes of the third degree	43	0.54	0.0004
Analogies of Long Test For Genius	5	0.54	0.28
Raven's Advanced Progressive Matrices (I.Q.)	6	0.53	0.24
The Hammer Of Test-Hungry	4	0.53	0.37
Cooijmans Intelligence Test - Form 4	44	0.52	0.0007
Qoymans Multiple-Choice #4	16	0.51	0.05
Verbal section of Test For Genius - Revision 2004	32	0.51	0.005
The Gate	9	0.51	0.15
Cooijmans Intelligence Test 5	33	0.50	0.005
Verbal section of Test For Genius - Revision 2016	34	0.50	0.004
Cooijmans On-Line Test - Two-barrelled version	25	0.50	0.02
Numbers	8	0.49	0.19
The Sargasso Test	50	0.49	0.0006
Genius Association Test	44	0.49	0.001
Tests by Nikolaos Soulios (aggregate)	13	0.49	0.10
The Nemesis Test	33	0.48	0.006
916 Test (Laurent Dubois)	9	0.48	0.17
The Piper's Test	18	0.48	0.05
Problems In Gentle Slopes of the second degree	30	0.47	0.01
Logima Strictica 24 (Robert Lato)	4	0.47	0.42
Test of Shock and Awe	5	0.44	0.37
The Smell Test	12	0.44	0.14
Space, Time, and Hyperspace	7	0.44	0.28
Labyrinthine LIMIT	20	0.41	0.07
Wechsler Adult Intelligence Scales	12	0.41	0.17
Qoymans Multiple-Choice #3 (batch scored by Paul Cooijmans)	6	0.41	0.37
Numerical section of Test For Genius - Revision 2010	58	0.41	0.002
A Relaxing Test (David Miller)	15	0.40	0.13
A Paranoiac's Torture: Intelligence Test Utilizing Diabolic Exactitude	34	0.38	0.03
Three Sonnets (Heinrich Siemens)	4	0.38	0.50
Daedalus Test	27	0.38	0.05
Bonsai Test	5	0.37	0.46
Tests by Greg Grove (aggregate)	10	0.37	0.26
Combined Numerical and Spatial sections of Test For Genius - Revision 2010	23	0.32	0.14
Logima Strictica 36 (Robert Lato)	12	0.30	0.32
Tests by Ivan Ivec (aggregate)	15	0.30	0.27
The Hammer Of Test-Hungry - Revision 2013	13	0.29	0.32
Test For Genius - Revision 2010	15	0.27	0.32
Letters	9	0.26	0.46
Gliaweb Recycled Intelligence Test	9	0.25	0.48
Miscellaneous tests	35	0.24	0.17
Isis Test	46	0.22	0.13
Strict Logic Sequences Examination II (Jonathan Wai)	9	0.21	0.54
Association subtest of Long Test For Genius	6	0.18	0.68
Spatial Insight Test	6	0.15	0.74
The Final Test - Revision 2013	14	0.15	0.60
Laaglandse Aanlegtest - Herziening 2016	5	0.12	0.81
Long Test For Genius	4	0.09	0.87
G-test (Nikos Lygeros)	4	0.07	0.92
Strict Logic Sequences Examination I (Jonathan Wai)	24	0.03	0.90
Strict Logic Spatial Examination 48 (Jonathan Wai)	16	0.02	0.94
Tests by Mislav Predavec (aggregate)	11	0.01	0.97
Numerologica (Andrei Udriște)	5	-0.01	0.97
Tests by Theodosis Prousalis (aggregate)	9	-0.09	0.81
Gliaweb Riddled Intelligence Test (old version)	10	-0.10	0.76
Tests by Xavier Jouve, other than those listed separately (aggregate)	7	-0.13	0.74
Tests by Arne Andre Gangvik (aggregate)	4	-0.17	0.76
Tests by Paul Laurent Miranda (aggregate)	5	-0.22	0.66
Raven's Advanced Progressive Matrices (raw)	5	-0.22	0.66
Tests by Iakovos Koukas (aggregate)	5	-0.23	0.64
Evens	5	-0.26	0.60
Tests by Jason Betts (aggregate)	14	-0.29	0.30
Kvociento (Bram van Kaathoven)	4	-0.38	0.50
Test of Inductive Reasoning / J.C.T.I. (Xavier Jouve)	5	-0.54	0.27
Tests by James Dorsey (aggregate)	8	-0.58	0.12
Odds	5	-0.61	0.22
Gliaweb Raadselachtig Analogieproefwerk	5	-0.68	0.17
Sequentia Numerica Form I (Alexander Herkner)	4	-0.71	0.22
Cattell Culture Fair	6	-0.83	0.06

Weighted mean of correlations: 0.517 (N = 2249)

Estimated g factor loading: 0.72

Ranking in above table is based on the unrounded correlations. All available data is present in this table, no tests are left out except for those with less than 4 score pairs. All known pairs are used, including possible floor/ceiling scores or outliers.

Estimated loadings of Reason Behind Multiple-Choice - Revision 2008 on particular item types

These are estimated g factor loadings, but against homogeneous tests (containing only particular item types) as opposed to non-compound heterogeneous tests. Although tending to surprise the lay person, it is not uncommon for tests to have high loadings on item types they do not actually contain themselves. Such loadings reflect the empirical fact that most tests for mental abilities measure primarily g, regardless of their contents; that the major part of test score variance is caused by g, and only a minor part by factors germane to particular item types. It is of key importance to understand that this is a fact of nature, a natural phenomenon, and not something that was built into the tests by the test constructors.

Type	n	g loading of Reason Behind Multiple-Choice - Revision 2008 on that type
Verbal	402	0.77
Numerical	148	0.57
Spatial	207	0.72
Logical	168	0.84
Heterogeneous	855	0.73

N = 1780

Compound tests have been left out of this table to avoid overlap.

Balanced g loading = 0.73

National medians for Reason Behind Multiple-Choice - Revision 2008

Country	n	median score
Spain	6	160.0
Italy	4	159.5
Sweden	4	159.3
Germany	6	155.5
United_States	31	151.5
China	8	149.0
Romania	3	149.0
United_Kingdom	6	141.8
Finland	5	139.0
Korea_South	7	137.0
Canada	4	136.3
Greece	9	117.5

Total number of countries: 37

For reasons of privacy, only countries with 3 or more candidates are included in this table. Ranking is based on the medians, and then alphabetic.

Correlation of Reason Behind Multiple-Choice - Revision 2008 with personal details

Personalia	n	r	p value
Observed associative horizon	11	0.58	0.07
PSIA Rational - Revision 2007	35	0.27	0.12
PSIA Orderly - Revision 2007	35	0.25	0.15
PSIA Neurotic - Revision 2007	35	0.22	0.20
PSIA Extreme - Revision 2007	35	0.21	0.22
PSIA Deviance factor - Revision 2007	35	0.14	0.40
Observed behaviour	30	0.13	0.48
PSIA System factor - Revision 2007	35	0.12	0.48
Sex	126	0.12	0.18
Educational level	118	0.07	0.44
PSIA Cold - Revision 2007	35	0.06	0.71
PSIA Antisocial - Revision 2007	35	0.04	0.78
PSIA True - Revision 2007	35	0.04	0.84
Year of birth	126	0.03	0.76
Mother's educational level	116	0.02	0.81
PSIA Just - Revision 2007	35	0.02	0.90
PSIA Ethics factor - Revision 2007	35	0.02	0.90
PSIA Cruel - Revision 2007	35	0.01	0.97
Cooijmans Inventory of Neo-Marxist Attitudes	18	0.00	1.00
PSIA Aspergoid - Revision 2007	35	-0.01	0.97
Disorders (parents and siblings)	118	-0.01	0.92
Father's educational level	112	-0.02	0.81
PSIA Introverted - Revision 2007	35	-0.03	0.87
Disorders (own)	120	-0.04	0.68
PSIA Rare - Revision 2007	35	-0.07	0.68
Gifted Adult's Inventory of Aspergerisms	29	-0.15	0.42

Notice: A correlation is generally considered significant if its p value is 0.05 or less.

Estimated g factor loadings for restricted ranges

The goal of estimated g factor loadings for restricted ranges is to verify the hypothesis that g becomes less important, accounts for a smaller proportion of the variance, at higher I.Q. levels. The mere fact of restricting the range like this also depresses the g loading compared to computing it over the test's full range, so it would be normal for these values to be lower than the test's full-range g loading.

Below 1st quartile (126.0)	0.63 (N = 500)
Below median (146.3)	0.68 (N = 971)
Above median (146.3)	0.56 (N = 1232)
Above 3rd quartile (160.0)	0.50 (N = 493)

Correlation between subtests

Qoymans Multiple-Choice #5 × Reason - Revision 2008 = 0.40 (n = 126)

Ideal values for correlations between subtests are around .5, thus being a compromise between the test's ability to yield a "profile" and its ability to provide an indication of general intelligence. With a too high correlation (like .8 or higher) the subtests measure basically the same so there is almost no profile information in them, with a too low correlation (like .2 or lower) the subtests are so different that there is little point in combining them into a measure of general intelligence.

For the correlations of the subtests with total score, see the correlations table above in this report. For statistics per subtest, see the statistical reports of the pertinent subtests.

Reliability

Expanded Spearman-Brown formula: 0.95
Stratified alpha coefficient: 0.93

These are computed from statistics like subtest reliabilities, subtest variances, and total test variance.

Error of measurement

Standard error = 8.2 raw score points

Robustness and overall test quality

Robustness (score trend by time measured in months) = r_{raw scores × months} = 0.07 (n = 126)
Quality (new method) = 60.0

The robustness is computed by averaging the r_{raw scores × months} values of the two subtests and then applying the formula given on the explanation page of Robustness.

[More statistical reports]