0 | ** |
3 | * |
4 | * |
5 | * |
6 | *** |
7 | * |
10.5 | * |
11 | **** |
12 | ** |
13 | ***** |
14 | ***** |
14.5 | * |
15 | *** |
15.5 | * |
16 | **** |
16.5 | * |
17 | ******** |
18 | ****** |
19 | ***** |
20 | **** |
21 | ** |
21.5 | *** |
(Test index) Test name | n | r |
---|---|---|
(118) Divine Psychometry | 4 | 0.98 |
(112) Combined Numerical and Spatial sections of Test For Genius - Revision 2016 | 61 | 0.96 |
(47) Psychometrically Activated Grids Acerbate Neuroticism | 5 | 0.94 |
(36) Reflections In Peroxide | 21 | 0.94 |
(48) Narcissus' last stand | 14 | 0.88 |
(39) Combined Numerical and Spatial sections of Test For Genius - Revision 2010 | 10 | 0.88 |
(1) Cartoons of Shock | 9 | 0.84 |
(109) The Bonsai Test - Revision 2016 | 23 | 0.83 |
(0) Test of the Beheaded Man | 15 | 0.81 |
(45) Numerical and spatial sections of The Marathon Test | 16 | 0.81 |
(111) Test For Genius - Revision 2016 | 42 | 0.81 |
(117) The Hammer Of Test-Hungry - Revision 2013 | 7 | 0.80 |
(33) Problems In Gentle Slopes of the first degree | 8 | 0.79 |
(42) The Marathon Test | 11 | 0.77 |
(21) Psychometric Qrosswords | 5 | 0.77 |
(30) Verbal section of The Marathon Test | 12 | 0.77 |
(31) Numerical section of The Marathon Test | 17 | 0.76 |
(35) Intelligence Quantifier by assessment | 17 | 0.75 |
(32) Spatial section of The Marathon Test | 17 | 0.75 |
(107) The Alchemist Test | 11 | 0.73 |
(37) Problems In Gentle Slopes of the third degree | 20 | 0.71 |
(16) Lieshout International Mesospheric Intelligence Test | 26 | 0.71 |
(28) The Test To End All Tests | 16 | 0.70 |
(2) Cooijmans Intelligence Test - Form 3 | 32 | 0.70 |
(24) Reason - Revision 2008 | 25 | 0.69 |
(66) Test For Genius - Revision 2004 | 5 | 0.69 |
(27) Spatial section of Test For Genius - Revision 2004 | 11 | 0.69 |
(106) Cooijmans Intelligence Test - Form 4 | 23 | 0.67 |
(114) Dicing with death | 8 | 0.63 |
(40) Reason Behind Multiple-Choice - Revision 2008 | 25 | 0.62 |
(103) Problems In Gentle Slopes of the second degree | 21 | 0.62 |
(46) Labyrinthine LIMIT | 7 | 0.61 |
(113) The Piper's Test | 9 | 0.61 |
(44) Associative LIMIT | 22 | 0.60 |
(12) Cooijmans On-Line Test - Two-barrelled version | 10 | 0.58 |
(43) Test For Genius - Revision 2010 | 7 | 0.57 |
(104) The Final Test - Revision 2013 | 8 | 0.56 |
(108) Verbal section of Test For Genius - Revision 2016 | 41 | 0.51 |
(23) Gliaweb Riddled Intelligence Test - Revision 2011 | 18 | 0.49 |
(19) Numerical section of Test For Genius - Revision 2010 | 64 | 0.48 |
(18) The Nemesis Test | 14 | 0.46 |
(25) The Sargasso Test | 18 | 0.41 |
(15) Letters | 5 | 0.40 |
(26) Verbal section of Test For Genius - Revision 2004 | 11 | 0.40 |
(110) Cooijmans Intelligence Test 5 | 27 | 0.39 |
(4) A Paranoiac's Torture: Intelligence Test Utilizing Diabolic Exactitude | 18 | 0.39 |
(5) Daedalus Test | 11 | 0.38 |
(3) Qoymans Multiple-Choice #5 | 24 | 0.37 |
(41) The LAW - Letters And Words | 5 | 0.34 |
(29) Words | 5 | 0.29 |
(10) Genius Association Test | 23 | 0.26 |
(7) The Final Test | 7 | 0.18 |
(11) Isis Test | 19 | 0.17 |
(115) De Laatste Test - Herziening 2019 | 4 | -0.02 |
Weighted average of correlations: 0.634 (N = 914, weighted sum = 579.72)
Conservatively estimated minimum g loading: 0.80
(Test index) Test name | n | r |
---|---|---|
(240) Strict Logic Spatial Exam 48 | 4 | 0.76 |
(242) Unknown and miscellaneous tests | 24 | 0.32 |
(201) Wechsler Adult Intelligence Scales | 4 | -0.32 |
(234) Strict Logic Sequences Exam I | 5 | -0.48 |
Weighted average of correlations: 0.193 (N = 37, weighted sum = 7.13)
Please be aware that correlations with these external tests are in most cases affected (depressed, typically) by one or more of the following: (1) Little overlap with the object test because of the much lower ceilings and inherent ceiling effects of the tests used in regular psychology; (2) Candidates reporting scores selectively, for instance only the higher ones while withholding lower ones; (3) Candidates reporting, or having been reported by psychometricians, incorrect scores.
These are estimated g factor loadings, but against homogeneous tests (containing only particular item types) as opposed to non-compound heterogeneous tests. Although tending to surprise the lay person, it is not uncommon for tests to have high loadings on item types they do not actually contain themselves. Such loadings reflect the empirical fact that most tests for mental abilities measure primarily g, regardless of their contents; that the major part of test score variance is caused by g, and only a minor part by factors germane to particular item types. It is of key importance to understand that this is a fact of nature, a natural phenomenon, and not something that was built into the tests by the test constructors.
Type | n | g loading of Space, Time, and Hyperspace - Revision 2016 on that type |
---|---|---|
Verbal | 162 | 0.68 |
Numerical | 81 | 0.74 |
Spatial | 54 | 0.85 |
Logical | 36 | 0.77 |
Heterogeneous | 332 | 0.78 |
N = 665
Balanced g loading = 0.76
Country | n | median score |
---|---|---|
Romania | 2 | 19.0 |
Turkey | 3 | 19.0 |
Canada | 3 | 17.0 |
China | 2 | 17.0 |
United_Kingdom | 3 | 17.0 |
Greece | 2 | 16.5 |
India | 2 | 16.3 |
United_States | 17 | 16.0 |
Germany | 2 | 15.5 |
Italy | 3 | 15.0 |
Sweden | 3 | 14.0 |
Korea_South | 4 | 13.5 |
Correlation of this test with national average I.Q.'s published by Lynn and Vanhanen:
Personalia | n | r |
---|---|---|
P.S.I.A. Orderly - Revision 2007 | 12 | 0.59 |
P.S.I.A. True - Revision 2007 | 12 | 0.46 |
Observed behaviour | 13 | 0.32 |
P.S.I.A. Ethics factor - Revision 2007 | 12 | 0.29 |
Gifted Adult's Inventory of Aspergerisms | 10 | 0.28 |
Cooijmans Inventory of Neo-Marxist Attitudes | 4 | 0.26 |
P.S.I.A. Rational - Revision 2007 | 12 | 0.24 |
Year of birth | 64 | 0.24 |
P.S.I.A. System factor - Revision 2007 | 12 | 0.22 |
P.S.I.A. Cold - Revision 2007 | 12 | 0.15 |
Father's educational level | 53 | 0.13 |
Educational level | 55 | 0.12 |
P.S.I.A. Cruel - Revision 2007 | 12 | 0.10 |
P.S.I.A. Introverted - Revision 2007 | 12 | 0.08 |
Sex | 64 | 0.03 |
P.S.I.A. Neurotic - Revision 2007 | 12 | 0.01 |
P.S.I.A. Aspergoid - Revision 2007 | 12 | -0.02 |
Mother's educational level | 53 | -0.03 |
P.S.I.A. Just - Revision 2007 | 12 | -0.09 |
P.S.I.A. Deviance factor - Revision 2007 | 12 | -0.16 |
Disorders (parents and siblings) | 54 | -0.19 |
P.S.I.A. Extreme - Revision 2007 | 12 | -0.19 |
Disorders (own) | 55 | -0.25 |
P.S.I.A. Rare - Revision 2007 | 12 | -0.32 |
P.S.I.A. Antisocial - Revision 2007 | 12 | -0.57 |
In parentheses the number of score pairs on which that estimated g factor loading is based. The goal of this is to verify the hypothesis that g becomes less important, accounts for a smaller proportion of the variance, at higher I.Q. levels. The mere fact of restricting the range like this also depresses the g loading compared to computing it over the test's full range, so it would be normal for both values to be lower than the test's full-range g loading.
Raw score | Upward g (N) | Downward g (N) |
---|---|---|
0 | 0.80 (914) | NaN (0) |
12 | 0.67 (680) | 0.67 (228) |
14 | 0.60 (541) | 0.72 (405) |
16 | 0.58 (330) | 0.78 (548) |
18 | 0.58 (212) | 0.79 (710) |
24 | NaN (0) | 0.80 (914) |
This reliability is high for such a short test (which is only a subtest) and that is a result of the revisions undergone by the test, which have left it with only good items. The price for that is paid in the form of a lower hardness. It is observed more often that a high reliability does not necessarily make for a good test but comes at a price. It is a mistake to strive for high reliability as the only or primary indicator of test quality.
Age class | n | median score |
---|---|---|
70 to 74 | 1 | 19.0 |
65 to 69 | 4 | 10.8 |
60 to 64 | 1 | 13.0 |
55 to 59 | 3 | 17.0 |
50 to 54 | 2 | 10.0 |
45 to 49 | 3 | 6.0 |
40 to 44 | 5 | 19.0 |
35 to 39 | 13 | 15.5 |
30 to 34 | 8 | 16.8 |
25 to 29 | 10 | 17.5 |
22 to 24 | 7 | 15.0 |
20 or 21 | 3 | 17.0 |
18 or 19 | 2 | 16.5 |
17 | 2 | 10.0 |
N = 64
Year taken | n | median score |
---|---|---|
2016 | 9 | 16.5 |
2017 | 6 | 12.0 |
2018 | 6 | 15.5 |
2019 | 13 | 15.0 |
2020 | 19 | 15.0 |
2021 | 11 | 18.0 |
ryear taken × median score = 0.43 (N = 64)
The robustness of a test that has undergone multiple revisions is protected by restricting the group of candidates to those who have taken a maximum of one (1) of the prior versions. This prevents an inflation of scores, which would cause the norms to become too low for newer candidates.
Item statistics are not published as that would help future candidates. To detect bad items, answers and comments from candidates are studied, as well as, for each problem, the correlation with total score and the proportion of candidates getting it wrong (hardness of the item). Possible bad items are removed or revised, resulting in a revised version of the test.