4 | * |
8 | * |
10 | * |
16 | ** |
22 | * |
29 | ** |
31 | ** |
33 | * |
34 | * |
37 | * |
38 | ** |
40 | ** |
41 | * |
42 | * |
44 | * |
46 | ***** |
(Test index) Test name | n | r |
---|---|---|
(29) Words | 4 | 0.99 |
(41) The LAW - Letters And Words | 4 | 0.99 |
(15) Letters | 4 | 0.97 |
(47) Psychometrically Activated Grids Acerbate Neuroticism | 6 | 0.94 |
(21) Psychometric Qrosswords | 6 | 0.92 |
(109) The Bonsai Test - Revision 2016 | 10 | 0.92 |
(37) Problems In Gentle Slopes of the third degree | 7 | 0.91 |
(1) Cartoons of Shock | 6 | 0.89 |
(19) Numerical section of Test For Genius - Revision 2010 | 11 | 0.87 |
(7) The Final Test | 4 | 0.87 |
(5) Daedalus Test | 7 | 0.87 |
(106) Cooijmans Intelligence Test - Form 4 | 9 | 0.86 |
(30) Verbal section of The Marathon Test | 8 | 0.84 |
(66) Test For Genius - Revision 2004 | 6 | 0.84 |
(2) Cooijmans Intelligence Test - Form 3 | 14 | 0.83 |
(36) Reflections In Peroxide | 9 | 0.83 |
(43) Test For Genius - Revision 2010 | 6 | 0.82 |
(0) Test of the Beheaded Man | 12 | 0.82 |
(44) Associative LIMIT | 12 | 0.81 |
(42) The Marathon Test | 8 | 0.81 |
(103) Problems In Gentle Slopes of the second degree | 11 | 0.81 |
(111) Test For Genius - Revision 2016 | 6 | 0.80 |
(48) Narcissus' last stand | 9 | 0.80 |
(16) Lieshout International Mesospheric Intelligence Test | 15 | 0.79 |
(114) Dicing with death | 8 | 0.79 |
(112) Combined Numerical and Spatial sections of Test For Genius - Revision 2016 | 6 | 0.79 |
(107) The Alchemist Test | 7 | 0.78 |
(104) The Final Test - Revision 2013 | 6 | 0.76 |
(117) The Hammer Of Test-Hungry - Revision 2013 | 5 | 0.73 |
(45) Numerical and spatial sections of The Marathon Test | 9 | 0.72 |
(32) Spatial section of The Marathon Test | 9 | 0.72 |
(35) Intelligence Quantifier by assessment | 10 | 0.71 |
(110) Cooijmans Intelligence Test 5 | 8 | 0.70 |
(105) Space, Time, and Hyperspace - Revision 2016 | 6 | 0.70 |
(28) The Test To End All Tests | 10 | 0.69 |
(40) Reason Behind Multiple-Choice - Revision 2008 | 11 | 0.69 |
(31) Numerical section of The Marathon Test | 9 | 0.68 |
(108) Verbal section of Test For Genius - Revision 2016 | 6 | 0.67 |
(12) Cooijmans On-Line Test - Two-barrelled version | 6 | 0.67 |
(25) The Sargasso Test | 10 | 0.67 |
(26) Verbal section of Test For Genius - Revision 2004 | 11 | 0.67 |
(18) The Nemesis Test | 6 | 0.66 |
(68) Numbers | 4 | 0.66 |
(10) Genius Association Test | 14 | 0.64 |
(3) Qoymans Multiple-Choice #5 | 11 | 0.63 |
(4) A Paranoiac's Torture: Intelligence Test Utilizing Diabolic Exactitude | 9 | 0.63 |
(39) Combined Numerical and Spatial sections of Test For Genius - Revision 2010 | 7 | 0.59 |
(24) Reason - Revision 2008 | 11 | 0.57 |
(11) Isis Test | 10 | 0.52 |
(27) Spatial section of Test For Genius - Revision 2004 | 11 | 0.48 |
(23) Gliaweb Riddled Intelligence Test - Revision 2011 | 10 | 0.45 |
(82) Reason | 5 | 0.31 |
(62) Reason Behind Multiple-Choice | 4 | 0.25 |
(80) Qoymans Multiple-Choice #4 | 5 | 0.24 |
Weighted average of correlations: 0.730 (N = 438, weighted sum = 319.86)
Conservatively estimated minimum g loading: 0.85
(Test index) Test name | n | r |
---|---|---|
(234) Strict Logic Sequences Exam I | 5 | 0.97 |
(201) Wechsler Adult Intelligence Scales | 5 | 0.91 |
(239) Titan Test | 4 | 0.84 |
(242) Unknown and miscellaneous tests | 10 | 0.45 |
Weighted average of correlations: 0.720 (N = 24, weighted sum = 17.28)
Please be aware that correlations with these external tests are in most cases affected (depressed, typically) by one or more of the following: (1) Little overlap with the object test because of the much lower ceilings and inherent ceiling effects of the tests used in regular psychology; (2) Candidates reporting scores selectively, for instance only the higher ones while withholding lower ones; (3) Candidates reporting, or having been reported by psychometricians, incorrect scores.
These are estimated g factor loadings, but against homogeneous tests (containing only particular item types) as opposed to non-compound heterogeneous tests. Although tending to surprise the lay person, it is not uncommon for tests to have high loadings on item types they do not actually contain themselves. Such loadings reflect the empirical fact that most tests for mental abilities measure primarily g, regardless of their contents; that the major part of test score variance is caused by g, and only a minor part by factors germane to particular item types. It is of key importance to understand that this is a fact of nature, a natural phenomenon, and not something that was built into the tests by the test constructors.
Type | n | g loading of Problems In Gentle Slopes of the first degree on that type |
---|---|---|
Verbal | 93 | 0.85 |
Numerical | 24 | 0.87 |
Spatial | 41 | 0.82 |
Logical | 23 | 0.78 |
Heterogeneous | 152 | 0.87 |
N = 333
Balanced g loading = 0.84
Country | n | median score |
---|---|---|
Canada | 3 | 46.0 |
United_States | 9 | 31.0 |
Correlation of this test with national average I.Q.'s published by Lynn and Vanhanen:
Personalia | n | r |
---|---|---|
Observed associative horizon | 4 | 0.56 |
Sex | 25 | 0.46 |
Educational level | 24 | 0.42 |
P.S.I.A. Orderly - Revision 2007 | 9 | 0.35 |
Observed behaviour | 10 | 0.24 |
P.S.I.A. Antisocial - Revision 2007 | 9 | 0.18 |
Father's educational level | 22 | 0.13 |
P.S.I.A. True - Revision 2007 | 9 | 0.08 |
P.S.I.A. Cruel - Revision 2007 | 9 | 0.04 |
P.S.I.A. Ethics factor - Revision 2007 | 9 | 0.04 |
Mother's educational level | 22 | -0.00 |
Disorders (own) | 23 | -0.10 |
P.S.I.A. Rational - Revision 2007 | 9 | -0.12 |
P.S.I.A. Rare - Revision 2007 | 9 | -0.15 |
Gifted Adult's Inventory of Aspergerisms | 7 | -0.16 |
P.S.I.A. Cold - Revision 2007 | 9 | -0.16 |
P.S.I.A. Extreme - Revision 2007 | 9 | -0.18 |
P.S.I.A. System factor - Revision 2007 | 9 | -0.21 |
P.S.I.A. Deviance factor - Revision 2007 | 9 | -0.25 |
P.S.I.A. Introverted - Revision 2007 | 9 | -0.27 |
Disorders (parents and siblings) | 23 | -0.30 |
Year of birth | 24 | -0.32 |
P.S.I.A. Aspergoid - Revision 2007 | 9 | -0.39 |
P.S.I.A. Neurotic - Revision 2007 | 9 | -0.43 |
P.S.I.A. Just - Revision 2007 | 9 | -0.62 |
Cooijmans Inventory of Neo-Marxist Attitudes | 5 | -0.68 |
In parentheses the number of score pairs on which that estimated g factor loading is based. The goal of this is to verify the hypothesis that g becomes less important, accounts for a smaller proportion of the variance, at higher I.Q. levels. The mere fact of restricting the range like this also depresses the g loading compared to computing it over the test's full range, so it would be normal for both values to be lower than the test's full-range g loading.
Raw score | Upward g (N) | Downward g (N) |
---|---|---|
0 | 0.86 (438) | NaN (0) |
24 | 0.60 (262) | 0.83 (50) |
30.5 | 0.58 (197) | 0.90 (160) |
37 | 0.61 (156) | 0.91 (231) |
42 | 0.84 (20) | 0.82 (314) |
46 | NaN (0) | 0.86 (438) |
Note: Near-perfect reliability is obviously no guarantee for a satisfactory high-range test. In fact, a more difficult test whereon no one reaches the ceiling is likely to have a lower reliability coefficient than a too easy test like this one, whereon several reach the maximum score.
Age class | n | median score |
---|---|---|
65 to 69 | 1 | 38.0 |
55 to 59 | 1 | 46.0 |
50 to 54 | 1 | 4.0 |
45 to 49 | 3 | 31.0 |
40 to 44 | 5 | 38.0 |
35 to 39 | 2 | 27.0 |
30 to 34 | 1 | 29.0 |
25 to 29 | 4 | 37.5 |
22 to 24 | 2 | 44.0 |
20 or 21 | 3 | 37.0 |
15 | 1 | 16.0 |
13 | 1 | 16.0 |
N = 25
Year taken | n | median score |
---|---|---|
2006 | 2 | 43.0 |
2008 | 1 | 42.0 |
2009 | 2 | 45.0 |
2010 | 1 | 33.0 |
2011 | 2 | 42.0 |
2012 | 3 | 34.0 |
2013 | 1 | 31.0 |
2014 | 1 | 40.0 |
2015 | 3 | 41.0 |
2016 | 1 | 4.0 |
2018 | 2 | 12.0 |
2019 | 1 | 29.0 |
2020 | 3 | 22.0 |
2021 | 2 | 34.0 |
ryear taken × median score = -0.59 (N = 25)
It is remarkable that scores on this test have dropped so steeply over time. Possibly, potential high scorers lost interest in the test because of its low ceiling.
Item statistics are not published as that would help future candidates. To detect bad items, answers and comments from candidates are studied, as well as, for each problem, the correlation with total score and the proportion of candidates getting it wrong (hardness of the item). Possible bad items are removed or revised, resulting in a revised version of the test. This test appears to have no bad items.
Verbal | 0.86 |
Numerical | 0.85 |
Spatial | 0.89 |
Logical | 0.69 |
Verbal × Numerical | 0.62 |
Verbal × Spatial | 0.65 |
Verbal × Logical | 0.49 |
Numerical × Spatial | 0.74 |
Numerical × Logical | 0.56 |
Spatial × Logical | 0.45 |
Score | Prop. | # scores (* = 1 score) |
---|---|---|
0 | 0.100 (0.200) | ***** |
1 | 0.220 (0.240) | * |
2 | 0.260 (0.280) | * |
5 | 0.300 (0.320) | * |
8 | 0.340 (0.360) | * |
10 | 0.400 (0.440) | ** |
11 | 0.720 (1.000) | ************** |
Score | Prop. | # scores (* = 1 score) |
---|---|---|
0 | 0.040 (0.080) | ** |
2 | 0.100 (0.120) | * |
3 | 0.140 (0.160) | * |
4 | 0.220 (0.280) | *** |
6 | 0.340 (0.400) | *** |
7 | 0.460 (0.520) | *** |
8 | 0.540 (0.560) | * |
9 | 0.780 (1.000) | *********** |
Score | Prop. | # scores (* = 1 score) |
---|---|---|
0 | 0.120 (0.240) | ****** |
1 | 0.280 (0.320) | ** |
4 | 0.340 (0.360) | * |
5 | 0.400 (0.440) | ** |
7 | 0.460 (0.480) | * |
8 | 0.500 (0.520) | * |
9 | 0.560 (0.600) | ** |
10 | 0.620 (0.640) | * |
11 | 0.700 (0.760) | *** |
12 | 0.880 (1.000) | ****** |
Score | Prop. | # scores (* = 1 score) |
---|---|---|
4 | 0.020 (0.040) | * |
6 | 0.060 (0.080) | * |
8 | 0.120 (0.160) | ** |
10 | 0.180 (0.200) | * |
11 | 0.240 (0.280) | ** |
13 | 0.520 (0.760) | ************ |
14 | 0.880 (1.000) | ****** |
Remark: On the whole, the slopes are too gentle, and too many reach the maximum scores. As a result, the test is too easy for its purpose. This test illustrates well the fact that a test with very high reliability, validity, and robustness may still be unsatisfactory by simply being too easy.