Qoymans Multiple-Choice #1 statistics

© 2005 Paul Cooijmans

Norms

Comment

This test was created to for once do something completely different. I had always seen multiple-choice tests as inferior (and still do) so I made an extreme one. It had too low estimated g loading and too low reliability. Therefore I later combined it with another test of the same type into a larger test and removed or revised bad items. The result is the QMC #4, which is better than the earlier ones, though still the least satisfactory test I have made. The QMC tests have the lowest g loadings of all my tests (so the lowest validity; for an IQ test, validity is equal to g loading). I attribute this entirely to the multiple-choice format.

Scores (test can no longer be taken)

# testees: 100
Mean: 28.75
SD: 9.92
Male mean: 29.4
Female mean: 25.97 (19 persons)

3*
6*
8*
9**
11*
13***
15***
16*
17***
18*
19**
20*
21*
22****
23***
24*
25***
26*******
27****
28****
29***
30***
31******
32***
33*****
34***
35***
36*****
37***
38*
39****
40***
41**
43***
44.5*
45**
46*
47*
48*

National averages

Country# scoresAverage score
Sweden341.7
Italy333.7
United_States1631.7
Netherlands227.5

Correlation with other tests

Test#cor
Bonsai Test60.85
Intern. High IQ Soc. Misc. tests80.75
Intern. High IQ Soc. Verbal test80.61
Qoymans Multiple-Choice #3150.55
Mysterium Entrance Exam100.51
Evens110.45
Unknown tests150.4
Analogies #1140.39
Association Subtest of LTFG130.37
Qoymans Multiple-Choice #2210.37
SAT (old)90.31
W8750.29
Nicolas Elena Test A50.27
Sigma Test60.27
Analogies of LTFG120.26
Cooijmans OnLine Test60.25
Numbers90.24
Test To End All Tests80.21
Final Test110.2
Genius Association Test50.18
Mega Test50.09
Intern. High IQ Soc. Ultimate IQ Test8-0.01
Nicolas Elena Tests6-0.02
Qoymans Multiple-Choice #49-0.02
Qoymans Automatic Test #28-0.04
Cooijmans Intelligence Test13-0.09
New York High IQ Soc. tests16-0.11
OCIP8-0.13
Long Test For Genius9-0.14
Raven APM8-0.15
Space, Time & Hyperspace19-0.15
GRE5-0.16
Encephalist-R5-0.2
Logima Strictica 367-0.21
Qoymans Automatic Test #17-0.24
Queendom Culture Fair8-0.29
WAIS7-0.29
NVCP6-0.34

Estimated g loading: 0.4

Correlation with personal details

Personalia#cor
PSIA System40.72
Father's eduational level110.47
Educational level110.46
PSIA Rare70.43
PSIA Rational70.38
PSIA Orderly70.36
Disorders (parents and siblings)110.21
PSIA Ethics100.06
Mother's educational level110.02
PSIA True70
Year of birth30-0.01
PSIA Extreme7-0.1
PSIA Aspergoid7-0.14
PSIA Just7-0.19
PSIA Antisocial7-0.23
PSIA Introverted7-0.28
PSIA Deviance10-0.36
PSIA Cold7-0.43
PSIA Neurotic7-0.45
PSIA Cruel7-0.48
Disorders (own)11-0.5

Correlation with national IQs

.09 over 35 pairs.

Reliability and standard error of measurement

Rel = 0.83
SE = 3.8 raw score points

Scores by age

Age group# testeesAverage score
75 to 79125
45 to 49117
40 to 44631.2
35 to 39926.3
30 to 34829.1
25 to 291221.1
22 to 24822.8
20 or 21319.3
18 or 191019.9
17517
16126
1517
14111
916

Additional statistics November 2011

The below statistics result from entering a number of old scores into the database that had previously been left out because they are from people from whom almost no data is known.

Scores on Qoymans Multiple-Choice #1

Contents type: Verbal.   Period: 2002-2002

3 *
6 **
7 **
8 *
9 **
10 ****
11 ***
12 ****
13 ********
14 *
15 *******
16 ***
17 *******
18 *****
19 *******
20 ***
21 ****
22 ********
23 ********
24 *****
25 *******
26 ************
27 ****
28 *********
29 *******
30 ****
31 ********
32 ****
33 ******
34 ***
35 ****
36 ******
37 ****
38 **
39 *****
40 ****
41 **
43 ***
44.5 *
45 ***
46 *
47 *
48 *

Scores by males

n = 130

3 *
6 *
7 **
8 *
9 *
10 **
11 **
12 **
13 ****
15 ****
16 *
17 ****
18 **
19 ***
20 *
21 **
22 **
23 *****
24 *****
25 *****
26 ***********
27 ****
28 *********
29 ******
30 ***
31 *******
32 ***
33 ******
34 ***
35 ***
36 ****
37 ***
38 **
39 ****
40 ****
41 **
43 **
45 **
46 *
47 *

Scores by females

n = 44

9 *
10 *
11 *
12 *
13 ****
14 *
15 ***
16 *
17 **
18 **
19 **
20 **
21 *
22 *****
23 **
25 **
26 *
29 *
30 *
32 *
35 *
36 **
37 *
39 *
43 *
44.5 *
45 *
48 *

Correlation of Qoymans Multiple-Choice #1 with other tests by Paul Cooijmans

(Test index) Test name n r
(54) Test of Shock and Awe50.72
(84) Bonsai Test70.57
(53) Qoymans Multiple-Choice #3170.56
(86) Evens120.46
(74) Cooijmans On-Line Test70.40
(77) Analogies #1140.39
(79) Association subtest of Long Test For Genius130.37
(52) Qoymans Multiple-Choice #2260.34
(75) Analogies of Long Test For Genius120.26
(68) Numbers90.24
(7) The Final Test140.21
(35) Intelligence Quantifier by assessment70.15
(28) The Test To End All Tests90.12
(80) Qoymans Multiple-Choice #410-0.01
(10) Genius Association Test8-0.03
(50) Qoymans Automatic Test #28-0.04
(85) Cooijmans Intelligence Test - Form 113-0.09
(63) Long Test For Genius9-0.14
(57) Space, Time, and Hyperspace18-0.16
(72) Qoymans Automatic Test #17-0.24

Weighted average of correlations: 0.211

Conservatively estimated minimum g loading: 0.46

Ranking in above table is based on the unrounded correlations. All available data is present in this table, no tests are left out except for those with less than 5 score pairs. All known pairs are used to obtain the true, honest statistics; correlations have not been artificially inflated by leaving out ceiling scores, outliers or other anomalies.

Correlation of Qoymans Multiple-Choice #1 with tests by others

(Test index) Test name n r
(236) International High IQ Society Miscellaneous tests80.75
(231) Mysterium Entrance Exam100.51
(242) Unknown tests150.36
(243) Scholastic Aptitude Test (old)90.31
(237) Sigma Test60.27
(235) Nonverbal Cognitive Performance Examination50.10
(229) Mega Test50.09
(218) Raven's Advanced Progressive Matrices (I.Q.)8-0.16
(219) Graduate Record Examination5-0.16
(213) Encephalist - R5-0.20
(225) Logima Strictica 367-0.21
(230) Omega Contemplative Items Pool10-0.21
(201) Wechsler Adult Intelligence Scales7-0.29

Weighted average of correlations: 0.132

Ranking in above table is based on the unrounded correlations. All available data is present in this table, no tests are left out except for those with less than 5 score pairs. All known pairs are used to obtain the true, honest statistics; correlations have not been artificially inflated by leaving out ceiling scores, outliers or other anomalies.

Please be aware that correlations with these external tests are in most cases affected (depressed, typically) by one or more of the following: 1) Little overlap with the object test because of the much lower ceilings and inherent ceiling effects of the tests used in regular psychology; 2) Candidates reporting scores selectively, for instance only the higher ones while withholding lower ones; 3) Candidates reporting, or having been reported by psychometricians, incorrect scores.

Estimated loadings of Qoymans Multiple-Choice #1 on particular item types

These are estimated g factor loadings, but against homogeneous tests containing only particular item types, as opposed to non-compound heterogeneous tests. Although tending to surprise the lay person, it is not uncommon for tests to have high loadings on item types they do not actually contain themselves. Such loadings reflect the empirical fact that most tests for mental abilities measure primarily g, regardless of their contents; that the major part of test score variance is caused by g, and only a minor part by factors germane to particular item types. It is of key importance to understand that this is a fact of nature, a natural phenomenon, and not something that was built into the tests by the test constructors.

Typeg loading of Qoymans Multiple-Choice #1 on that type
Verbal0.54
Numerical0.61
Spatial-0.40
Logical0.63
Heterogeneous0.33

There is no overlap between the categories in this table as a result of leaving out compound tests.

Balanced g loading = 0.34

National medians for Qoymans Multiple-Choice #1

Country n median score
Sweden343.0
Italy334.0
Germany232.5
United_States1731.0
Netherlands427.0

For reasons of privacy, only countries with 2 or more candidates are included in this table. Ranking is based on the medians, and then alphabetic.

Correlation of Qoymans Multiple-Choice #1 with personal details

Personalia n r
P.S.I.A. System factor50.71
Father's educational level130.46
P.S.I.A. Rare70.43
P.S.I.A. Rational70.38
Educational level150.36
P.S.I.A. Orderly70.36
Observed behaviour110.25
Sex1740.16
P.S.I.A. Ethics factor110.11
Mother's educational level130.02
P.S.I.A. True7-0.00
P.S.I.A. Extreme7-0.10
P.S.I.A. Aspergoid7-0.14
Observed associative horizon6-0.16
Disorders (parents and siblings)14-0.18
P.S.I.A. Just7-0.19
P.S.I.A. Antisocial7-0.23
P.S.I.A. Deviance factor11-0.27
P.S.I.A. Introverted7-0.28
Year of birth138-0.29
P.S.I.A. Cold7-0.43
P.S.I.A. Neurotic7-0.45
P.S.I.A. Cruel7-0.48
Disorders (own)15-0.55
Gifted Adult's Inventory of Aspergerisms7-0.68

Correlation with national I.Q.s of Qoymans Multiple-Choice #1

Correlation of this test with national average I.Q.s published by Lynn and Vanhanen:

Estimated g factor loadings Upward and Downward of specific scores

In parentheses the number of score pairs on which that estimated g factor loading is based. The Upward and Downward values are calculated including the pertinent score itself. It is normal that g factor loadings go down when the range is restricted, so some inevitable depression must be taken into account.

ScoreUpward (n)Downward (n)
00.46 (225)NaN (0)
190.37 (203)NaN (0)
260.24 (179)0.52 (31)
330.65 (94)0.45 (89)
60NaN (0)0.46 (225)

Reliability

Error

Scores by age

Age class n median score
75 to 79125.0
45 to 49117.0
40 to 44632.0
35 to 391025.5
30 to 34830.5
25 to 291219.5
22 to 24919.0
20 or 21313.0
18 or 191020.5
17514.0
16126.0
1517.0
14111.0
916.0

Scores by age - within females

Age class n median score
75 to 79125.0
40 to 44228.5
35 to 39230.5
30 to 34137.0
25 to 29519.0
22 to 24418.0
20 or 21113.0
18 or 19419.0
17212.0
16126.0

Scores by age - within males

Age class n median score
45 to 49117.0
40 to 44432.0
35 to 39825.5
30 to 34728.0
25 to 29724.0
22 to 24524.0
20 or 21222.5
18 or 19621.0
17321.0
1517.0
14111.0
916.0

Scores by year taken

Year taken n median score
200218526.0

Robustness and overall test quality

Item analysis

Item statistics are not published as that would help future candidates. To detect bad items, answers and comments from candidates are studied, as well as, for each problem, the correlation with total score and the proportion of candidates getting it wrong (hardness of the item). Possible bad items are removed or revised, resulting in a revised version of the test.