Analogies #1 Statistics

© 2003 Paul Cooijmans

Norms

Scores (out of 24)

# testees: 30
Mean: 8.4
SD: 3.9
Male mean: 8.6
Female mean: 6 (2 persons)

00*
01*
03**
04***
05*
07***
08***
09****
10*
11**
12*****
13*
14***

Correlation with other tests

Test#cor
Test of Shock and Awe40.97
Short Test For Genius40.82
Mega Test50.76
Cooijmans Intelligence Test80.75
Titan Test50.66
Test To End All Tests50.62
Unknown tests50.61
Numbers70.59
Final Test90.47
Qoymans Multiple-Choice110.46
Mysterium Entrance Exam50.45
Space, Time & Hyperspace140.35
Analogies of LTFG90.31
Intern. High IQ Soc. Ultimate IQ Test40.19
Association Subtest of LTFG90.17
Cooijmans OnLine Test40.17
NVCP40.14
Qoymans Multiple-Choice #37-0.04
Long Test For Genius6-0.08
Evens6-0.21
Qoymans Multiple-Choice #27-0.31
Logima Strictica 364-0.56

This test has recently fused with the Evens number series into the Test of Shock and Awe.

Used for norming are scores from tests correlating .35 and higher. Prior scores are converted to a scale with a standard deviation of 15 where needed [and were in 2008 converted to protonorms using the initial protonorm formula], and ranks of raw and prior scores are equated. Norms for scores above 14 are extrapolated.

Additional statistics January 2011

© Paul Cooijmans

Remark: The problems from this test are now part of the test "Cartoons of Shock". The problems in themselves are good, but the original version "Analogies #1" was too short to have sufficient reliability in its own right, and was from the start on meant as an experimental test.

Scores on Analogies #1

Contents type: Verbal.   Period: 1999-2003

0 *
1 *
3 **
4 ***
5 *
7 ***
8 ***
9 ******
10 *
11 *
12 *****
13 *
14 ***
16 *

Correlation of Analogies #1 with other tests by Paul Cooijmans

Test n r
Intelligence Quantifier by assessment50.92
Test of Shock and Awe70.87
Short Test For Genius40.83
Cooijmans Intelligence Test - Form 190.76
Bonsai Test40.71
Numbers70.66
The Final Test120.60
Space, Time, and Hyperspace160.54
Association subtest of Long Test For Genius110.39
Qoymans Multiple-Choice #1140.39
The Test To End All Tests80.37
Analogies of Long Test For Genius110.36
Long Test For Genius80.29
Cooijmans On-Line Test40.17
Evens7-0.04
Qoymans Multiple-Choice #38-0.08
Qoymans Multiple-Choice #27-0.31

Weighted average of correlations: 0.428

Conservatively estimated minimum g loading: 0.65

Ranking in above table is based on the unrounded correlations. All available data is present in this table, no tests are left out except for those with less than 4 score pairs. All known pairs are used to obtain the true, honest statistics; correlations have not been artificially inflated by leaving out ceiling scores, outliers or other anomalies.

Correlation of Analogies #1 with tests by others

Test n r
Mega Test70.62
Unknown tests50.61
Titan Test60.60
Mysterium Entrance Exam50.45
International High IQ Society Miscellaneous tests40.32
Nonverbal Cognitive Performance Examination40.01
Logima Strictica 364-0.62

Weighted average of correlations: 0.345

Ranking in above table is based on the unrounded correlations. All available data is present in this table, no tests are left out except for those with less than 4 score pairs. All known pairs are used to obtain the true, honest statistics; correlations have not been artificially inflated by leaving out ceiling scores, outliers or other anomalies.

Please be aware that correlations with these external tests are in most cases affected (depressed, typically) by one or more of the following: 1) Little overlap with the object test because of the much lower ceilings and inherent ceiling effects of the tests used in regular psychology; 2) Candidates reporting scores selectively, for instance only the higher ones while withholding lower ones; 3) Candidates reporting, or having been reported by psychometricians, incorrect scores.

Estimated loadings of Analogies #1 on particular item types

These are estimated g factor loadings, but against homogeneous tests containing only particular item types, as opposed to non-compound heterogeneous tests. Although tending to surprise the lay person, it is not uncommon for tests to have high loadings on item types they do not actually contain themselves. Such loadings reflect the empirical fact that most tests for mental abilities measure primarily g, regardless of their contents; that the major part of test score variance is caused by g, and only a minor part by factors germane to particular item types. It is of key importance to understand that this is a fact of nature, a natural phenomenon, and not something that was built into the tests by the test constructors.

Typeg loading of Analogies #1 on that type
Verbal0.55
Numerical0.56
Spatial0.73
Logical0.41
Heterogeneous0.89

There is no overlap between the categories in this table as a result of leaving out compound tests.

Balanced g loading = 0.63

National medians for Analogies #1

Country n median score
United_States119.0
Sweden27.5

For reasons of privacy, only countries with 2 or more candidates are included in this table. Ranking is based on the medians, and then alphabetic.

Correlation of Analogies #1 with personal details

Personalia n r
Mother's educational level50.88
Observed associative horizon40.84
Father's educational level50.76
P.S.I.A. Deviance factor50.59
Sex310.37
Educational level60.19
P.S.I.A. Ethics factor50.16
Year of birth280.06
Disorders (parents and siblings)6-0.09
Gifted Adult's Inventory of Aspergerisms6-0.16
Disorders (own)7-0.22
P.S.I.A. System factor3-0.88

Correlation with national I.Q.s of Analogies #1

Correlation of this test with national average I.Q.s published by Lynn and Vanhanen:

Estimated g factor loadings Upward and Downward of specific scores

In parentheses the number of score pairs on which that estimated g factor loading is based. The Upward and Downward values are calculated including the pertinent score itself. It is normal that g factor loadings go down when the range is restricted like this, but careful study of the Upward and Downward columns may reveal possible scores below or above which the test loses validity.

ScoreUpward (n)Downward (n)
00.65 (142)NaN (0)
30.65 (142)NaN (0)
60.67 (125)NaN (0)
90.69 (95)0.27 (56)
120.64 (41)0.49 (102)
15NaN (0)0.58 (131)
18NaN (0)0.65 (142)

Reliability

Error

Scores by age

Age class n median score
70 to 7418.0
60 to 6419.0
45 to 4919.0
40 to 4439.0
35 to 39214.5
30 to 34610.0
25 to 2949.0
22 to 2429.5
20 or 2149.0
1425.0

Scores by year taken

Year taken n median score
1999312.0
2001115.0
2002109.0
2003411.5
200819.0

ryear taken × median score = -0.09 (n = 29)

Robustness and overall test quality

  • Robustness by month = 0.81
  • Quality = 0.66
  • Item analysis

    Item statistics are not published as that would help future candidates. To detect bad items, answers and comments from candidates are studied, as well as, for each problem, the correlation with total score and the proportion of candidates getting it wrong (hardness of the item). Possible bad items are removed or revised, resulting in a revised version of the test.