Learn in your language
Skip to content
A Level · Cambridge (CIE) · 9990

Evaluate psychometric tests

Learn how standardised tests measure psychological characteristics, and why scores need evidence, context and careful limits.

Cambridge International AS & A Level Psychology 9990 · 2028–2030 · Version 1 · AL-PSYCHOMETRIC
Exam scope and assessment notes

Original StudyForA teaching mapped to the Cambridge 2028–2030 syllabus. These lessons are independent study support, not Cambridge material, official mark schemes or awarded grades. No lesson reproduces a research article or Cambridge question. Human subject-expert review and full timed-paper grading remain pending. This is one of the five additional A Level methodology areas and supports Paper 4 planning; it does not replace teaching the selected specialist options or a timed Paper 4 practice set.

Before you begin

  • This lesson supports the 2028–2030 Version 1 A Level Psychology route. Review the AS research-method foundations first, then apply the method to the specialist options your school selects.

Work on paper. Try each question before revealing help, and explain why your method works.

Quick readiness check

A standardised test gives similar scores on repeat administration. Which property does this most directly suggest?

What you will learn

  • Describe standardisation, scoring and interpretation in psychometric tests
  • Evaluate reliability, validity, norms, fairness and the limits of individual conclusions

A psychometric test measures a defined psychological characteristic

Psychometric tests use standardised items, instructions and scoring to assess a construct such as memory, attitudes or a personality dimension. The construct must be specified: a test score is an indicator produced by a task, not the characteristic itself.

Standard administration helps compare results, but researchers still need to explain what is scored, how missing answers are handled and which interpretation is justified. A test designed for research is not automatically a clinical or educational diagnostic tool.

Good interpretation needs evidence about the test

Reliability asks whether scores are sufficiently consistent, for example across items, raters or repeat testing when the characteristic is expected to be stable. Validity asks whether evidence supports the intended interpretation and use. A highly consistent test can measure the wrong thing consistently.

Norms describe scores from a stated reference group. Check who was included, when the norms were collected and whether the learner being compared is sufficiently like that group. Language, culture, disability access, familiarity and unequal opportunity can influence scores.

A score is not a complete account of a person

Use more than one relevant source of evidence when a consequential decision is being considered, and report uncertainty. A group mean can hide individual variation; a cut-off can misclassify people near the boundary.

Protect sensitive results, obtain appropriate consent and explain who can see the data. Do not diagnose, rank or make a high-stakes decision from a single score unless the instrument and use have been properly validated for that purpose by qualified professionals.

Sources for this lesson

Pause and explain

A test was normed only with adults who speak one language. What is the key concern when using it with younger learners who use another language?

Put the idea to work

Worked example

A 20-item memory test has the same instructions for everyone and produces similar scores when repeated one week later. What does this support, and what remains unknown?

Show the worked solution
  1. Name the measurement feature suggested by stable repeat scores.
  2. Ask whether repeatability proves that the intended construct is measured.
  3. Check whether the comparison group and intended use fit.

Answer The repeat scores provide evidence of test–retest reliability if memory is expected to remain stable over that interval. They do not by themselves establish that the items validly measure the intended kind of memory, that norms fit a different language group or that the test can diagnose an individual.

Try a topic test

Choose Easy, Normal or Difficult. Save your answers and open worked review after finishing.

Test this topic →

From guided practice to a new situation

Write your answer and reasoning first. Use a hint only if you are stuck. The model solution is for self-checking; your written work is not automatically marked.

1 · Guided

A study uses a fixed 30-item attention test with the same instructions and scoring for each participant. Identify one standardisation feature and one question about validity.

Give me a hint

Separate consistent administration from what the items actually measure.

Compare my reasoning
  1. The fixed item set and common instructions are standardisation features.
  2. Ask whether the items represent the intended attention construct rather than reading speed or familiarity with the task.
  3. Check that the test's interpretation is supported for the sample and intended research use.

Using the same items, instructions and scoring supports standardisation. Validity still requires evidence that performance reflects the intended aspect of attention for this sample rather than another skill such as reading speed.

Look for these in your work

  • A concrete standardisation feature named
  • Construct validity question identified
  • Population and use considered
2 · Independent

A test is reliable in adults from one country but will be used to compare 13-year-olds across several language groups. Evaluate the proposed comparison.

Give me a hint

Consider the norm group, item language and age-related experience.

Compare my reasoning
  1. Reliability in one adult sample does not establish validity for younger learners or other languages.
  2. Items may differ in difficulty because of vocabulary, schooling or cultural familiarity rather than the measured characteristic.
  3. The test should be adapted and validated with appropriate groups, and results should not be compared to unsuitable adult norms.

The test's adult reliability evidence is too narrow to justify cross-group comparison of 13-year-olds. Age, language and cultural effects may alter item performance, so relevant validation and norms are needed before the score is interpreted comparatively.

Look for these in your work

  • Evidence scope compared with target group
  • Plausible construct-irrelevant factors explained
  • A suitable validation step proposed
3 · Transfer

Plan how to evaluate a short scale intended to measure students' confidence when explaining a worked solution.

Give me a hint

Define confidence, then check scoring consistency and whether the items represent that construct.

Compare my reasoning
  1. Write brief items with consistent response anchors and pilot them with learners of the intended age and language background.
  2. Check whether independent raters or repeat administrations produce suitably consistent results when confidence is expected to be stable.
  3. Compare responses with relevant evidence such as learners' own explanations, protect privacy and avoid using one score to label ability.

Pilot clear, age-appropriate items; check scoring consistency; gather evidence that the items reflect confidence when explaining rather than general self-esteem or subject knowledge. Treat results as one limited research measure, not a label of ability.

Look for these in your work

  • Construct is defined
  • Reliability and validity evidence both considered
  • Interpretation and privacy limits stated

Common mistakes

  • Equating reliability with validity
  • Treating a test score as the construct itself
  • Applying norms to a population unlike the norm group
  • Using an unvalidated threshold for a high-stakes decision
  • Assuming standardised instructions remove cultural or access bias
Recall without your notes

What can you explain now?

Can a reliable psychometric test be invalid for a proposed use?

Compare with the explanation

Yes. Consistent scores do not prove that the test measures the intended construct or supports the proposed interpretation.

Reliability is useful evidence, but validity must be considered for the specific population and decision.

After trying it yourself, choose your next review. This is your self-assessment.

Your review choice appears on Today. Sign in to sync it across devices.

Make it stick

What evidence supports interpreting a psychometric test score, and why should the score not be treated as a diagnosis by itself?

If you needed the solution, close it and solve the problem again from a blank page. A correct answer is stronger when you can explain the reason for each step.

Keep learning Psychology

Course scope and assessment

Seven original lessons map all 15 AS research-method and methodological-concept sections to explained Guided, Independent and Transfer practice. All 12 compulsory AS core studies have original study-specific teaching and staged practice; five additional A Level methodology lessons cover research design and validity. All 15 Clinical, all 15 Consumer (2.1.1–2.5.3) and all 15 Health (3.1.1–3.5.3) Psychology sections link to original teaching and staged practice. All 15 Organisational Psychology sections 4.1–4.5 now have original teaching and explained staged practice; the six new 4.4–4.5 lessons bring the planning map to 92 of 92 indexed sections. Consumer lessons cover physical and psychological environments; decision models, heuristics and mistakes; packaging, selling and buying; advertising, self-monitoring, product placement, brand recognition and slogans. Evaluation boundaries are explicit: studies use particular products, samples, tasks and settings; gaze, recall, self-report, EEG indices, ratings, choices and purchases are different outcomes. Health evidence is bounded: Laba et al. measured hypothetical preferences; Riekert and Drotar raise a non-response concern; Chung and Naya's cap tracked openings, not swallowing; Chaney et al. was a short caregiver-reported pilot; Yokley and Glenwick examined immunisation attendance in one public-health setting. MacLachlan et al. report one patient, not a controlled treatment effect; Brudvik et al. compared separate child, parent and physician ratings in one emergency department. Chandola et al. found a cohort association; Wang et al. measured responses during a monitored arithmetic task; Evans and Wener observed commuters; Bridge et al. found mixed self-rated outcomes in radiotherapy. Janis and Feshbach measured short-term self-reports in one school; Lewin et al. tested a rehabilitation package, not information alone. Tapper et al. and Fox et al. studied bounded school and worksite programmes; incentive effects do not establish transfer or rule out reporting effects. Weinstein measured comparative expectations, while Seligman’s framework is conceptual and Shoshani and Steinmetz used a school-level comparison. These findings do not establish universal health effects or diagnose individuals. Need-theory examples use a child measurement study, not a workplace test; SMART is a practical checklist, not a motivational theory. Landry et al. compared reward framing with student volunteers in a lab; this does not establish universal effects in workplaces. Cuadrado et al. (2008) measured undergraduate evaluations of presented leaders, not workplace performance or hiring; this does not establish a universal gender effect. The historical 1995 Munchausen criteria are not a current diagnostic checklist. Cambridge’s 2028–2030 Reference List treats Oruč et al. (1997) as an example of genetic explanation although its participants had bipolar I; gambling disorder is listed in Cambridge’s Clinical topic but classified under addictive behaviours in ICD-11. Candidates choose two options, but all four remain listed so schools can select a route. The 92-section count is a planning index, not a Cambridge score. Remaining work is deeper coverage review, separate-year syllabus reconciliation, timed-paper practice and human subject-expert review. The separate 2027 and 2024–2026 syllabuses are not reconciled into this route. Practice is not official grading, a timed-paper simulation or human subject-expert review.

StudyForA · Learn with understanding

Original teaching content and links to official sources. Check your exam year and qualification before using a resource.