Methodology & Data Sources

Methodology & Data Sources

US Academic Scores presents results from major national and international education assessments using official data, technical documentation and clearly defined comparison rules. Scores are interpreted within the population, subject, grade, cycle and measurement framework of the assessment that produced them.

Assessments Covered

Each assessment measures a defined student population using its own framework, scale and reporting system.

PISA
International assessment of 15-year-old students, with core reporting in mathematics, reading and science and additional domains in selected cycles.

TIMSS
International mathematics and science assessment primarily covering students in Grade 4 and Grade 8.

PIRLS
International assessment focused on reading achievement among students generally in the fourth year of formal schooling.

NAEP
U.S. national assessment reporting results by subject, grade, jurisdiction, achievement level and student group.

ICILS
International assessment of computer and information literacy, with computational thinking reported as a separate domain where available.

Primary Data Sources

Official assessment organizations and government education agencies are the primary source for reported scores, percentages, achievement levels, benchmark distributions and technical information.

National Center for Education Statistics

NCES provides U.S. results, technical documentation and data resources for NAEP and U.S. participation in international assessments including PISA, TIMSS, PIRLS and ICILS.

National Center for Education Statistics

The Nation’s Report Card

The official NAEP reporting platform provides national and state results, achievement-level distributions, subject results and demographic comparisons.

The Nation’s Report Card

OECD

The Organisation for Economic Co-operation and Development publishes PISA international results, country notes, databases, assessment frameworks and technical documentation.

OECD PISA

International Association for the Evaluation of Educational Achievement

IEA oversees international studies including TIMSS, PIRLS and ICILS and publishes international reports, frameworks, technical documentation and study data.

IEA

Source Hierarchy

When several sources report the same result, priority is given to the source closest to the original assessment data. Official databases and final statistical tables generally take precedence over summaries, press releases and secondary reporting.

Preferred source order: official database or statistical table, official results report, official technical documentation, official country or jurisdiction report, and then secondary material when additional context is necessary.

A secondary source is not used to replace an available official value simply because it presents the information in a more convenient format.

Matching Data to the Correct Population

Assessment results are linked to the population actually tested. Age-based results are not converted into grade-based results, and results from different grades are not combined unless the official reporting framework specifically provides such a measure.

PISA primarily reports results for 15-year-old students. TIMSS commonly reports Grade 4 and Grade 8 separately. PIRLS focuses on students around the fourth year of schooling. NAEP reports separate results for specific grades and subjects. ICILS uses its own target-population definitions.

Differences in population are treated as substantive measurement differences rather than formatting details.

Assessment Cycles and Reporting Years

The year attached to an assessment normally refers to the assessment cycle rather than the date on which every report or dataset was published. A result can therefore be released after the year in which students were assessed.

Historical tables retain the official cycle labels used by the assessment program. Publication dates are not substituted for assessment years when presenting trends.

When a cycle is delayed, renamed or affected by an unusual administration schedule, the official assessment designation is retained.

Scores and Scales

Assessment scores are not percentages correct. Large-scale assessments typically use statistical models to place student performance on reporting scales designed for the individual assessment and subject.

A score of 500 in one assessment does not represent the same level of achievement as a score of 500 in another assessment. Scores from mathematics, reading, science, computer and information literacy or other domains are also not assumed to be directly interchangeable.

Scores are interpreted only within the scale and framework in which they were reported. No cross-assessment conversion is applied unless an official source provides a valid linking methodology.

Proficiency Levels and International Benchmarks

Assessment programs use different systems for describing levels of performance. These classifications retain their official names and definitions.

NAEP achievement levels such as Basic, Proficient and Advanced are not treated as equivalents of PISA proficiency levels or TIMSS and PIRLS international benchmarks. Similar labels across assessments do not imply identical thresholds.

Percentages reaching a baseline level and percentages reaching the highest levels describe different parts of the performance distribution and are reported separately.

Statistical Significance

Large-scale assessment results are estimates based on samples and therefore contain statistical uncertainty. A difference between two displayed values can exist numerically without being statistically significant.

When an official source reports a significance test, descriptions of higher, lower, increased, decreased or unchanged performance follow that statistical result rather than the size of the rounded numerical difference alone.

If statistical significance cannot be established from the available official information, the comparison is described numerically without implying that the difference is statistically meaningful.

Rounded Values and Reported Changes

Published tables often display rounded scores while official change estimates can be calculated from unrounded underlying values. As a result, subtracting two displayed scores can occasionally produce a difference that varies slightly from the officially reported change.

Where an official change estimate is available, that value takes precedence over a difference calculated solely from rounded display values.

Derived Values

Some tables may contain values derived directly from official statistics when the calculation is transparent and does not require an additional assumption.

Examples include subtracting one published percentage from another to identify the remaining share of a complete distribution or calculating a simple numerical difference between two published scores.

Derived values are distinguished from officially reported estimates when that distinction is material. Calculations that require estimating missing observations, reconstructing suppressed values or assuming an undocumented statistical relationship are not used.

Historical Trends

Trend comparisons use assessment cycles that the official program treats as sufficiently comparable. A longer sequence of published results does not automatically represent a valid trend if the framework, scale or target population changed in a way that breaks comparability.

Short-term change between two cycles is distinguished from longer-term movement across several cycles. A recent increase or decline does not by itself establish the direction of the long-term trend.

Trend pages identify the subject and population represented by the series so that results from different grades or assessment domains are not blended into a single line.

International Comparisons

International comparisons use the participating education systems and reporting definitions provided by the assessment program. OECD averages, international averages and benchmark groups are identified according to the terminology of the relevant study.

Numerical ordering is not treated as a definitive rank when statistical uncertainty prevents reliable separation between nearby results. Where official reports identify systems as statistically higher, lower or not different from the United States, those comparisons are preferred over a simple score-based league table.

NAEP State Comparisons

State comparisons use the jurisdictions included in the relevant NAEP release and are limited to the stated subject, grade and assessment year.

A state’s position in a sorted table does not represent an overall education-system ranking. Small differences between state scores may not be statistically significant, and the composition of student populations can differ substantially across jurisdictions.

District, territory and other jurisdiction results are identified separately when their inclusion affects the scope of a comparison.

Student-Group Comparisons

Results by race and ethnicity, gender, socioeconomic status or other student characteristics follow the categories and definitions used by the original assessment source.

Categories are not assumed to have identical definitions across assessments or years. Changes in classification, questionnaire design, reporting coverage or sample size can limit comparisons.

Observed achievement gaps describe differences in reported assessment outcomes. They do not by themselves establish the cause of those differences.

Suppressed and Unavailable Data

Officially suppressed estimates are not reconstructed from surrounding values. A missing statistic remains unavailable when the source does not provide enough information for a valid calculation.

Suppression can reflect insufficient sample size, reliability requirements, confidentiality protections or other technical rules established by the assessment program.

A blank value, dash, symbol or suppression code is interpreted according to the documentation accompanying the original dataset rather than automatically treated as zero.

Charts and Data Tables

Interactive charts provide a visual representation of data available in the associated page. Important values remain available in HTML tables so that the underlying information does not depend entirely on JavaScript or chart rendering.

Chart axes and scales are selected to preserve meaningful differences without creating an exaggerated visual impression. A zero baseline is used when required by the type of measurement, while assessment-score charts may use a narrower documented range when a zero baseline would provide little interpretive value.

Tables may include sorting, searching and downloadable CSV functionality. These tools change how existing values are viewed and do not alter the underlying data.

Interpretation and Causality

Interpretation is limited to patterns supported by the available data. Differences across subjects, groups, states or years can be described without assigning a cause.

Assessment data alone generally cannot determine why a score changed. Policies, demographic changes, instructional practices, economic conditions and other factors are not presented as causes of an observed result unless evidence capable of supporting that conclusion is available.

Descriptive relationships are kept separate from causal claims.

Technical Limitations

Assessment results can be affected by sampling, participation rates, exclusions, nonresponse, questionnaire coverage, linking error and changes in assessment design. Material limitations identified by the official assessment organization are included when they affect interpretation.

An official result can remain usable while still requiring a technical caution. Such qualifications are treated as part of the result rather than as evidence that the statistic should automatically be discarded.

Revisions and New Releases

Later official releases can add detail, revise previously published figures or change the available historical series. The most recent authoritative version of a statistic takes precedence when an official revision is identified.

New assessment cycles are treated as new observations rather than retroactively changing the meaning of earlier cycles, except where the assessment organization itself revises historical values or comparability guidance.

Core methodology principle: every statistic should remain tied to its original assessment, population, cycle, subject, measurement definition and source.