Cosmological Likelihood Construction
Scrollable formula. Use Left and Right arrow keys to reveal hidden content.
Scrollable table. Use Left and Right arrow keys to reveal additional columns.
Scrollable figure. Use Left and Right arrow keys to inspect hidden content.
A cosmological likelihood is a probability model for a versioned data product given a physical prediction and its nuisance parameters. It is not merely a expression copied from a paper. A trustworthy construction binds the data vector to its response, calibration, selection, covariance, foreground model, and preprocessing history; it also retains every normalization that changes across the comparison being made. This page develops that construction and uses the public Pantheon+ release as a concrete example.
Required background. Probability and Statistical Inference supplies conditional densities, nuisance marginalization, covariance, and coverage.
Helpful background. Einstein Equations supplies the gravitational prediction being tested; Relativistic Matter and Compact Objects supplies matter and source models; Relativistic Cosmology supplies light-cone observables and transfer functions; and Computational Relativity supplies numerical validation and convergence tests.
Start from the data-generating process
Section titled “Start from the data-generating process”Let be the released data vector. A useful schematic model is
where is the cosmological signal, contains the mask, window, beam, transfer, binning, or fiducial-coordinate response, are calibration parameters, represents foreground or nuisance templates, and is stochastic noise. The likelihood is then
Every word after the conditioning bar is part of the model. A map mask, catalog veto, redshift cut, multipole range, or object-quality threshold changes which random variable was observed. A calibration correction changes the response, and a fiducial-cosmology conversion can change both the mean prediction and its covariance. Hidden preprocessing cannot be recovered by adding a nuisance parameter later.
The Gaussian form and the terms one must not drop
Section titled “The Gaussian form and the terms one must not drop”For residual and positive-definite covariance , the normalized Gaussian likelihood is
If and the data dimension are fixed, the last two terms are constant with respect to the parameters. They may be dropped for posterior shape, but an absolute evidence requires the normalized likelihood; a common fixed factor cancels a Bayes factor only when both models genuinely use the same data and normalization. If depends on cosmology or nuisance parameters, is no longer constant, and omitting it rewards models simply for inflating their errors. Likelihoods built from different data dimensions describe different observed random variables and should not be compared by silently retaining or dropping incompatible constants.
Numerically, factor and solve triangular systems. Explicitly forming is slower and less stable. A failed Cholesky factorization is a diagnostic: it can reveal an inconsistent mask on one covariance axis, roundoff in an estimated covariance, duplicated modes, or an invalid systematic construction.
Nuisance parameters are either sampled jointly or marginalized under declared priors:
A precomputed correction and a sampled nuisance describing the same uncertainty must not both be applied. Conversely, fixing a correction while omitting its uncertainty makes the posterior too narrow.
For linear additive nuisances with a Gaussian prior, , independent of , this integral has a transparent exact answer:
The extra covariance is the propagated uncertainty of the same nuisance amplitude shared across its template. Adding this term and also sampling that amplitude would count its uncertainty twice. The identity assumes a linear response and the stated independence; nonlinear calibration generally requires the integral itself.
Response, covariance, and compression belong together
Section titled “Response, covariance, and compression belong together”A released compression has mean and covariance . Using the compressed mean with an uncompressed covariance, or changing the scale cuts without rebuilding both, is inconsistent. Window matrices also mix physical scales: a nominal cut on the plotted coordinate is not necessarily a sharp cut on contributing modes.
Estimated covariance introduces another stochastic layer. Finite simulations can bias its inverse and propagate uncertainty into parameter widths. The release must identify the simulation ensemble, number of realizations, estimator, conditioning or shrinkage, and any correction applied to the precision matrix. Non-Gaussian tails, connected higher-point covariance, parameter-dependent sample variance, and uncertain responses should be tested rather than hidden inside a fixed Gaussian approximation.
Planck’s 2018 high-multipole likelihood is a particularly clear example of an inseparable package: frequency cross-spectra, masks, beams, polarization efficiencies, foreground templates, multipole cuts, nuisance priors, and covariance enter together. Planck Collaboration 2020, §§2–4 and appendices documents that construction and its validation; its cosmological parameters cannot be reproduced from a plotted spectrum alone.
Worked example using the Pantheon+ release
Section titled “Worked example using the Pantheon+ release”Pantheon+ provides 1,701 light-curve rows for 1,550 distinct supernovae, so repeated objects carry off-diagonal statistical covariance. Its cosmology release builds
with systematic covariance obtained from calibrated response variations. Brout et al. 2022, §2.2, Eqs. (5)–(9), and Appendix C gives the construction and warns that plotting-only diagonal errors are not the likelihood covariance.
For the supernova-only Hubble diagram, use the release coordinate m_b_corr, the redshifts zHD and zHEL, and the selection cut zHD > 0.01. Reshape the full covariance first, then apply the same ordered Boolean mask to both axes; this leaves 1,590 rows. The data-release paper records the quality cuts and repeated-light-curve structure in Scolnic et al. 2022, §2.2, Table 2, and Appendices A–B.
Supernovae without an absolute calibrator constrain relative distances. If is the vector before subtracting a common intercept , analytic profiling gives
Profiling chooses the best intercept for each cosmology; marginalization averages over its prior. To see the difference, write and complete the square: . For a uniform prior of finite width , broad compared with and with far from its endpoints,
With fixed covariance this factor does not change posterior shape, but it does enter an absolute evidence. An improper flat prior has no normalized evidence. If changes with cosmology or a prior endpoint is approached, even the posterior shape differs from profiling.
Substituting a Cepheid-calibrated distance column would answer a different question and import an absolute calibration. The exact release repository is commit c447f0fea703fcd0fff57de5000947b5ca81286b; it has no license file, so this page gives a retrieval recipe rather than redistributing the large data objects.
Selection and blinding change the conditional density
Section titled “Selection and blinding change the conditional density”If an object is observed only when event occurs, the correct density is
The denominator is the selection efficiency. Ignoring it generally biases population or distance parameters because detectable objects are not a random sample of the latent population. Completeness simulations, trigger thresholds, target selection, quality cuts, sky masks, and redshift failures therefore belong in the release record.
Blinding protects choices from result-driven tuning, but the record must say what was hidden, which diagnostics were examined, and whether any cut changed after unblinding. A post-unblinding change is not automatically wrong; it must be identified and stress-tested on simulations or independent data.
Validation and clean-room reproduction
Section titled “Validation and clean-room reproduction”Likelihood validation has three distinct layers. Unit tests check normalization, dimensions, ordering, and known limiting cases. Injection tests generate data through the complete forward model and verify bias and interval coverage across the parameter regime. Data checks reproduce a released likelihood value, best-fit residual, or posterior summary and run posterior predictive or goodness-of-fit statistics that were not tuned on the same discrepancy.
For a clean rerun, archive the data vector, covariance, response matrices, masks, nuisance templates, simulations, likelihood source, environment lockfile, configuration, and hashes. Record units, fiducial transformations, calibration and foreground conventions, all selection cuts, random seeds, optimizer or sampler settings, and convergence criteria. ACT DR6.02 demonstrates the scale of this contract: its public products and Louis et al. 2025, §§3–7 couple maps, passbands, beams, masks, transfer corrections, simulations, covariance, foregrounds, and approximately two thousand null tests.
Results and limitations through 2026-08-19
Section titled “Results and limitations through 2026-08-19”As of 2026-08-19, Pantheon+, Planck 2018, ACT DR6.02, and DESI DR2 offer versioned public likelihood or compressed-likelihood examples with different calibration domains and selections. None licenses the practice of mixing a vector from one release with covariance, masks, nuisance priors, or corrections from another. This page has specified the Pantheon+ algebra and retrieval boundary but has not claimed a clean-environment reproduction of its full posterior.
The most consequential failure modes are parameter-dependent covariance without its determinant, finite-simulation precision bias, non-Gaussian tails, inconsistent masks, hidden preprocessing, doubled corrections, hard nuisance boundaries, post-selection inference, look-elsewhere choices, and a normalization silently discarded before model comparison.
The durable scope is likelihood construction and validation. It does not provide undated best-fit values, replace instrument-specific release documentation, or certify that a collaboration pipeline has been reproduced merely because its public likelihood can be evaluated.
Exercise: the cost of ignoring shared noise
Section titled “Exercise: the cost of ignoring shared noise”Two measurements of a common mean have unit variance and correlation . Both report the value . Find the generalized-least-squares estimate and its variance. Compare with the result obtained by multiplying two independent unit-variance likelihoods.
Solution
For
symmetry gives . Its variance is . Treating the data as independent sets and gives variance . The central value happens not to move because the two observations agree, but the independent product overstates the information and reduces the standard deviation from to . A shared calibration nuisance or explicit cross-covariance restores the correct uncertainty.
References
Section titled “References”- Brout, Dillon, et al. 2022. “The Pantheon+ Analysis: Cosmological Constraints.” Astrophysical Journal 938: 110. arXiv:2202.04077v2. DOI. Open PDF.
- Louis, Thibaut, et al. (ACT Collaboration). 2025. “The Atacama Cosmology Telescope: DR6 Power Spectra, Likelihoods and ΛCDM Parameters.” arXiv:2503.14452v2. Open PDF. Official DR6.02 release.
- Planck Collaboration. 2020. “Planck 2018 Results. V. CMB Power Spectra and Likelihoods.” Astronomy & Astrophysics 641: A5. DOI. Open PDF.
- Scolnic, Dan, et al. 2022. “The Pantheon+ Analysis: The Full Data Set and Light-curve Release.” Astrophysical Journal 938: 113. arXiv:2112.03863v2. DOI. Open PDF.