Sealed-corpus description length, and what it would take to identify the dynamics of a social system
The Foundations for Evidence-Based Policymaking Act of 2018 (P.L. 115–435) created access and governance for evidence building—an openness presumption for public data, a confidentiality framework for restricted data, and the secure-enclave machinery that became the National Secure Data Service—but it defined no criterion of merit. The gap is usually read as a question about data, about which body of evidence is the better one, and that reading is part of why it has not been closed. What the Act leaves undefined is a criterion for model selection: a rule for saying which account of the same record is better, computable without discretion. Data selection cannot settle itself. Admitting or excluding a source is defensible only against a statement of what the resulting account buys, so in the absence of such a statement both questions fall to expert judgment exercised inside privileged access, and a member of the public cannot contest a finding without obtaining the same access. This is not an abuse of the Act’s access provisions; it is those provisions working as written. We propose the missing piece: a single hard number, the total description length of a sealed corpus at instrument precision, scored by a custodian who runs submitted programs and publishes only the resulting bit count. The corpus is held fixed; what competes is the program. Curation therefore falls inside the object being ranked rather than beside it, which is how a model selection criterion settles the data question that cannot settle itself: a cleaning step, a source, an imputation is admitted when the account it makes possible costs fewer bits than the account without it. The data never move, so confidentiality is preserved exactly; the program is public, so the data-cleaning algorithm is scored rather than presumed; and replication becomes the act of submitting a rival program and beating the number. We then demonstrate the submission format at small scale on 3,146 United States counties observed at eight time points from 1970 to 2024 on 777 items, reporting the identified dynamics, an intervention operator warranted by measured invariance, the curation defects the exercise exposed, and two failures that instruct. The sole component of the fitted system that does not extrapolate is the sole component we supplied from outside it; and the contrasts a difference was supposed to make independent of that component turn out to be conditional on it—stable in sign across three panel versions, but not across two base years, and, by direct audit rather than by assertion, conditional in magnitude on which shared path is propagated, by a median of a third of the effect itself. Both were located by the method’s own diagnostics rather than by argument, which is the property a criterion of merit has to have. Both bound what the study may claim, to the four of seven reported outcomes whose direction survives. And both have the same remedy: let the aggregate be generated by the system rather than supplied to it—which we then built and tested, and which shortens the code on three paired seeds of four while recovering the aggregate it was denied in only two runs of six, though among those runs the shortest code does reliably mark the best held-out forecast.
The Evidence Act supplies access and process and no measure of merit. Title II establishes a presumption that government data are open and machine readable; Title III establishes a confidentiality framework and a presumption of accessibility for statistical purposes, and the committee it created recommended the secure data service now being built. All of this is machinery for getting data to analysts. None of it says what distinguishes better evidence from worse. The Act therefore delegates that judgment to peer review and agency expertise—both exercised inside privileged access, and neither contestable from outside it.
The consequence is structural rather than venal. A finding produced from restricted data cannot be checked by anyone lacking the same clearance, so it rests on the standing of its author. The most consequential empirical social science of the last two decades has this shape, and the customary remedy—release the data—is precisely what the confidentiality title forbids for the records that matter most. We should stop treating this as a tension to be managed and recognize it as a missing component: the Act built the library and omitted the scoreboard.
The stakes make the omission expensive. Federal transfer, tax, health and education programs turn on beliefs about how the social system responds when acted upon, and the sums involved run to the tens of trillions of dollars over a planning horizon. Where a quantity that large depends on an unfalsifiable claim, the incentive to keep the claim unfalsifiable is of the same order. A hard public number is the only instrument we know of that removes the appearance of interest as effectively as it removes the substance, and it does so symmetrically: it exposes an analyst whose model is beaten, and it protects one whose model is not.
Three words carry a methodological sense and a substantive sense at once. This is not bad luck: system identification and demography have grown their vocabularies independently, so a paper that applies the first to the second will keep colliding. We always qualify and never use any of them bare.
A system state is the dynamical object—a point in the state space whose motion the recurrence describes; a US state is the jurisdiction counties nest within, and which supplies one of the regimes across which invariance is tested. Watch for this in “state variable” and “state regime”, which belong to opposite senses.
A family of models is the class the description length is minimized within; a family household is a census unit, and family structure—married couples with own children, female-headed families with children—supplies several of the outcomes reported below. The paper’s most robust substantive finding and its frankest methodological limitation are both about a “family”, and they are not about the same thing. A related reservation, made once here: regime always means an environment across which invariance is tested—a decade, a US state—and never a policy or access arrangement.
A panel version is one of the three successive assemblies of the data, of 525, 770 and 777 items; a generation is people. This paper is about intergenerational causation and reports an outcome named the next generation’s bachelor’s share, so “generation” is reserved for that sense throughout and the versions are never called generations.
A criterion of merit. Total description length of a corpus at instrument precision : a measurement in bits, with no tuning constant, no discretion in the scoring, and an unambiguous ordering.
A mechanism that preserves confidentiality exactly. Contestants submit programs; the custodian runs them inside the enclave and publishes only the bit count. No record is disclosed, and yet any outsider can contest any claim by beating its number.
A rule that puts curation inside the scored object. The corpus is held as close to the measurement instrument as law allows, so that cleaning is part of the submitted algorithm rather than an unexamined step upstream of it.
A worked submission, at a scale small enough to audit, with its failures reported at the same resolution as its results.
The substantive question we use to exercise the method—whether young men can outbid the labour market for the fertile years of the most economically valuable women, and with what consequence for the next generation—is a fair specimen of the class the Act exists to inform, and its results are reported in §11.
The criterion has to be a number a custodian can compute without judgment, that cannot be gamed by choosing a flattering test, and that measures understanding rather than fit. Total description length is the only candidate we know of with all three properties, and in the limit it is not merely a proxy for identification—it is identification, because the shortest program that generates a record is the mechanism that generated it .
Following , the best description of a body of data minimizes the total length of a description comprising the model and the data encoded with it. Writing \(\theta\) for the parameters and \(\delta y\) for the resolution of cell \(y\), \[L \;=\; L(\theta) \;+\!\!\sum_{\text{observed cells}}\!\! -\log_2\!\big(p(y \mid \theta)\,\delta y\big). \label{eq:twopart}\] Both terms are bits, so they are commensurable and there is no free parameter trading them off. The sum runs over observed cells only: coding imputed values would let a submission earn bits for predicting its own guesses.
The factor \(\delta y\) is not decoration. Coding a real number to unlimited precision costs unlimited bits, so the criterion is well posed only once the data’s own resolution is stated. We carry a per-cell \(\delta y\): a published margin of error divided by \(1.645\) for a survey estimate, the tabulation’s rounding step for a complete count, a propagated combination for derived quantities. For a federal benchmark this has a second virtue—it forces the custodian to publish the precision of its own instruments, which is itself evidence-building.
\(L(\theta)\) is computed two ways: for accounting, an entropy code over quantized weight levels; inside the gradient, a differentiable code at the same quantization step, so the optimizer feels the cost of its parameters. Weights are rounded in the forward pass, because a model must be scored at the precision at which it would be transmitted.
It is tempting to score submissions on a withheld regime—a period, a US state, a policy discontinuity—on the grounds that this is what tests whether a relation survives being acted upon. In a sealed benchmark the distinction collapses: the shortest program generating the record necessarily generates the part of the record the contestant has not seen, so code length over the full corpus is the held-out score. Reported separately, held-out performance is a finite-sample audit of whether a submission’s parameter code was honest within its chosen family of models, which is worth publishing but is not a second criterion.
This matters for how the present study should be read. Everything we report about the gap between compression and causal identification is a statement about a bounded approximation inside a chosen family of models, not about the criterion. Where the approximation failed, we can name the violation that caused it (§8); none of the failures is evidence against the underlying thesis, and we are at pains to say so because the objection that there is “no empirical evidence” for that thesis has been used to decline precisely the instrument that would produce the evidence.
Confidentiality and contestability are usually treated as opposed, and they are not. Submit programs rather than findings; have the custodian run them inside the enclave the Act’s confidentiality title already contemplates; publish only the resulting bit count. No record is disclosed, so the statutory protection is preserved exactly. The program is public, so every cleaning decision is legible. And replication—which for restricted-data findings is currently unavailable at any price—becomes the act of submitting a rival program and beating the number.
The properties that matter for a federal benchmark follow directly.
No discretion in scoring. The custodian executes and counts bits. There is no protocol to negotiate, no specification to choose, no test set to select.
Adversarial verification without access. An outsider who believes an official model is wrong does not need the data to demonstrate it. This is the specific failure of the present arrangement that the mechanism repairs: today such an outsider has no move at all.
Curation is scored. Under the rule of §4 the corpus sits as close to the instrument as law allows, so a submission that began from someone’s pre-cleaned extract would be importing unscored judgment. The cleaning is in the program or it is nowhere.
Symmetry. The mechanism exposes an analyst whose model is beaten and protects one whose model is not. An agency holding the best-scoring submission holds a public fact, not a claim of standing.
Three honest obstacles. The first is linkage: what makes restricted access valuable is joining tax to survey to program records, and that joining is governed by several statutes with incompatible rules—so the benchmark needs the linked corpus to exist, which is a political question the mechanism does not answer. The second is corpus selection: which instruments enter at all is a decision no criterion over a fixed corpus can make, and it is the part of the consensus problem that remains genuinely open. The third is that some agency processing is undocumented. Here a trend that is usually reported as a loss is a gain: a release protected by a formally private mechanism publishes its noise parameters , whereas one protected by swapping does not, so formal privacy makes agency processing modellable and therefore scorable.
A sealed corpus can be overfitted through its own leaderboard. Each published score is a measurement of the withheld data, so a contestant submitting repeatedly learns about the corpus without ever seeing it, and a sequence of adaptively chosen submissions can reach a good score by exploiting that leakage rather than by understanding anything. This is the adaptive data analysis problem , and any benchmark proposed for policy consequence has to say what it does about it. Three answers compose.
Budget the submissions. The leakage is bounded by the number of scores released, so a submission budget per entrant converts an open-ended attack into a quantified one.
Report the score through a privacy mechanism. Publishing the bit count with calibrated noise preserves the ordering that matters while bounding what a sequence of scores reveals—the reusable-holdout construction, applied to the leaderboard rather than to the data.
Let the corpus renew. This is the advantage a federal statistical corpus has over a static machine-learning benchmark and it is decisive: the agencies publish again every year, so the sealed portion regenerates on its own. A submission tuned to leakage from last cycle’s scores must face next cycle’s releases, and a method that only ever fitted the leaderboard will show it.
None of this requires new legislation. The Act already provides the enclave, the confidentiality regime and the mandate to build evidence; what is missing is a published number, a submission budget and an open queue, all of which are administrative.
The corpus should be held as close to the measurement instrument—mechanical or institutional—as law allows, so that every cleaning step is a line in the submitted program rather than a property of the data. This is not fastidiousness. Three defects in our own curation each changed published results and none was visible in goodness-of-fit: one reversed the sign of the estimated housing response; one had silently removed the entire income and poverty domain, 245 items, from a panel used to study economic pressure on family formation; one produced a county median household income of $3.77 million. Every one had been applied upstream of the corpus, where a criterion cannot reach it.
Consider the first defect. Per-capita normalization was keyed on the source’s unit code, and dollars serve both aggregate payroll and median income, so four dollar medians were divided by population. Ask what an information criterion makes of this. If population is in the corpus, the corrupted column is an invertible function of the clean one given population, and the two corpora are the same object: we measure the difference at \(-0.0000\) bits per cell. The criterion is exactly indifferent, and correctly so.
That indifference is the argument for holding the boundary at the instrument, not an argument against the criterion. As a step inside a submitted program the division is free, and the choice is legible in the code. As a step applied before the corpus it is unfalsifiable, and the column silently denotes something other than what its name says. Our panel was built the second way—the population denominator is consumed by the normalization and never appears as an item—and in that configuration the defect is not information-preserving but merely negligible: it costs \(1.86\) bits per cell on that column in 1980 and \(1.49\) in 1990, which is \(0.04\%\) of a \(6.6\) bit-per-cell total spread over 777 items. No optimization over that corpus would ever have surfaced it.
The unit is the United States county, keyed by US-state-plus-county FIPS: 3,146 counties at eight time points—1970, 1980, 1990, 2000 from the decennial census and the American Community Survey five-year windows 2006–2010, 2011–2015, 2016–2020 and 2020–2024—on 777 items. Of the \(25{,}168 \times 777\) cells, \(9{,}280{,}572\) (47.5%) are observed. Values are stored as \(\log(1+x)/s_{95}\) with precision propagated accordingly.
The source records income and poverty by the year the quantity refers to: income collected in the 1980 census is income in 1979. A grid admitting only exact decade years silently dropped 245 items—the whole income and poverty domain. Admitting columns within one year of a grid point recovered them, taking the panel from 525 to 770 items, and roughly halved the estimated fertility effects of §11: the earlier estimates had been confounded by an economic variable the corpus did not contain.
Connecticut replaced its counties with planning regions in 2022. Both geographies are exact unions of the same 169 towns, so counties rebuild by summation for counts and for shares of counts—but not for medians, which is how the $3.77 million arose. We admit a reconstructed column only if the same reconstruction reproduces a published value in a period where one exists: 635 of 676 columns cleared, and Connecticut’s observed density at 2024 rose from \(0.004\) to \(0.290\) against \(0.319\) nationally. That procedure was then itself found defective, through a list misalignment that paired each column with another column’s error—which is what had let the $3.77 million through.
Two lessons for a federal benchmark. These defects are invisible to the objective because a model fits whatever it is given; they surface only when a quantity is read in its own units by someone asking whether the number is possible, or when a derivation is forced to reproduce an answer already known. And a verification step is code and fails like code, so the benchmark must publish submissions in full rather than accept their authors’ account of them.
The cleaning rules of §4 were hand-written, and two of them were wrong. That is an argument for deriving them rather than asserting them, and the derivation is available: whether a column is extensive is not a fact about the analyst’s intentions but a property of the column, and the corpus can settle it. We measure that a single threshold on how a column scales with population recovers the hand-written classification for \(98.1\%\) of items.
Take the first defect. Deciding whether to divide a column by population is deciding whether the quantity is extensive, and an extensive quantity is one that grows with the size of the unit. That is testable. Across 207 items measured at the 2000 point, the correlation of \(\log\) value with \(\log\) population separates the two classes cleanly: median \(\rho = +0.946\) for items the hand-written rule treats as extensive against \(+0.185\) for those it exempts. A single threshold, \(\rho > 0.66\), reproduces the hand label for \(98.1\%\) of items.
Figure 1 shows the separation. The four disagreements are instructive rather than noisy. Two are counts of small, geographically concentrated minority populations, which grow with unit size more weakly than a general count; two are percentages that happen to rise with unit size because the composition they measure is urban. Both failures are visible, nameable, and would have been surfaced by the test—which is more than can be said for a regular expression that omitted the word “mean”.
The stronger move is to give the compressor the documentation as well as the numbers. The agencies publish, for every column, a unit indicator, a universe statement, a decimal resolution and a description in English. Each of the three defects was a failure to use information that this metadata already contained:
whether a quantity is extensive is largely predictable from its unit indicator and the words “median”, “mean”, “average” or “per capita” in its description;
the reference year of an income series is stated in its own description—“median household income in 1979”—so the mapping onto a survey year need not have been guessed at all;
whether a quantity may be summed across geographies follows from its universe and unit: a count of households is additive, a median of them is not.
There is an information-theoretic reason to prefer this to an enumeration, and it is not the obvious one. On a fixed corpus, enumerating the exceptions is cheap: marking \(10\) intensive columns among \(698\) costs about \(73\) bits, less than the character count of a rule that finds them. Minimum description length over the data alone would therefore prefer the list. The rule wins on two other grounds. It generalizes to columns the corpus does not yet contain, which is the situation of any benchmark whose corpus grows. And once the metadata is itself part of what must be transmitted, the rule stops being an extra cost: the description strings are already in the corpus, so conditioning the normalization on them is free, and the rule becomes a statement about a regularity the corpus already exhibits rather than an assumption imposed on it.
For a benchmark this settles what the corpus is: not a table of numbers but the agency’s release as published, documentation included. A submission’s cleaning is then a conditional model of data given metadata, priced in the same bits as everything else, and testable in the way §4 could not test a hand-written regular expression—which is how the same class of error escaped twice.
The model is a manifold autoencoder with a mixture output head, fitted by [eq:twopart], together with a recurrence on its latent state. The one design choice that is not conventional is the closure: the recurrence must code the encoder’s own embedding of the next period, not merely that period’s observations. Without it, one-step prediction looks fine and multi-step propagation is meaningless—which matters here because intervention results are propagated for decades.
An encoder maps a unit’s cross-section, with unobserved inputs entering at the feature mean, to a latent state \(z \in \mathbb{R}^{32}\); a decoder returns, for each item, a three-component Gaussian mixture. The mixture matters: it lets the residual term be an honest code length for asymmetric and multi-modal item distributions without transformation tricks. Weights are initialized so that the untrained output is exactly the per-item null—each item an independent Gaussian at its own mean and variance—so epoch zero scores the null and every subsequent bit is earned from a baseline the model itself reproduces. A fraction of observed inputs is masked during training while still being coded, which prevents the encoder from copying inputs to outputs.
Coding a unit’s own cross-section through the latent and back, at each cell’s precision, we call the pullback. Its residual measures how much structure the manifold has captured, in the data’s own units.
A recurrence carries \(z\) from one period to the next, \[z_{t+1} \;=\; z_t \;+\; \Delta t \,\big(\,c_{t,s} \;+\; f(z_t)\,\big), \label{eq:step}\] with \(c_{t,s}\) a displacement shared by all units in period \(t\) and US state \(s\), \(f\) built from a library of constants, linear terms and pairwise products—sparse selection from a function library follows —and \(\Delta t\) the step length so that both are rates.
Fitted only against next-period observations, such a recurrence can score well one step ahead while its output lands nowhere the encoder ever puts a unit. The decoder is far from injective, and with half the target cells unobserved the set of latent points decoding acceptably is a wide region. Iterating then evaluates \(f\) outside its training distribution. We therefore require the recurrence’s output to code the encoder’s own embedding of the next period, \[\mathrm{cons} \;=\; \tfrac{n}{2}\sum_k \log_2\!\big(2\pi e\, s_k^2\big), \qquad s_k^2 = \big\langle (z_{t+1}^{\text{pred}} - z_{t+1}^{\text{enc}})_k^2 \big\rangle , \label{eq:cons}\] the bits to transmit the encoder’s embedding given the recurrence’s guess, in the same currency as the rest.
The closure costs nothing and buys the multi-step results: the closed model predicts better than the unconstrained one (\(8.43\) against \(8.76\) bits per cell in the panel version where both were fitted) at equal pullback, and two-step error grows as \(\sqrt{2}\) times one-step error rather than compounding. Requiring the recurrence’s output to be a system state, and not merely to decode like one, turns out to regularize it.
Decade motion separates into a component shared across units and a unit-specific remainder, and the two behave oppositely. The unit-specific map is invariant across every decade and US-state regime tested. The shared component does not extrapolate at all. That asymmetry is what licenses interventions to be posed as contrasts, which remove the shared component’s explicit term from the difference equation—though not, as §9.1 shows, entirely from the result—and, as §8 argues, it is also a self-inflicted wound rather than a property of the world.
In the present panel the shares of squared motion are \(0.79\) national, \(0.05\) US state and \(0.16\) unit-specific, the national share inflated by nominal-dollar items moving with the price level.
The shared component’s failure is quantitative: parameterized as a function of national time series and projected onto a withheld decade, it coded that decade at \(27.9\) bits per cell against \(14.0\) for assuming no shared motion at all. Worse than nothing.
The unit-specific map is a different object. Fitted in quadratic form it is invariant across all six decade regimes and, in linear form, across all 41 US-state regimes, scored against an effective sample size accounting for spatial and temporal correlation. Linear-in-decades fits are not invariant, which we read as curvature mistaken for time-variation when the form is forced to be linear.
A relation that holds unchanged across regimes is a candidate causal relation ; it is the property and named autonomy, and the property observed a relation must have to survive being acted upon. We have it for the unit-specific map and demonstrably lack it for the shared displacement.
The single component of this system that fails to extrapolate is the single component we supplied from outside it. That is not a limitation of the method; it is the method’s central claim being confirmed by our own violation of it.
The shared displacement is either a free parameter per period—an unexplained constant, which is exogeneity in its purest form—or a linear map from national principal components that we import from published macroeconomic series. Having refused exogenous variables at the county level, we reintroduced them at the aggregate, and then measured exactly the failure the autonomy literature predicts for a relation that is not autonomous.
The remedy is to close the system, and it is concrete. Of the twelve national series used, eight —unemployment, three labour-force participation measures, median house price, total fertility, adolescent fertility—are aggregates of the county cross-section and should be computed from the system state rather than supplied to it. The remaining four—consumer prices, real output per capita, the long mortgage rate, federal debt relative to output—are monetary, fiscal and price-level quantities genuinely outside a county panel, and the consistent treatment is not to import them but to promote them to system-state variables carrying their own dynamics. A closed system has no shared displacement to extrapolate, because the aggregate is generated rather than assumed.
We report this prominently because of how a study like this is liable to be read. Taken at face value, “the component that compresses well does not extrapolate” looks like evidence that compression is causally insufficient. It is nothing of the kind. It is evidence that we gave a compressor a record it was forbidden to explain, and it declined to explain it.
Closing the system shortens the code every time we try it and does not, on this panel, produce a model that forecasts better or that recovers the aggregate it was denied. Both halves of that sentence are measured, and the second is the reason the remedy stays a proposal.
The implementation replaces the imported basis with a generated one. A national system state \(u_t\) starts from a free parameter and evolves under \[u_{t+1} \;=\; u_t \;+\; \Delta t \,\big[\,1,\; u_t,\; \bar z_t\,\big] A , \label{eq:closed}\] where \(\bar z_t\) is the cross-county mean latent—the system’s own aggregate—and the shared displacement reads \(u\) exactly as it previously read the imported components. Seventy-two parameters replace twelve numbers the open model receives as a fixed input and never pays for in the code.
Paired by seed against the open model, closing the aggregate changes the total code by \(-1.8\), \(+0.5\), \(-5.2\) and \(-3.4 \times 10^{5}\) bits. Run-to-run spread at fixed architecture is \(5.2\times10^{4}\) bits, so the three wins clear the floor and the one loss sits at it. By the criterion this paper proposes the closed system is the better model of the corpus, and it is better while also paying for an aggregate the open model was given—but not on every seed, which is the first sign of what §8.1 ends on.
These are the code lengths the diagnostics evaluate: clean encoder input, quantized weights throughout, in evaluation mode. They are not the quantity the optimizer minimizes, which charges the prediction branch at unquantized precision and corrupts the encoder input with the denoising mask. That training objective is the right thing to descend and the wrong thing to report—it is not a transmittable code length—and the two can disagree by more than \(10^{5}\) bits at the same checkpoint. Every figure in this section is the transmittable one.
Holding out the 2020–2024 transition, the open model codes it at \(4.1316\) bits per cell and six closed runs average \(4.1726\)—one per cent worse, with one of the six beating the open model. That comparison is unfair to the closed model, and the unfairness is the finding: at prediction time the open model is handed the 2020 national system state, which is the one input a genuine forecast cannot have. Read as a trade rather than a contest, closure costs about \(0.05\) bits per cell and buys a system that needs nothing from outside itself.
In a held-out run the generated \(u_{2020}\) is produced from \(u_{2015}\) and the 2015 aggregate and enters no training loss, so where it lands is a genuine forecast of the national system state. Mapping the generated coordinates onto the published components on the fitted decades and applying that map at 2020, two of six runs beat both naïve baselines—persistence and linear extrapolation of 2010–2015, at errors of \(1.155\) and \(1.134\) in units of the components’ own spread—at \(0.395\) and \(0.579\). The other four are worse than both. The county cross-section evidently contains its own aggregate in some fits and not in others, and the difference is the seed.
Across the six held-out runs, rank correlation between the transmittable code length at a checkpoint and that checkpoint’s held-out bits per cell is \(+0.83\). The shortest-coding run has the best held-out prediction and the only win over the open model; the longest-coding run has the worst. Description length earns its keep here, and it earns it on the comparison it is supposed to lose—among fits of one architecture, where nothing but the optimizer’s path distinguishes them.
We first measured this wrong, and we report the error because it is a demonstration of §3 rather than an aside about carefulness. Ranking the same six runs by the quantity the optimizer descends gives \(-0.31\) against held-out bits and \(-0.77\) against aggregate error—an apparent refutation of the criterion, by the criterion’s own proponents. That quantity is not a code length: it corrupts the encoder input with the denoising mask and charges the prediction branch at unquantized precision. Both are correct for an objective and disqualifying for a score.
The two roles the mechanism separates are exactly the two we conflated. A contestant optimizes whatever they like; the custodian runs the submitted program and computes the description length itself, from the sealed corpus and the program’s output, and never sees the objective that was descended. Under that arrangement this error cannot reach a scoreboard, because the number on the scoreboard is not the contestant’s to compute. We made it because in a study one writes alone there is no custodian—the same hand that trains the model reports its score, which is the configuration the proposal exists to abolish, and which is the configuration nearly all published quantitative social science is in.
Two further properties of the criterion are on display, and both are claims §3 makes in the abstract and can now make concretely. The discrepancy was findable: it was found by recomputing bits from a checkpoint, which anyone holding the program and the corpus can do, and which is what “contestable without privileged access” means operationally. And the criterion is sharp in the way an ordering has to be if it is to decide anything—the two quantities differ by at most \(0.13\%\) of the total, and that was enough to reverse the sign of a reported correlation and to move one architectural comparison from four wins to three. A criterion loose enough that a tenth of a per cent could not overturn a finding would not be worth sealing a corpus for.
What the code length does not track is the other test. Against how well a run reconstructs the published national components the correlation is \(+0.14\), which is nothing. That asymmetry is not mysterious: held-out bits score the decoded county cross-section, which the code charges for directly, while \(u_{2020}\) is an extrapolation of the national recurrence that no term in the code ever scores. The criterion ranks what it is paid to rank.
So §8’s remedy stands where the evidence leaves it: built, shortening the code on three seeds of four, selecting reliably among its own fits, and recovering the aggregate it was denied in two runs of six. The right thing to build, and not yet delivering what it was built for.
\(\mathrm{cause}(C)\) is the minimum-norm displacement of a unit’s latent system state that realizes condition \(C\) in the decoded observables, with every other observable co-moving as the manifold requires, propagated by the identified recurrence and decoded with intervals. Nothing is severed and there is no graph. Every result carries two diagnostics—how much of the requested change survives re-encoding, and what fraction of units end where data exist—and interventions are posed as contrasts, which remove the non-extrapolating shared displacement from the difference equation, though §9.1 bounds what survives it.
Because the system state is the whole cross-section, a condition on one item necessarily moves others; those co-moves are reported rather than assumed away. They are the honest content of refusing exogeneity: in a closed system the co-moves are not contamination to be purged, they are what intervening consists of. Minimum norm is a stated choice—it encodes an assumption that an intervention disturbs the system state as little as it can—and the data do not establish it.
We write \(\mathrm{cause}\) rather than \(\mathrm{do}\) not in opposition to but because the object assumed autonomous differs. Pearl’s operator formalizes autonomy for the case where the invariant structure is a graph, and obtains its warrant from the graph’s correctness; here the invariant structure is a recurrence, there is no edge to delete, and the warrant is the measured invariance of §7. One asymmetry favours the recurrence: its autonomy is testable out of sample, and we test it.
The region diagnostic is not decorative. A result whose intervened system state is largely outside the region the data occupy describes units that do not exist; it is reported flagged and not quoted. In this application it disqualified two of the eight contrasts attempted (§12).
Interventions are posed as contrasts: move one item while holding another at its factual value. Substantively, a single-item move on this manifold drags the whole labour market with it. Technically, a contrast is a difference between two system states propagated by the same recurrence, and the explicit shared term cancels from that difference. Writing the baseline as \(z_t\) and the intervened system state as \(z_t+d_t\), \[d_{t+1} \;=\; d_t \;+\; \Delta t\,\big[\,f(z_t+d_t)-f(z_t)\,\big], \label{eq:diff}\] in which \(c_{t,s}\) does not appear.
It does not follow that the contrast is independent of the shared displacement. The base trajectory \(z_t\) depends on every shared displacement applied before \(t\), and for a quadratic \(f\) the bracket in [eq:diff] is \(J(z_t)d_t + Q(d_t)\), which depends on \(z_t\) through the Jacobian. The shared path therefore reaches the contrast by two indirect routes: through the latent difference, and through the decoder, where an effect reported as a percentage is divided by a baseline that the shared path moves.
We bound both. Doubling the shared displacement at every step for thirty years—far outside any plausible path—moves the propagated latent difference by \(2.8\%\), and by the same \(2.8\%\) at intervention magnitudes of \(0.05\), \(0.10\) and \(0.20\), so this route is linear and scale-free. One decade of the fitted displacement changes the growth rate \(\lVert J(z)d\rVert\) by \(9.1\%\) (10th to 90th percentile \(7.2\)–\(12.6\%\)), which over three steps accumulates to the \(2.8\%\) above.
The second route is bounded by direct audit, which is the only way to reach it: it runs through a nonlinear decoder and a percentage baseline, so there is no inequality to write down. shared_path_audit.py freezes the checkpoint, the base-year cohort, the intervention and the reporting definitions, and varies only the shared path, re-reading the contrast under eight paths: as fitted; the national component with the US-state component removed; zero; doubled; reversed; the mean of the six fitted per-decade rates; and the 1980 and the 2020 rate each held for the whole run. Each path is applied identically to both branches, and the script asserts that the realized intervention at \(t=0\) is unchanged across paths, so a difference in the answer is the indirect dependence and nothing else. These are sensitivity paths, not forecasts.
Two paths carry the trajectories out of the data region and are dropped before anything is read from them: reversing the shared displacement, and holding the 2020 rate for a decade. The second is worth stating plainly—the most recently fitted shared rate, sustained, takes every unit off the manifold within one step. That is the non-extrapolability of §8 appearing as a support failure rather than as a confident wrong number, which is the behaviour the region diagnostic exists to produce.
On the paths that stay in region, magnitudes move by a median of \(0.32\) times the effect the fitted path gives. The contrasts are therefore conditional on the shared path in size, and every magnitude in §11 is to be read as conditional on the fitted one. The signs are another matter: across two base years, two contrast directions, seven outcomes and three horizons—\(84\) cells—\(79\) hold the sign the fitted path gives. Four of the five that do not are median home value; the fifth is a births effect of \(-0.26\%\).
Median home value is a systematic exception rather than a scattered one, and the reason is legible. Decoding the fitted shared displacement at the mean system state and reading which items it moves, dollar-denominated items carry \(37.6\%\) of its motion while being \(17.4\%\) of the panel —over-represented by a factor of \(2.2\), and rising from \(27\)–\(39\%\) before 2010 to \(41\)–\(51\%\) after it. Eight of the thirteen largest movers are dollar items: median home value twice, per capita income twice, median household income twice, gross rent, owner costs. Setting the shared path to zero therefore does not perturb the housing contrast so much as remove a large part of what it is made of: the primary contrast on median home value goes from \(+\$4{,}228\) to \(-\$605\) at the median unit. No real-quantity outcome behaves this way.
The same decoding says what else the shared displacement is made of, and the answer bears directly on §8. Its five largest movers are population change, population density, women’s and men’s unemployment rates, and families below poverty: population growth and the business cycle, with the price level behind them. Those are three components, and the remedy already sorts all three—growth and unemployment are aggregates of the county cross-section and should be computed from the system state; the price level is genuinely exogenous to a county panel and should be promoted to a system-state variable carrying its own dynamics. We did not choose that split to fit this measurement; the measurement is what the split predicts. This is the same outcome §11.1 finds changing sign between base years. It was already outside the set we state without qualification; what the audit adds is the reason, which is not a general fragility of the method but a specific one—a nominal contrast cannot be separated from a shared path that is mostly the price level.
The cancellation of the explicit term is why the method yields contrasts rather than forecasts: the component that would have to be extrapolated for a level prediction never enters [eq:diff] at all. What remains is a weaker and measurable dependence, which the contrasts below are conditional on, and which §8’s remedy would remove entirely—a closed system has no shared displacement to choose.
On transitions withheld entirely from fitting, the model sits \(0.43\) to \(0.52\) bits per cell above the attainable floor, and that margin is flat whether the step is four years or ten. We report this as the audit described in §2, and we caution against the summary statistic most natural here, because a federal benchmark that adopted it would be ranking the wrong thing.
| held out | step | oracle | model | persistence | skill | model \(-\) oracle |
|---|---|---|---|---|---|---|
| 2000–2010 | 1.0 dec | 6.404 | 6.871 | 19.730 | 0.965 | 0.467 |
| 2010–2015 | 0.5 | 3.554 | 3.983 | 4.607 | 0.592 | 0.429 |
| 2015–2020 | 0.5 | 3.528 | 3.964 | 4.860 | 0.673 | 0.436 |
| 2020–2024 | 0.4 | 3.606 | 4.128 | 5.006 | 0.627 | 0.522 |
Skill is not comparable across transitions: its denominator varies more than fourfold, because assuming no change over a decade fails catastrophically while assuming no change over four years does not. The \(0.965\) reports a collapsed baseline, not an easy problem. Excess over the attainable floor survives the comparison, and its flatness across step lengths is the strongest evidence here that the recurrence captured something of the process rather than of the sampling: nothing in the fitting arranges for a four-year and a ten-year step to be equally well predicted.
Against the per-item null the model codes the panel at \(6.64\) bits per cell versus \(9.29\) and predicts the next period at \(6.42\) versus \(9.08\). Permuting the correspondence between units and their latent codes costs \(46\) bits per cell. Nominal 90% predictive intervals cover 92% of observed cells.
The motivating contrast is stable in sign across three panel versions differing by 252 items and a time point—twenty-one sign agreements out of twenty-one—and its mirror reverses family structure cleanly. Two things qualify that. Its magnitudes are not converged: five of seven attenuate monotonically as identification improves. And stability across panel versions is not stability across base years: propagated from 1990 rather than 1980, three of the seven outcomes change sign. Four of the seven survive both tests—married couples with own children, female-headed families with children, never-married women, and the next generation’s bachelor’s share—and they are the only ones we state without qualification.
| outcome at \(+30\) years | 525-item | 770-item | 777-item |
|---|---|---|---|
| female-headed families with children | \(+15.6\) | \(+9.4\) | \(+10.7\) |
| never-married women | \(+8.6\) | \(+6.8\) | \(+5.8\) |
| next generation’s bachelor’s share | \(+8.0\) | \(+4.9\) | \(+3.2\) |
| median home value | \(+4.0\) | \(+5.0\) | \(+4.3\) |
| births per 1,000 | \(+4.4\) | \(+3.0\) | \(+1.9\) |
| children under 5 | \(+2.0\) | \(+2.2\) | \(+1.4\) |
| married couples with own children | \(-5.6\) | \(-1.6\) | \(-1.2\) |
Table 3 reports the contrast. The mirror—men’s employment up, women’s participation held—reverses family structure: married couples with children \(+5.6\)%, female-headed families with children \(-9.9\)%, never-married women \(-3.9\)%. That the same three variables move oppositely at comparable magnitude under the mirrored contrast is the strongest internal check the method affords.
The attenuation is not mechanical. The intervention is identically realized and fully in region in all three panel versions, and the per-outcome ratios are strongly heterogeneous—\(0.21\) for married-with-children, \(1.08\) for home value—where a scaling artifact would be uniform. The outcomes that shrank most are the fertility and marriage ones, and the panel version that shrank them is the one that admitted the income and poverty domain.
Sign stability across panel versions is a statement about identification improving while the answer stays put. It is not a statement that the contrast is independent of the trajectory it starts from, and propagating the same intervention from a 1990 base rather than a 1980 base shows that it is not.
| outcome at \(+30\) years | from 1980 | from 1990 | ratio |
|---|---|---|---|
| married couples with own children | \(-1.2\) | \(-5.7\) | \(4.75\) |
| female-headed families with children | \(+10.7\) | \(+14.4\) | \(1.35\) |
| never-married women | \(+5.8\) | \(+8.3\) | \(1.43\) |
| next generation’s bachelor’s share | \(+3.2\) | \(+4.1\) | \(1.28\) |
| births per 1,000 | \(+1.9\) | \(\mathbf{-1.3}\) | \(-0.68\) |
| children under 5 | \(+1.4\) | \(\mathbf{-1.8}\) | \(-1.29\) |
| median home value | \(+4.3\) | \(\mathbf{-1.4}\) | \(-0.33\) |
Three of seven change sign: births, children under five and median home value. It is tempting to explain this by magnitude—that the survivors are the large effects and the casualties the small ones—and the table does not support it. Married couples with own children survives at \(-1.2\%\), while median home value reverses from \(+4.3\%\), the third largest effect reported. What the four survivors have in common is that they are composition measures, shares of a population or of a household stock; what reverses is a flow rate, an age-specific count and a price. We record the pattern without a mechanism for it.
This is the second route of §9.1 made visible: the base trajectory differs between the two runs, and with it the baseline each percentage is divided by.
Two conclusions, and the second is the one that should govern how these numbers are used. The attenuation across panel versions is most likely confounding removed—the fertility effects shrank in the version that admitted the income domain, which the panel did not contain until the defect of §4 was repaired. But the contrasts are conditional on a base year and a shared path, and the four surviving directions are the only ones this paper is entitled to state without that qualification. Producing them with a band over plausible base years and shared paths is unfinished work, not a refinement.
The method establishes directions, not magnitudes; relations among counties, not among people; and contrasts, not forecasts. Two of the eight contrasts attempted are disqualified by its own region diagnostic. We set these out as a numbered part of the argument rather than as a closing hedge, because each is a measured property of the results rather than a caveat of manners.
Every effect is an effect on a county, not on a person . A county where women’s education and childlessness both rise says nothing directly about whether the educated women are the childless ones. Stating this does not dispose of it.
Propagating levels requires the synchronized displacement, which §7 shows does not extrapolate. Across panel versions a decade-ahead forecast of the same quantity moved by a factor of five for births and changed sign for female-headed families. A contrast removes that component from the difference equation; it does not make the result independent of it (§9.1).
A one-standard-deviation move in correctly scaled income leaves the manifold: the intervened system state is in region for 14% of units. Such results are reported flagged and are not interpreted. The diagnostic disqualified two of the eight contrasts attempted.
See §11. The direction of an effect is established as firmly as this method can establish it; its size is not.
The two-part code is minimized within a chosen family of models, and within that, a chosen architecture. Neither choice is free, and the criterion cannot tell us what a different family of models would have found.
Three of these five are themselves measurements—the region fraction, the forecast divergence, the attenuation sequence—which is the property a benchmark should demand of every submission: that its boundaries be located by the same instrument as its results. A submission that reports where it fails, in the units it reports its successes, is one a custodian can rank; one that does not is a claim of standing.
P.L. 115–435 built the library and omitted the scoreboard. The access and confidentiality machinery it created is sound and is in place; what it lacks is a rule for saying which of two accounts of the same record is better—a model selection criterion, from which the data question follows—and in that vacuum both are settled by authority exercised where the public cannot follow. A criterion exists that does not require the public to follow: total description length of a sealed corpus, with programs submitted and only the bit count returned. It preserves confidentiality exactly, it scores the data cleaning rather than presuming it, and it converts replication from a privilege into an act anyone can perform.
We have demonstrated the submission format at a scale small enough to audit, and reported its failures at the resolution of its results: three curation defects invisible to the objective, one verification step that was itself defective, and two failures of the dynamics that are worth more than the successes around them.
The first is that the only component of our fitted system that does not extrapolate is the only component we supplied from outside it. The second is that a contrast, which removes that component’s explicit term from the difference equation, does not thereby become independent of it—three of seven reported outcomes change sign when the same intervention is propagated from a different base year. Read carelessly the pair looks like evidence against the premise. Read correctly it is the premise operating: a relation that is not autonomous fails exactly where autonomy is what was needed, and the failure is visible because the method measured for it.
Three things follow, and they are what make the failures useful rather than merely honest. They locate the boundary of the claim in the same units as the claim itself, so this paper states the four surviving directions and withholds the three that reverse. They were found by the diagnostics rather than by an objector, which is the behaviour a criterion of merit must produce if it is to be trusted where no objector has access. And they converge on one remedy—close the system, let the aggregate be generated rather than assumed—which removes both at once and is the obvious next piece of work.
The sums that turn on getting these dynamics right run to the tens of trillions of dollars. An incentive of that size attaches equally to getting the answer right and to ensuring that no hard number can ever show the answer was wrong. That is the strongest argument we know for adopting a criterion whose scoring admits no discretion, and for adopting it before rather than after the next occasion on which the public is asked to take an unfalsifiable claim on trust.
The worked submission—code, panel construction, every model checkpoint and the diagnostic logs—is available at the project repository, and each reported figure prints the invariance verdict and held-out performance of the model that produced it.
The criterion is minimized within a chosen family of models, so the obvious question is how much of the result is the class. Table 5 reports a sweep on a 90/10 split of the county cross-section, varying latent width, mixture components, hidden width and the reconstruction head.
| run | latent | components | hidden | total (Mbit) | bits/cell |
|---|---|---|---|---|---|
| L8_K3 | 8 | 3 | 512,256 | 35.155 | 9.378 |
| L16_K3 | 16 | 3 | 512,256 | 35.001 | 9.260 |
| L32_K1 | 32 | 1 | 512,256 | 35.323 | 9.642 |
| L32_K3_norec | 32 | 3 | 512,256 | 34.992 | 9.344 |
| L32_K3_wide | 32 | 3 | 1024,512 | 35.165 | 9.389 |
| L32_K5 | 32 | 5 | 512,256 | 34.797 | 9.308 |
| L64_K3 | 64 | 3 | 512,256 | 34.921 | 9.281 |
| L128_K3 | 128 | 3 | 512,256 | 35.079 | 9.393 |
Two things follow, one reassuring and one not. The spread across a sixteen-fold range of latent width is \(1.51\%\) of total bits, so the reported code lengths are not an artifact of a lucky architecture; and a single mixture component is the worst configuration, which is the mixture head earning its place. What does not follow is that the panel model’s architecture is optimal—this sweep was run on the cross-sectional model and the panel model inherited its settings rather than repeating the search. A submission to the benchmark of §3 would have no reason to inherit anything, which is the point of scoring rather than asserting.
Fitting is not convex, so where two architectures are compared we run each from several seeds and report the shortest. That raises an obvious objection—the number of restarts looks like a parameter nobody paid for, and a minimum over \(K\) tries is a biased estimate of what a model can achieve. The objection dissolves in the mechanism and survives in the paper, and it is worth separating the two.
In the mechanism of §3 there is nothing to correct, because nothing is being estimated. The custodian runs a submitted program and publishes the bits that program achieved. A program that restarts internally spends its submitter’s compute and returns one number; the criterion never asks what code length was attainable, only what this program attained. That is a quiet advantage of scoring programs over estimating an infimum, and it is the same property that lets curation sit inside the scored object.
Within this paper the objection stands, and we handle it the only honest way: \(K\) is matched across the architectures being compared, runs are paired by seed, and the spread is reported alongside the difference. Run-to-run spread at fixed architecture is \(5\times10^{4}\) bits, about \(0.005\) bits per cell, which is the floor any architectural claim here has to clear.
That restarts are needed at all is a fact about the objective rather than a nuisance: the architectures whose aggregate is generated rather than supplied have a markedly rougher surface than those whose aggregate is handed to them, with five times the seed spread. Fixed restarts are the crudest possible response to that, and the adaptive-reannealing literature is the natural place to look for a better one. We note the connection and do not pursue it: changing the optimizer mid-study would confound the architectural comparison this section exists to make.
Every source is public and no restricted data were used. USA Counties (U.S. Census Bureau) supplies the 1970–2010 backbone; American Community Survey five-year detailed tables for 2006–2010, 2011–2015, 2016–2020 and 2020–2024 are retrieved from data.census.gov; county-subdivision tables for Connecticut come from the same endpoint. Harmonized long-run series are IPUMS NHGIS extract nhgis0001 (time series tables BX3, A34, BM4, A67, BS4, AG4, B79, AB2, BD5), which requires the citation: Schroeder, Van Riper, Manson, Cooper, Krause, Kugler, Zhu and Ruggles, IPUMS National Historical Geographic Information System: Version 21.0, IPUMS, 2026, doi:10.18128/D050.V21.0. County population estimates are from the Census Bureau’s Population Estimates Program (vintages as cited in code); single-year-of-age county populations from the National Cancer Institute’s SEER program; county student-debt measures from the Urban Institute. Code, the panel’s construction, every model checkpoint and the diagnostic logs are in the project repository; each figure prints the invariance verdict and held-out performance of the model that produced it.
The American Community Survey's five-year rolling samples, the successor to the Decennial long form after 2000. Each release pools sixty months of interviews, so "ACS 2020-2024" describes the whole window rather than a moment, and consecutive windows overlap. Two consequences run through this work: comparing an early window with a late one understates change wherever the windows share years, and every estimate carries a published Margin of error which becomes the cell's Instrument precision.
The test a candidate Fill table value must pass before it is allowed into the Chart. A proposed source for an Item is accepted only if, at a time point where both the existing series and the candidate exist, they agree across counties in rank and in level: the rank correlation must clear a threshold calibrated to the item's own decade-to-decade persistence, and the ratio of medians must sit near one. The self-calibration matters, because demanding that a filled series track the panel more tightly than the panel tracks itself would reject good data.
A gate that a defective series can bypass is worth naming, and one did: see Part-year base defect. The stricter form, used when the derivation has a known right answer, is Verify-then-emit.
Description length measured in programs rather than in codes for distributions: the complexity of an object is the length of the shortest program that outputs it, a quantity that does not depend on a chosen parametric family except up to an additive constant. Founded independently by Solomonoff, Kolmogorov and Chaitin in the mid-1960s.
It is uncomputable, so every practical use is an approximation — here a Two-part code over one model class. But it is the criterion being approximated, and it is what the Core methodological thesis appeals to at the System identification stage, where the object sought is a generating law rather than a description of a sample. See Solomonoff induction and Algorithmic statistics. Solomonoff (1964); Kolmogorov (1965); Chaitin (1966).
The branch of Algorithmic information theory that gives formal meaning to the split a Two-part code performs: separating an object's meaningful information — the model, the lawlike part — from its accidental information, the residual that is incompressible noise relative to that model. Kolmogorov's structure function makes the trade-off precise and picks out a minimal sufficient statistic: the smallest model leaving a residual indistinguishable from noise.
This is the warrant for the move the whole project rests on — treating the model half of the code as the object of interest and the residual as nothing but measurement at Instrument precision. Without it, "the model got shorter" is a statement about an arbitrary partition. Kolmogorov (1974); Gács, Tromp and Vitányi (2001), "Algorithmic Statistics".
The property that makes a relation usable for policy: it continues to hold when something acts on the system rather than dissolving into the correlations that produced it. Named by Frisch in 1938 and developed by Haavelmo in 1944, it predates Pearl's do(C) by about half a century, and Pearl credits Haavelmo for it. It is the Warrant this project appeals to: the claim is not that a graph was drawn correctly but that a measured Recurrence held fixed across decades and across US states. Frisch (1938), memorandum on autonomy; Haavelmo (1944), "The Probability Approach in Econometrics".
Supplying values for time points where an Item exists as a concept but not as a published number, by locating the same construct in another source and passing it through the Acceptance gate. Distinct from imputation: a backfilled cell is a measurement from elsewhere, not a model output. The Pullback does imputation proper, and the two are kept separate so that a claim about code length is never resting on the model's own fabrications.
Gary Becker's account of marriage and fertility as household production: gains from marriage arise from specialization, and children are time-intensive goods whose cost rises with the wage of whoever supplies the time. It predicts that rising women's wages lower fertility through the Opportunity cost of children and weaken the specialization gain from marriage. It is the standard economic frame for the question this project asks, and the frame the Contrast on women's participation is designed to probe. Becker (1973), "A Theory of Marriage"; (1981), "A Treatise on the Family".
Accumulating a code length one block of rows at a time under gradient checkpointing, so that the (rows by items by mixture components) intermediates are never all resident at once. A code length is a sum over cells, so blocking is identical arithmetic; what changes is that each block is recomputed during the backward pass instead of being held. Introduced when the widened panel exceeded the GPU by about a hundred megabytes. Verified identical at fixed parameters: gradient cosine similarity $1.000000000000$, relative difference $3.7\times10^{-7}$. Runs still diverge over many optimizer steps, because floating-point summation order differs and gradient descent amplifies it.
A subspace identification method that chooses latent coordinates to maximize correlation between the past and the future of a series, rather than to maximize explained variance. The distinction matters here: a variance-ranked decomposition keeps whatever is large, while a predictive-state decomposition keeps whatever carries information forward, and those are not the same coordinates. See Latent state.
The intervention operator used throughout this work, deliberately not written do(C). $\mathrm{cause}(C)$ is the Minimum-norm displacement of a county's Latent state that realizes condition $C$ in the decoded observables, with every other observable co-moving as the manifold requires, propagated forward by the identified Recurrence and decoded with intervals.
Nothing is severed and there is no graph. Because the Cross-section as system state is the whole county record, a condition on one Item necessarily moves others, and those Co-moves are reported rather than assumed away. Minimum norm is a stated choice, not something the data forces. The Warrant for reading the result as causal is measured Autonomy, not graph surgery.
One number in the Chart, at the intersection of a row and a column — the spreadsheet sense of the word. A row is one county at one time point; a column is one Item, a property of counties. The cell where they meet is that county's value of that property in that year: Webb County, median home value, 2020. It is the Panel's atom --- what plain usage would call a datum --- and the unit everything in this project is counted in.
The Panel version reported here is 25,168 rows (3,146 counties at eight time points) by 777 columns: 19,555,536 cells, of which 9,280,572 are observed and the remaining 10,274,964 were never measured. That is 47.5% — the table is about half empty, and the half that is empty is not missing at random, since a column exists only for the years its source published it.
Three consequences run through the method. Each cell carries its own Instrument precision, the published Margin of error of that county's estimate of that item in that year, so the residual code is summed cell by cell at cell-specific precision rather than at one tolerance for the table. Unobserved cells contribute nothing to the code, and are not filled in first and coded afterwards; Observed-cell MDL is where that distinction is argued, and it decides whether a code length means anything at all on a table this empty. And every code length is reported per cell, because a total in bits is uninterpretable across tables of different size while bits per cell can be compared with the Per-item null and the Oracle.
The assembled numerical object the model trains on: a matrix of county-time rows by Item columns, with a parallel matrix of per-cell Instrument precision values and a boolean mask of which cells are observed. Built by one function whose flags record every curation decision, so that a model checkpoint plus its configuration reproduces the exact chart it saw. Values are stored under the log1p / s95 transform. Distinguished from the County-decade panel, which is the underlying design; the chart is that design rendered into arrays.
The Confidential Information Protection and Statistical Efficiency Act, re-enacted as Title III of the Evidence Act. It protects records collected for statistical purposes from disclosure or use against the respondent, and establishes a presumption that such data be made accessible to qualified researchers for evidence building. Both halves matter here: the protection is why a corpus cannot simply be released, and the accessibility presumption is why a Sealed-corpus benchmark is administratively reachable without new legislation.
A model in which every quantity that moves the system state is itself part of the system state, so nothing is supplied from outside. This project is not closed, and the consequence was measured: the shared displacement is either a free parameter per period or a linear function of national series imported from elsewhere, and it is the only component of the fitted system that fails to extrapolate. Having refused the Exogenous variable at county level, we reinstated it at the aggregate.
The remedy is concrete. Eight of the twelve national series used are aggregates of the county cross-section and should be computed from the system state; the remaining four -- consumer prices, real output per capita, the long mortgage rate, federal debt to output -- are genuinely outside a county panel and should be promoted to state variables carrying their own dynamics rather than imported. A closed system has no shared displacement to extrapolate, because the aggregate is generated rather than assumed.
Period fertility describes what happened in a calendar year across all ages; cohort fertility describes what a group born in the same year eventually did. The Total fertility rate is a period measure, and it can fall and recover purely because births are postponed, with completed cohort fertility barely moving. Any claim that a policy or a price "reduced fertility" has to say which one it means. See Tempo and quantum.
The change an intervention induces in observables other than the one it names, because the system state is a point on a manifold and cannot be moved in one coordinate alone. Reported alongside every cause(C) result in within-standard-deviation units, largest first. They are the honest content of "no exogenous variables": in a finite system the co-moves are not contamination to be purged, they are what intervening actually consists of.
A state-space model in which the Recurrence's output must code not only the next period's observations but also the encoder's own embedding of that next period. Without the closure a Recurrence can score well one step ahead while its image drifts off the manifold, so multi-step propagation becomes meaningless — which is exactly what happened in the unconstrained joint model here, and why its multi-step effects were withdrawn. The closure term is a Gaussian code on the latent discrepancy at its own fitted per-coordinate scale.
An intervention stated as two conditions at once — typically move one Item and hold another at its factual value — rather than as a single-item change. Two reasons. Substantively, a single-item move on this manifold drags the whole labour market with it. Technically, a contrast is a difference between two system states propagated by the same Recurrence, so the shared displacement's explicit term cancels from the difference equation — including the Synchronization component, which is the part that does not extrapolate.
The cancellation is narrower than it looks. The base trajectory still depends
on every shared displacement applied before it, and for a quadratic map the remaining bracket
depends on that trajectory, so the shared path reaches the answer twice: through the latent
difference and through the decoder, whose percentage baseline it moves. Both routes are measured
rather than argued. Doubling the shared path at every step for thirty years moves the latent
difference by $2.8\%$. Varying only the shared path across eight scenarios
(shared_path_audit.py) moves magnitudes by a median of $0.32$ times the fitted-path
effect and holds $79$ of $84$ signs, where two scenarios leave the region the data occupy and are
dropped unread. Four of the five sign changes are median home value, a nominal-dollar item that
cannot be separated from a shared path which is mostly the price level; it is also the outcome
that changes sign between a 1980 and a 1990 base. Contrasts are conditional on a base year and a
shared path in magnitude; the family-structure directions survive both tests. See Closed
system, which removes both routes by construction.
The claim that organizes the project, and the reason code length is applied at two stages with different standing.
Compressing a static cross-section is statistical model selection. What it exploits is correlation among Items across counties, and no quantity of it distinguishes a cause from a co-varying bystander. Compressing a record over time by an autonomous Recurrence is a different act: what is shortened is the description of the process, and the thing that shortens it is a generating law rather than a distribution over samples. The thesis is that the second is identification of mechanism where the first is only description of correlation.
Two things have to be kept straight, and the distinction is easy to lose. First, the induction principle at the second stage is Algorithmic information theory — shortest generating program — not Rissanen's statistical Minimum description length, which is its computable approximation within a fixed Family of models and is the right tool only at the Manifold autoencoder stage. Second, algorithmic induction by itself delivers convergence of prediction, not of attribution: it will converge using a law that is not autonomous. The causal reading requires the further demand that the law hold in regimes it was not fitted on, which is Autonomy, tested as Invariant causal prediction and scored by Skill. Compression supplies the candidate; invariance out of regime is what promotes it to a mechanism.
Deciding which instruments enter the record at all. No criterion defined over a fixed corpus can make this decision, because the alternatives differ in what they contain rather than in how well they are described -- which is why it survives every refinement of the criterion and is the irreducible residue of the Core methodological thesis. Compression scores descriptions of a record; it is silent on the design of the study that produces the record.
The Instrument-proximate corpus rule does not solve it but sharpens it, converting ``which processed products do we trust'' into ``which instruments do we read'', which is a question about the world rather than about somebody else's judgment calls.
One of the successive assemblies of the County-decade panel, each admitting data the last one lacked: 525 items, then 770 once the Reference-year column defect was repaired, then 777 with the 2011-2015 window added. Comparing results across versions is how this project measures whether a finding is a property of the world or of what happened to be in the file — the primary Contrast keeps its sign across all three, while its magnitudes attenuate monotonically.
Never called a ``generation''. This project studies intergenerational causation and reports an outcome named the next generation's bachelor's share, so that word is reserved for people. The collision is the same hazard as System state against US state and Family of models against Family household: system identification and demography grew their vocabularies separately, and applying one to the other keeps producing it.
The design underlying the Chart: roughly 3,140 counties observed at seven time points from 1970 to 2024, each carrying several hundred Items. Decadal spacing was a deliberate choice — the time constants of fertility and family formation are measured in decades, and coarser spacing sharply reduces missingness — later extended with two sub-decade points from the ACS 5-year estimates to reach 2024. Counties are keyed by STCOU.
The fraction of observed cells whose true value falls inside the model's nominal ninety-percent predictive interval. A calibration check rather than an accuracy one: a model can have short code length and still lie about its own uncertainty. Values near 0.92 to 0.93 here, slightly conservative.
A rule for saying which of two models of the same record is better, computable without discretion. Model selection is the primary act and data selection follows from it: a source or a cleaning step earns its place when the account it makes possible costs fewer bits than the account without it, which is a question the criterion answers and no amount of deliberation about corpus selection can. The Evidence Act created access and governance for federal evidence building and defined no such rule, so the question falls to expert judgment exercised inside privileged access. This project proposes total description length at Instrument precision as the missing criterion: a number in bits, with no tuning constant, no protocol to negotiate and no test set to select.
The modeling stance that a county's system state at a time is its entire observed cross-section — every Item at once — rather than a handful of variables chosen in advance. The alternative, selecting a few "drivers" and calling the rest noise, imports a causal hypothesis before any measurement occurs. Stated in this project as the refusal of the Exogenous variable: in a finite universe nothing is outside the system, so the burden is on any proposal to *remove* a coordinate, not to include one. The cost is dimensionality, paid for by the Manifold autoencoder.
The sample questionnaire sent to roughly one household in six at each decennial census through 2000, and the source of everything the short form did not ask: income, education, labor force, housing value, detailed marital status. Discontinued after 2000 and replaced by the ACS 5-year estimates, which is why so many series in this panel change source at the 2000-to-2010 step and why that single splice receives disproportionate scrutiny.
Randomly hiding a fraction of the observed inputs during training while still requiring the model to code them. It prevents the encoder from copying inputs to outputs and forces the Latent state to carry information that generalizes across coordinates, which is also what makes the Pullback usable as imputation.
The ratio by which a survey's true standard error exceeds the simple-random-sampling (binomial) value, because of clustering, stratification and weighting. Rather than assume one, this project measures it: the same shares exist in the panel at points where the ACS 5-year estimates publish a Margin of error, so the ratio of that sigma to the binomial sigma on the same counties gives the factor, measured at 1.59 and applied to every year of the NHGIS-derived series.
The component of the Recurrence that acts on county-specific motion, after the Synchronization displacement shared by all counties is removed — a part of the transition law, never the whole of it. Fitted in quadratic form it is measurably invariant across decade regimes; fitted linearly it is not, curvature being read as time-variation when the form is forced to be linear. That invariance is the measured Warrant for the causal reading. The name follows the developmental-trajectory literature in single-cell biology, where the same problem arises: recovering a process from a population observed without a clean time axis.
What a statistical agency does to stop a published table from identifying an individual: suppressing small cells, rounding, swapping records between similar areas, and more recently injecting calibrated noise under Formal privacy. It is not a marginal nuisance for a county panel — it sets a hard ceiling on what county tabulation can ever show, and it binds hardest in small counties, which is exactly where this panel is already thinnest.
It now also sets the panel's end date. As of the Census Bureau's August 2026 updates no release date has been set for the 2021-2025 ACS 5-year estimates: the Bureau is working out how to publish them under a Department of Commerce order, DAO 216-26, and has said it is seeking a compliant method for release later in 2026. Until then the County-decade panel ends at 2024.
A movement of a unit's Latent state, in the coordinates the Manifold autoencoder learned. The word is never used bare in this project, because two displacements with opposite standing are in play at once. The shared displacement is the period-by-period motion every unit receives together (Synchronization); it is supplied from outside the system, it does not extrapolate, and it is the reason level forecasts are not quoted. The minimum-norm displacement is what cause(C) computes: the smallest move of one unit's system state that realizes a stated condition (Minimum-norm displacement).
A Contrast is built to cancel the first and report the second, which it does for the explicit term but not for the trajectory behind it — measured, magnitudes move by a median of 0.32 times the fitted-path effect while 79 of 84 signs hold. See Contrast.
Pearl's intervention operator: setting a variable to a value by deleting the edges into it in a causal graph, so the intervened variable no longer responds to its former parents. Its warrant is the correctness of the graph. This project uses cause(C) instead, not as an objection to Pearl but because the invariant structure here is a Recurrence rather than a DAG, and there is nothing to sever. Both formalize Autonomy; the difference is what kind of object is assumed autonomous. One practical asymmetry: a recurrence's autonomy is testable out of sample, and is tested here. Pearl (1995, 2009).
Richard Easterlin's argument that fertility responds to young adults' income relative to the material expectations formed in their parents' households, not to absolute income. Large cohorts crowd the labor and housing markets, depress their own relative position, and postpone or forgo children; small cohorts do the reverse. It is the closest thing in the existing literature to Outbidding the economy, and it is a relative-price argument, which is why the Contrast rather than the level forecast is the right instrument for it. Easterlin (1980), "Birth and Fortune".
Inferring about individuals from relationships measured on groups. A county where women's education and childlessness both rise tells you nothing directly about whether the educated women are the childless ones. This is the standing caveat on everything here: the analysis is of counties as units, and every effect is an effect on a county, not on a person. Stating it does not dispose of it. Robinson (1950), "Ecological Correlations and the Behavior of Individuals".
The ratio of women's to men's share of bachelor's degree or higher among adults 25 and over, with EDUFBA and EDUMBA the two component shares. A ratio rather than a difference, for three reasons: it is dimensionless and so comparable across counties at very different attainment levels, it stays positive and survives the log1p / s95 transform, and a ratio is a difference of logs, which is the geometry the Chart already works in. At the median county it runs 0.749 in 1970 to 1.196 in 2024, crossing one between 2000 and 2010. Relevant to Educational hypergamy.
Marrying up the educational ladder; hypogamy is marrying down, homogamy marrying level. The historical pattern of women marrying men with more education has inverted in most rich countries as women's attainment overtook men's, and a literature asks whether the adjustment in preferences has kept pace with the arithmetic. When EDURAT exceeds one, a strictly hypergamous norm becomes arithmetically unsatisfiable for some fraction of women — a structural Marriage squeeze in education rather than in numbers.
The number of independent observations a correlated sample is worth. Counties are spatially correlated and a county's successive decades are strongly autocorrelated, so 15,730 transitions are not 15,730 independent facts. Every invariance verdict here is scored against an effective count rather than a raw one, which is what keeps "the Developmental map varies across decades" from being a statement about sample size.
The time for a mode of a linearized Recurrence to decay by a factor of $e$, computed from the eigenvalue modulus. Reported here per latent direction to give the persistence of the identified dynamics in years: the slowest directions have e-folding times of centuries, which is a way of saying the county system has very long memory and that a thirty-year horizon is short relative to its own relaxation.
The Foundations for Evidence-Based Policymaking Act of 2018 (P.L. 115-435). Title I directs agencies to build evidence and appoint evaluation and data officers; Title II, the OPEN Government Data Act, establishes a presumption that public data be open and machine readable; Title III re-enacts CIPSEA and creates a presumption of accessibility for statistical purposes. The committee it established recommended the National Secure Data Service.
What it does not contain is a Criterion of merit. It is machinery for getting data to analysts, and it is silent on what distinguishes better evidence from worse -- so that judgment falls to peer review and agency expertise, neither contestable from outside the access regime. See Privileged-access replication.
A variable treated as determined outside the system under study, so that it can be varied without the model having to explain it. The organizing objection of this project is that in a closed finite system there are no such variables, and that designating some is a prior about causal structure wearing the costume of a modeling convenience. The alternative adopted here is the Cross-section as system state. The price is that nothing can be "held constant" for free: holding something fixed is itself an intervention, which is why interventions are posed as a Contrast.
A census unit: a householder living with one or more people related by birth, marriage or
adoption. Family structure supplies several of this project's outcomes — married couples with own
children under 18, female-headed families with own children, and the derived FAMMCH and
FAMFCH shares — and family formation is the substantive process the whole study is about.
Not a Family of models. The two senses collide in this work: the most robust substantive finding concerns families of the first kind, and the frankest methodological limitation concerns a family of models. Bare ``family'' is therefore never used.
A plain table of STCOU, item, year, value, delta rows produced by one
curation script from one source, which the Chart builder merges in. Keeping each
source in its own fill, merged in a fixed order with the last writer winning, means a
source can be added, corrected or withdrawn without touching the others, and the
provenance of any cell is a matter of record rather than reconstruction. Items not
already in the panel become new columns.
A Disclosure avoidance approach that bounds, by a stated and published parameter, how much any one record can influence a released statistic — differential privacy and its relatives — as against traditional methods like swapping, whose protection is real but unquantified. Used for the 2020 decennial census. Whether the ACS will move to it is not yet known; that is the open question behind the 2025 delay.
Two consequences for this work if it does. A published Margin of error would then describe sampling error alone, so Instrument precision would understate total error unless the injected noise variance is added to it — and because a formal mechanism publishes its parameters, that correction is exactly computable, which swapping never permitted. And the change would be a method change at a splice, the failure mode this panel has already been damaged by once, so any 2025 point must clear the Acceptance gate against a 2024 point produced under the old regime rather than being appended to it.
The set of candidate functions of the Latent state from which the Recurrence is built — here constants, linear terms and pairwise products. Fitting a Recurrence means selecting a sparse combination from the library by code length rather than by a significance threshold, so that adding a term must pay for itself in bits. The approach is shared with sparse-regression system identification.
The decoder's output layer: for each Item it emits a small mixture of Gaussians rather than a point estimate. This is what lets the residual term be an honest code length — the number of bits to transmit the true value given the model's distribution at that cell's Instrument precision — and what lets asymmetric and multi-modal item distributions be coded without transformation tricks.
A set of period-to-period transitions excluded from the training objective and kept for scoring. Naming the year that a transition starts identifies it: holding out 2010 removes the 2010-to-2020 step. This is the only honest test of the Recurrence, because the Pullback can always code a period it has seen. Scored against Persistence, Oracle and the Per-item null; see Skill.
A standing prize for lossless compression of a fixed corpus of English Wikipedia, premised on the claim that compression and understanding are the same problem. Two features are load-bearing for the proposal here: the corpus is raw, markup and errors included, so that cleaning is part of the submitted compressor rather than unscored prologue; and the score is a single number that admits no discretion. The macrosociological analogue is a Sealed-corpus benchmark, which adds only that the custodian runs the program because the corpus cannot be released.
The share of counties whose intervened system state still lies within the region of the manifold where data exist. A cause(C) result with a low in-region fraction is describing counties that do not exist, and is reported and flagged rather than quoted. The clearest instance here: after per capita income was corrected to real dollars, a one-standard-deviation income intervention fell to 2 to 7 percent in-region, because a full cross-county standard deviation of income is simply outside the region the data occupy.
The resolution at which a cell's value is actually known — the published Margin of error for a survey estimate, the rounding step for a tabulated count, a propagated combination for a derived quantity. Carried per cell alongside the value, and it is what makes the residual term a code length rather than a likelihood: coding a number to infinite precision costs infinite bits, so the question "how many bits does this model save" only has an answer once you say how precisely the data are known.
The rule that a corpus should be held as close to the measurement instrument -- mechanical like a thermometer, or institutional like a vital-statistics registry -- as law allows, so that every cleaning step falls inside the submitted algorithm rather than upstream of it.
The argument is measured, not aesthetic. Per-capita normalization of a median costs exactly $-0.0000$ bits when the denominator is in the corpus, because the corrupted column is then an invertible function of the clean one: as a step inside a program the choice is free and legible, and the criterion is rightly indifferent. Applied before the corpus the same step is unfalsifiable, and the column silently denotes something other than its name -- which is how the Median per-capita defect survived. Everything upstream of the boundary is axiom.
The property that licenses reading a fitted relation as something one may act on rather than merely read off: the same relation holds, with the same coefficients, across environments that differ in every other respect (Regime). It is the content of Autonomy in Frisch and Haavelmo, of the Lucas critique's demand, and of Invariant causal prediction's identification criterion.
Tested here by Minimum description length, not by a significance test: a map is invariant across a set of regimes when fitting it separately per regime does not pay for its own extra Parameter code. On the current model the quadratic Developmental map is invariant across all six decade regimes and the linear map across all 41 US-state regimes. The verdict is recorded per run and printed on every figure (Warrant), so a weakened claim travels as a weakened claim.
An extensive Item scales with county size — a count of households, an aggregate payroll — and must be divided by population before counties are comparable. An intensive item is already a ratio, a rate, a median or an average, and must not be. Getting this wrong in either direction produces a quantity with no meaning, and it went wrong twice here: see Median per-capita defect. The unit code alone cannot decide it, since dollars label both an aggregate payroll and a median income, so the item description has to be consulted; see Prenormalized item.
An identification strategy that takes invariance across environments as the criterion for causality: a relation that holds unchanged across regimes is a candidate causal relation, and one that does not is not. It supplies the formal basis for what this project measures when it asks whether the Developmental map is the same across decades and across US states. Peters, Bühlmann and Meinshausen (2016), "Causal inference by using invariant prediction".
One measured quantity in the panel, identified by a short code — HSG490
for median owner-occupied home value, VST020 for births per thousand — and
carrying a unit indicator, a description and a decimal resolution. The codes come from
USA Counties; constructed measures added here use mnemonic codes of the same shape.
Items are the columns of the Chart.
The low-dimensional coordinates the encoder assigns to a county at a time point — thirty-two numbers standing in for several hundred Items. The claim that this is a system state rather than a summary is an empirical one, and it is tested: a system state must support a Recurrence that predicts the next period, which is what the Consistency-closed model enforces and the Held-out transition scores.
The ratio of women's to men's labor force participation among adults 16 and over, with LFPRF and LFPRM the components. At the median county it runs 0.507 in 1970 to 0.868 in 2024 — women's participation rising from 36.9 to about 55 percent while men's falls from 73.7 to 63.5. Together with EDURAT it is the measured form of the change whose consequences this project asks about.
Joining records on the same person or household across agencies -- tax to survey to program to education. It is what makes restricted access valuable and it is the most tightly governed operation in federal statistics, because the governing statutes differ by agency and were not written to compose. A Sealed-corpus benchmark needs the linked corpus to exist; creating it is a political question the mechanism does not answer, and it is the largest real obstacle to the proposal.
The Chart's storage transform: $y = \log(1+x)/s_{95}$, where $s_{95}$ is the 95th percentile of the observed $\log(1+x)$ values across the whole chart. The logarithm puts items spanning eight orders of magnitude on comparable footing and makes ratios into differences; the single global scale keeps one common unit so that bits per cell means the same thing everywhere. Instrument precision is propagated through it as $\delta y = \delta x / ((1+x)\,s_{95})$. It requires non-negative values, which is why derived measures are defined as ratios rather than signed gaps.
Robert Lucas's 1976 argument that relationships estimated from historical data will change when policy changes, because the behavior generating them was optimized against the old policy. It is the dynamical statement of Autonomy: a relation that is not autonomous breaks precisely when you act on it, which is precisely when you wanted it. The reason this project insists on out-of-sample invariance testing rather than fit.
The encoder-decoder pair that takes a county's full observed cross-section to a Latent state and back. "Manifold" rather than "compression" because the object of interest is the learned surface the counties lie on: the Recurrence is defined on it, cause(C) moves along it, and the In-region fraction asks whether a proposed intervention stays on it. Trained by Minimum description length, not by reconstruction error.
The Census Bureau's published sampling uncertainty for a survey estimate, given at the 90 percent level, so a standard error is the margin divided by 1.645. Converted to Instrument precision for every cell sourced from the ACS 5-year estimates. Where no margin is published, a standard error is derived from the sample fraction and inflated by a measured Design factor.
Bits per cell of the model minus bits per cell of the Per-item null, a negative number when the model helps. The comparison that survives a change in the item set: absolute bits per cell fall simply by adding predictable items, so two models built on different panel versions can only be compared on their margins, and even then only cautiously, since the null itself changes character when the added items are highly persistent.
Men per woman in the age bands that actually marry each other, built from single-year-of-age county populations with the male window offset upward by the observed marriage-age gap rather than by a fixed constant, so that the measure tracks the gap as it changes. MSR0 is the unoffset version for comparison. The quantitative form of the Marriage squeeze; the age offset is taken from Singulate mean age at marriage.
An imbalance in the number of available partners at marriageable ages, arising mechanically when cohort sizes change and men marry younger women. Guttentag and Secord's extension argues that the scarcer sex gains dyadic power while the more abundant sex faces worse terms, with consequences for marriage rates, family-household stability and fertility. Measured here as the Marriage-market sex ratio; the education analogue is under Educational hypergamy. Guttentag and Secord (1983), "Too Many Women? The Sex Ratio Question".
A curation bug in this work, named because it recurred. Per-capita normalization was keyed on the unit code alone, and dollars are a count unit, so four dollar-median housing items were divided by county population — producing median-value-per-resident, a quantity with no interpretation. Found and fixed; then found again in a second form where the guard matched "average" and "median" but not "mean" or "per capita", which put per capita personal income, a Contrast variable in every causal result to that point, through the same mill. Both are instances of Intensive and extensive items being misclassified. Recorded here because the lesson is that a defect of this shape is invisible in fit statistics and only shows up when someone reads the numbers in their own units.
Rissanen's principle that the best model is the one that, together with the data encoded using it, yields the shortest total description. It converts model selection into a measurement in bits with no free parameter for how much complexity to tolerate: a model earns a parameter only if that parameter buys back more bits than it costs. Implemented here as a Two-part code.
It is a statistical principle, and its scope in this project is the first stage only. It selects within a parametric family, and it is the right tool for the Manifold autoencoder, where the task is to compress a cross-section and the structure being exploited is correlation among Items. It is not the criterion appealed to at the System identification stage: there the object is a generating law, the governing principle is Algorithmic information theory, and this is its computable approximation rather than its equivalent. Treating Rissanen as the criterion at both stages collapses the distinction the Core methodological thesis exists to draw. Rissanen (1978), "Modeling by shortest data description".
Of all the latent moves that would realize a stated condition in the decoded observables, the shortest one. It is the choice that makes cause(C) well defined, since infinitely many latent states satisfy a condition on a few coordinates, and it is a choice: it encodes an assumption that an intervention disturbs the system state as little as it can, which the data do not establish. Stated on every figure for that reason.
The class of models a description length is minimized within — here a Manifold autoencoder of stated width and depth with a Gaussian mixture head, plus a Recurrence built from a Function library. The choice is not free and the criterion cannot price it: two-part Minimum description length ranks models inside a family of models and is silent about which family of models was chosen, which is the computable approximation's distance from Algorithmic information theory, where description length is measured over all programs.
Measured sensitivity: across eight architectures spanning a sixteen-fold range of latent width, total description length varies by $1.51\%$, so the reported code lengths are not an artifact of one lucky choice. That is a statement about architecture within a family of models, not about the choice of family of models.
Not a Family household. See that entry for the convention keeping them apart.
Modeling the Synchronization component as a function of a few national time series rather than as a free displacement per decade, in the hope that it would then extrapolate to an unseen decade. It does not. Held out, the extrapolated national displacement coded the next decade at 27.9 bits per cell against 14.0 for assuming no shared motion at all — a linear function of national components fitted on three decades is worse than nothing. Recorded as a negative result: level forecasting from a county's system state is unsupported here, which is why the project reports a Contrast instead.
The secure enclave for evidence building recommended by the advisory committee the Evidence Act created: a facility where approved analysts compute on restricted records that never leave it. It is the institutional vehicle a Sealed-corpus benchmark would run inside, which is why that proposal requires no new legislation -- the enclave, the confidentiality regime and the mandate already exist. What is missing is a published number and an open submission queue.
The IPUMS National Historical Geographic Information System, which republishes US census tabulations from 1790 onward with consistent codes and documentation, through an API that builds extracts to order. Its Time series tables are the reason the sex-split education and marriage-age series in this panel run from 1970 instead of 2000. Use requires registration for the NHGIS collection specifically and a citation. Schroeder, Van Riper, Manson, Cooper, Krause, Kugler, Zhu and Ruggles, IPUMS NHGIS Version 21.0, doi 10.18128/D050.V21.0.
Linking geographic units across time by their names and codes, disregarding boundary changes — as opposed to geographically standardized integration, which interpolates every year onto one census's boundaries. Nominal is the right choice for a STCOU-keyed county panel, since counties rarely change shape and interpolation would introduce error everywhere to fix a handful of cases. Its failure mode is a code that means different areas at different times, or stops existing: see Planning region gap.
Setting the initial weights so the untrained model's output is exactly the Per-item null — each item a Gaussian at its own mean and variance. Epoch zero then scores the null exactly, and every bit the model subsequently claims is a bit it earned, measured from a baseline the model itself reproduces rather than from a separately computed reference.
Restricting the residual code to cells that were actually measured, with unobserved inputs entering the encoder as the feature mean and contributing nothing to the loss. The alternative — imputing, then coding the imputations — would let the model earn bits for predicting its own guesses. With a panel about half observed, this distinction is the difference between a code length that means something and one that does not.
The earnings and career progression forgone by whoever supplies the time children require. It rises with the wage of that person, which is why the standard economic prediction is that improving women's labor market position lowers fertility, and why the effect should be strongest for the highest-earning women. The demand side of the same relation that Outbidding the economy describes from the other direction. See Becker specialization model.
The code length achieved when the target period is coded from the encoder's own embedding of that period — the model given the answer. It is the attainable floor: no Recurrence can beat it, because it represents what the decoder can do with perfect knowledge of the system state. The denominator in Skill, and the quantity that keeps a hard prediction problem from being mistaken for a bad model.
The question this work was built to ask, in the form the user posed it: whether young men can outbid the economy for the fertile years of the most economically valuable women, and what follows for the next generation. It frames family formation as a bidding contest for a specific scarce resource — the limited fertile window of women whose labor is most highly valued — in which the competing bidder is paid employment. It is not standard terminology. The nearest established relatives are the Opportunity cost of children, the Easterlin hypothesis (relative income of young adults), and the Two-Income Trap (the bid getting capitalized into housing). Its empirical shadow in this panel is the pairing of LFPRR and EDURAT against family-structure and fertility outcomes, posed as a Contrast.
The second half of the Two-part code: the bits needed to transmit the model itself. Computed two ways here — an entropy code over quantized weight levels, used for honest accounting, and a differentiable Laplace code at the same quantization step, used inside the gradient so the optimizer actually feels the cost of its parameters. Without this term nothing stops a model from spending unlimited complexity to shave the residual. See Quantization-aware training.
A second named curation bug. Every Census Population estimates vintage begins at an April census base, so the "year" at the start of a vintage covers roughly three months, not twelve. Births filled at the 2010 point from such a base read 3.19 per thousand against a true 12.75 — a quarter of the real value — and it passed the Acceptance gate because rank correlation across counties was unaffected. The general lesson: a gate testing rank and level ratio catches a wrong shape but not a uniform scale error in a period definition.
The reference model in which every Item is an independent Gaussian at its own mean and variance, with no county and no time structure. It is what the model must beat to have learned anything at all, it is where Null initialization starts, and its code length is the denominator of the Margin over null. A weak baseline by design: beating it is necessary, not impressive.
The baseline that predicts no change: decode the base period's Latent state and use it to code the target period. The one a Recurrence must beat to be worth anything, since most of what a county is next decade is what it was last decade. It must be computed on the same transitions being scored — mixing a persistence figure from the training transitions with a model figure from the Held-out transition produced a badly inflated Skill here before it was caught.
Connecticut replaced its eight counties with nine councils-of-government planning regions for federal statistical purposes, effective with ACS 2022. Under Nominal integration the old county codes simply stop appearing, so the eight Connecticut counties had almost no observed cells at the 2024 point — and they include Fairfield and Hartford, high-income commuter counties central to the question. Nothing was corrupted: the new region codes fail the STCOU join and are dropped, so the cells were missing rather than wrong.
Closed. Both geographies are exact unions of the same 169 towns and a town's five-digit subdivision code survives the redefinition, so the old counties rebuild by summing county-subdivision tables. Connecticut's observed density at 2024 went from 0.004 to 0.290 against 0.319 nationally, 222 items across the eight counties. Nine items stay missing and should: a published median cannot be aggregated from town medians. See Verify-then-emit.
The Census Bureau's annual county population estimates, the source here for births, deaths and net domestic and international migration. Published in vintages, each revising the whole intercensal series from a fresh census base, so figures for the same year differ between vintages and the base year is a part-period. Both properties caused trouble; see Part-year base defect.
What looked like a break in county dynamics after 2020, and mostly was not. The median county did flip from losing domestic migrants to gaining them (−1.43 to +2.38 per 1,000 per year), and that part is real.
The headline acceleration was a sampling artifact. The original 1.66x compared a three-year window against decade-scale motion — different sampling rates. Once the panel gained sub-decade points, the noise-corrected county-specific rate per decade reads 0.106 (2010-2015), 0.093 (2015-2020) and 0.115 (2020-2024): post-2020 is about 1.15x the 2010s five-year rate. Skill likewise appeared to halve only while the comparison was a decade holdout against a four-year one; at matched sub-decade steps it is 0.59, 0.67 and 0.63. The identified law does not measurably degrade after 2020. The entry is kept because the wrong version was quoted for several days and stands in earlier commits.
An Item whose published value is already a ratio, rate, median, mean or per-capita figure, and which must therefore be exempt from per-capita normalization. Detected from the item description, since the unit code cannot distinguish an aggregate payroll from a median income. The detection pattern is a piece of curation logic worth naming because getting it wrong is silent: see Median per-capita defect and Intensive and extensive items.
The condition in which a finding can be checked only by someone holding the same restricted-data clearance as its author, so that it rests on the author's standing rather than on anything a challenger can attack. The customary remedy -- release the data -- is exactly what CIPSEA forbids for the records that matter most.
It is a verifiability problem wearing privacy's clothes, and it does not require releasing anything to fix. Under a Sealed-corpus benchmark an outsider who believes an official model is wrong can beat its number without ever seeing a record. The present regime gives that outsider no move at all.
An ordering of observations along a developmental trajectory recovered from the data alone, without using the time stamps — borrowed from single-cell biology, where cells are destroyed by measurement and no cell is observed twice. Applied here as a check, and the check was informative in the negative: the recovered ordering correlates strongly with calendar decade and barely at all with county-specific motion, meaning it is picking up Synchronization, not development. Counties, unlike cells, are synchronized by shared national conditions, which is precisely the difference that makes the biological method not transfer.
Encoding a county's cross-section to the Latent state and decoding it back to the original observables at their own Instrument precision, then measuring the residual code. "Pullback" because the manifold's structure is pulled back onto the raw data, in their own units, rather than being assessed in some transformed space where the error metric is arbitrary.
Two things fall out. The residual bits are a direct measurement of how much structure the manifold has captured, comparable across models. And the decoded values at unobserved cells are a principled imputation — one that respects the joint distribution of all items and reports its own uncertainty — which is a stronger object than the usual conditional-mean fill.
Rounding weights to a per-group step in the forward pass while passing gradients through to the unrounded masters — the straight-through estimator. Necessary because the Parameter code counts bits of quantized weights: a model must be scored at the precision at which it would actually be transmitted, and the step size itself is re-chosen periodically to minimize total bits. Without this, the Two-part code would be charging for a model different from the one being used.
One of the environments across which Invariance is tested — a decade, or a US state. A reserved word: it never means a policy, an administration, or a data-access arrangement, which are the senses ordinary usage would supply. The reservation matters because the whole causal warrant of this project is a statement about regimes in the first sense, and the Evidence Act discussion on the same page is about arrangements in the second.
A regime is useful in proportion to how unlike the others it is: invariance across two similar decades says little, invariance across forty-one US states and six decades says a great deal. See Warrant and Post-2020 regime shift, whose name is a legacy of the reading it corrected.
The rule taking a county's Latent state at one period to the next. Here it is the sum of a Synchronization displacement shared across counties and a Developmental map acting on county-specific position, built from a Function library and fitted by code length — at this stage an approximation to program length in the sense of Algorithmic information theory, not statistical model selection; see Core methodological thesis. It is the object whose invariance is tested, the object cause(C) propagates along, and the object the whole project means by "the identified system".
Naming: the recurrence is the whole transition law, the Developmental map only its county-specific component, and "linear" or "quadratic" names a functional form fitted to either. Bare "map" is avoided throughout, because this project's own logs and commit messages have used it for all three.
A column in USA Counties labeled by the year its quantity refers to rather than the year of the census reporting it: median household income collected in the 1980 census is income in 1979, coded 1979. A grid admitting only exact decade years silently dropped 245 such items from this panel — the entire income and poverty domain, plus parts of housing, labor force and age — leaving a panel with house prices and employment but no income levels at all. Admitting columns within one year of a decade point recovered them, taking the panel from 525 to 770 items. One year, not two: two would pull the 1998 and 2002 economic censuses into the 2000 point.
The Census Bureau's Small Area Income and Poverty Estimates, model-based annual county figures for median household income and poverty that borrow strength from administrative records. Present in USA Counties as a separate item group. Being model output rather than direct measurement, it is a different kind of object from a survey estimate, and its uncertainty is not a sampling Margin of error.
The proposed mechanism: contestants submit programs rather than findings, a custodian runs them inside the enclave, and only the resulting bit count is published. The data never move, so confidentiality is preserved exactly; the program is public, so the cleaning algorithm is scored rather than presumed; and replication becomes the act of submitting a rival program and beating the number.
Four properties follow: no discretion in scoring, adversarial verification without access, curation inside the scored object (see Instrument-proximate corpus), and symmetry -- it exposes an analyst whose model is beaten and protects one whose model is not. Three obstacles remain: Linkage, Corpus selection, and agency processing that is undocumented, where Formal privacy is a gain rather than a loss because it publishes its noise parameters.
Van de Kaa and Lesthaeghe's account of the post-1960s shift in rich countries: sub-replacement fertility, later marriage, cohabitation, births outside marriage, and a value shift toward self-realization. It supplies the descriptive backdrop for this panel's 1970-to-2024 window and an alternative reading of the same facts — values rather than prices. The two are hard to separate with aggregate data, which is worth stating plainly rather than resolving by assertion. Van de Kaa (1987); Lesthaeghe (2010).
The National Cancer Institute's county population files by single year of age and sex, 1969 to the present, produced for cancer-rate denominators. Their value here is incidental to that purpose: single-year age detail over a long unbroken span is what makes an age-offset Marriage-market sex ratio computable at all, and back to 1969 rather than 2000.
Scoring the model after permuting the correspondence between rows and their latent codes. The result should be far worse than the Per-item null, and is — about 14.4 bits per cell against a null near 9.6 — confirming that the code length depends on matching the right system state to the right county rather than on a generically flexible output distribution.
Hajnal's estimator of the mean age at first marriage among those who ever marry, computed from the proportions never married by age rather than from marriage registrations: $$\mathrm{SMAM} = \frac{15 + \sum_x w_x S(x) - 50\,S^*}{1 - S^*},$$ with $S(x)$ the proportion never married in age band $x$, $w_x$ the person-years the band contributes between exact ages 15 and 50, and $S^*$ the never-marrying share taken at ages 45 to 54. Used here because median age at first marriage is not published per county, while the never-married-by-age tabulations are. At the median county it runs 22.5 to 29.3 years for men and 20.7 to 27.7 for women, 1970 to 2024. Supplies the age offset in the Marriage-market sex ratio. Hajnal (1953), "Age at Marriage and Proportions Marrying".
How far the model closes the gap between the Persistence baseline and the Oracle floor on a Held-out transition: $$\mathrm{skill} = \frac{b_{\text{persistence}} - b_{\text{model}}} {b_{\text{persistence}} - b_{\text{oracle}}}.$$ Zero means no better than assuming no change; one means as good as knowing the answer. Preferable to raw bits because it is bounded by what is attainable given measurement noise. All three terms must be computed on the same transitions and the same items, or the number is meaningless — see Persistence for how that goes wrong.
Universal inductive inference: weight every program consistent with the observations so far by $2^{-\ell}$ in its length $\ell$, and predict with the resulting mixture. Solomonoff's convergence theorem bounds total prediction error by the complexity of the true generator, so the procedure learns any computable process from its own record, with no prior chosen by the analyst beyond the choice of machine.
Two consequences here. It is a statement about sequences — about dynamics — which is why it is the right frame for the Recurrence and not for a lone cross-section. And what it guarantees is prediction, not mechanism: see Core methodological thesis for why Autonomy has to be measured separately. Solomonoff (1964), "A Formal Theory of Inductive Inference".
Distinguish two claims. Solomonoff induction's convergence result is a theorem and wants no empirical evidence. What is empirical, and genuinely open, is whether bounded computable approximations inherit its virtues on real problems -- that is Solomonoff's thesis proper.
The objection that there is ``no empirical evidence'' for it has been used to decline the very instrument that would produce the evidence, which is circular: a Hutter Prize or Sealed-corpus benchmark is the experiment. Nothing measured in this project bears against the thesis; every failure reported here is attributable to a named violation of the framework -- most sharply the one recorded under Closed system.
The dynamical object: a point in the state space whose motion the Recurrence describes. In this project a unit's system state is its entire observed cross-section, compressed to the Latent state, and the claim that it is a system state rather than a summary is empirical and tested---a system state must support a recurrence that predicts the next period.
Not to be confused with US state, the jurisdiction. The collision is unavoidable in a paper whose units are counties nested in US states and whose method is state-space identification, so bare ``state'' is never used: it is always system state or US state. Watch for it in phrases like ``state variable'' and ``state regime'', which belong to opposite senses.
The five-digit US-state-plus-county FIPS code used as the panel's unit key: US state times 1000 plus county. The join key for every Fill table, and the thing that quietly fails when a US state redefines its county geography — see Planning region gap.
Carrying the length of each transition explicitly, so the Recurrence learns a rate per decade rather than a displacement per step. Needed once the panel gained points at 2020, 2023 and 2024: without it, a four-year step and a ten-year step would be fitted as though they were the same motion, and the apparent slowdown after 2020 would be an artifact of the spacing rather than a fact about counties.
The Census Bureau's tabulated decennial outputs: Summary Tape Files in 1980 and 1990, Summary Files in 2000 and later. STF1 and STF2 are complete-count tabulations; STF3 and STF4 come from the Decennial long form sample, STF4 carrying the detailed cross-tabulations. Which file a construct lives in changes by decade — marital status was a complete-count item in 1980 and 1990 but a sample item in 2000 — which is exactly the kind of discontinuity a Time series table exists to absorb.
The legal regime making student debt uniquely difficult to discharge in bankruptcy, tightened in stages: the 1976 Education Amendments barred discharge of federal loans for five years, extended to seven, and the 1998 Higher Education Amendments removed the time limit for federal loans entirely; the 2005 bankruptcy act extended protection to qualified private loans. The remaining route requires showing "undue hardship", which most circuits assess through the Brunner test (1987), a standard rarely met. Relevant because a debt that cannot be discharged is a fixed claim on household formation decades before children are considered — the mechanism the Two-Income Trap argues for, in a form its original analysis did not emphasize.
The component of decade-to-decade latent motion shared across counties, decomposed into a national part and a US state part, with the remainder being county-specific motion on which the Developmental map acts. The separation matters because the two behave completely differently: the developmental part is invariant across decades and usable, while the synchronized part does not extrapolate at all — see National parameterization.
A Contrast removes its explicit term from the difference equation, which is why contrasts are quotable where level forecasts are not — but not its trajectory dependence, which is measured rather than assumed away.
Its measured size depends heavily on what is in the panel. Admitting nominal-dollar income and housing items raised the national share from 0.49 to 0.76, almost entirely because prices inflate together; that is a property of the price level, not a rise in real synchronization.
The engineering discipline of inferring a dynamical model — system-state dimension, transition law, noise structure — from observed input-output records, with the model validated by prediction on data it was not fitted to. Its standards are the ones this project adopts in place of the regression-and-significance convention: a system state must be shown to be a system state, a law must be shown to be invariant, and a fit that has not been tested out of sample is not a result. See Canonical variate analysis, Held-out transition.
This is the project's second stage, and the criterion changes with it. What is being shortened here is the description of a process, so the standard is program length in the sense of Algorithmic information theory, not statistical model selection over a family of distributions — see Core methodological thesis.
The jurisdiction counties nest within, and one of the two regime families across which the recurrence's invariance is tested---the linear developmental map is invariant across all 41 US-state regimes present in the panel. It also carries a share of the Synchronization: displacement common to the counties of one US state but not to the country, measured at $0.05$ of squared decade motion against $0.79$ national.
Not the System state. See that entry for the convention this project uses to keep them apart.
Bongaarts and Feeney's decomposition of period fertility into quantum, how many children are eventually born, and tempo, when. Postponement alone depresses the Total fertility rate while it is under way and inflates it when it stops, so an observed TFR decline can be pure tempo. Any account of falling fertility owes an answer to which it is claiming. See Cohort and period fertility. Bongaarts and Feeney (1998), "On the Quantum and Tempo of Fertility".
An NHGIS product that reconciles one construct across multiple censuses and survey windows onto a single category scheme, naming the residual incomparabilities in the category labels themselves — for example "4 years of college (until 1980) or bachelor's degree (since 1990)". Preferable to splicing raw STF and SF summary files by hand, because a method change at a splice is a fabricated transition and this panel had already been damaged once by one.
The number of children a woman would bear if she experienced the current year's age-specific fertility rates throughout her life. A synthetic period measure, not a description of any real cohort, and therefore vulnerable to tempo distortion — see Tempo and quantum and Cohort and period fertility. The quantity this project began from, though the panel works with observed births per thousand and children under five, which are measured per county where TFR is not.
Warren and Tyagi's argument that two-earner households did not gain slack but lost it: the second income was bid into fixed commitments — above all housing in school-district competition — leaving families more exposed to a single job loss than one-earner families had been. It is the clearest published statement of the mechanism behind Outbidding the economy, with the bid capitalized into house prices. Its bankruptcy analysis centered on mortgage, medical and job-loss shocks; student debt figures far less prominently there than its later prominence would suggest, which is part of why Student loan non-dischargeability is tracked separately here. Warren and Tyagi (2003).
The concrete form Minimum description length takes here: total bits are the Parameter code plus the residual code, the latter being the bits to transmit each observed value given the model's predictive distribution at that cell's Instrument precision, $$L = L(\theta) + \sum_{\text{observed cells}} -\log_2\!\big(p(y \mid \theta)\,\delta y\big).$$ Both halves are real bits, so they are directly comparable and there is no tuning constant trading them off. See Observed-cell MDL. The split into a lawlike half and a noise half is not a bookkeeping convenience; Algorithmic statistics is what makes it a meaningful partition rather than an arbitrary one.
County-level student debt measures built by the Urban Institute from a credit-bureau panel: the share of consumer records holding student debt, median balance, median monthly payment, and share in collections. Added here to test whether debt carries information about family formation beyond income and education. Measured answer: it does not. The Panel version built on it is flat on the Margin over null and slightly worse on Held-out transition than the panel without it — four items at few time points, largely already carried by income and attainment. Retained in the panel; not doing work.
The rule for a derived source: run the same derivation on a period where the true answer is already published, and admit only the columns that reproduce it. Used when Connecticut's counties were rebuilt from towns — the aggregation was run on the 2016-2020 window, where the old-county values exist, and a column was allowed through only if the town-sum matched the published value to 0.5%. 635 of 676 cleared. Stronger than the Acceptance gate, which can only ask whether two series agree, because here the derivation has a known right answer.
It earned its place twice over. It caught the medians, which cannot be summed and which Census marks with large negative sentinels, so their town-sums came to −2.7 billion. Then the gate itself proved to be broken by a list misalignment that paired every column with another column's error, which had let median household income through at 3.77 million dollars for Fairfield. A verification step is code and fails like code: check that the gate rejects what it should.
The Census Bureau's compiled county data file, several thousand Items drawn from censuses, surveys and administrative sources, each column coded by item and year. The spine of this panel. Its quirks are load-bearing: column years are sometimes the quantity's Reference-year column rather than the census year, and its unit indicators cannot distinguish intensive from extensive quantities — see Intensive and extensive items.
The specific measured facts that license reading a cause(C) result as causal rather than as a correlation, recorded per model run and printed on every figure so the claim travels with its justification. Two components: the invariance verdict for the Developmental map across decade and state regimes, and the Skill on Held-out transitions. On the current model the Developmental map is invariant across all six decade regimes and the linear map across all 41 US-state regimes, with skill 0.59, 0.67 and 0.63 on the three sub-decade transitions. A figure whose warrant has degraded should be read as a weaker claim, not the same claim.