Finite two-block entropy repair #
A point-mass bound on a joint source gives a nearby block source by replacing small rows with uniform rows of the same mass. This preserves the first marginal exactly. Conditional caps are stated without division by the row mass, so they apply to zero-mass rows as well. Row averaging retains the original joint point-mass cap, allowing the repair to feed later splitting steps at the same input threshold.
The power-of-two corollary is a finite marginal-preserving version of Chattopadhyay--Goodman--Liao, Lemma 5.3 of Affine Extractors for Almost Logarithmic Entropy, https://eccc.weizmann.ac.il/report/2021/075/, which attributes the splitting lemma to Goldreich--Wigderson (1997). The explicit repair and the sharper bound by the mass of the replaced rows are proved here. This module concerns probability weights; a recursive extractor and its seed-reuse argument require further results.
Row averaging preserves any original joint cap, without probability, nonnegativity, or nonempty-alphabet assumptions.
The repaired weights remain a probability distribution.
Every repaired row satisfies the conditional cap, including rows of mass zero.
The original joint point cap also controls the unchanged first marginal.
The repair costs at most the total mass of the rows it replaces.
Repair a joint source into a two-block source with threshold K,
preserving its first marginal and paying at most card α*K*μ in distance.
For equal m-bit alphabets, joint entropy at least m+t+e can be
repaired to two blocks of entropy at least t with error at most 2^(-e).
The explicit power-of-two repair also retains the original joint cap, while producing two blocks at the smaller threshold and preserving their first marginal.