Refined predictive validity claim positive re-confirmation — access_log +43.20%、 csv_metrics +30.56% vs gzip、 n=1 → n=3 positive support 昇格
STEP 1870 で refined predictive validity claim (v0.3 YES + ASCII-numeric field 両方 必要) を n=1 positive (structured_log の み) で land した 状態 を n≥2 に 昇格 する v0.4 送り 11 実施。 2 新規 domain (access_log_apache Combined + csv_metrics) 生成 (deterministic PRNG seed 20260907)、 dedicated schema-aware compressor 実装。 実測: access_log +43.20% vs gzip、 csv_metrics +30.56% vs gzip、 両方 30% threshold met。 n=1 → n=3 positive support 昇格、 arc 「refined + n=3 in-scope positive + n=4 out-of-scope negative + 7/7 consistent」 完成。 8/8 test PASS。
1. 実測 (2 新規 domain vs baselines)
| domain | 原文 | gzip -9 | brotli -q11 | dedicated | vs gzip | vs brotli |
|---|---|---|---|---|---|---|
| access_log_apache | 1,211,866 | 182,700 | 19,615 | 103,774 | +43.20% ★ | -429% |
| csv_metrics | 463,835 | 114,230 | 77,535 | 79,323 | +30.56% ★ | -2.31% |
両 domain gzip 30% threshold met = refined predictive validity claim n=1 → n=3 positive 昇格。
2. Evidence stack (STEP 1867 → 1871 累積、 7/7 consistent)
| STEP | domain | v0.3 | ASCII-numeric | dedicated vs gzip | claim consistency |
|---|---|---|---|---|---|
| 1867 | structured_log | YES | YES (timestamp/req_id/latency) | +40.4% | ✓ positive |
| 1870 | markdown_proxy | YES | no (prose) | +1.8% | ✓ negative |
| 1870 | esperanto_wikipedia | YES | no (prose) | +0.3% | ✓ negative |
| 1870 | voynich_eva | YES | no (unknown) | +0.2% | ✓ negative |
| 1870 | dna_ncbi | no | no | +3.9% | ✓ negative |
| 1871 | access_log_apache | YES | YES (IP/timestamp/status/size) | +43.2% | ✓ positive |
| 1871 | csv_metrics | YES | YES (id/timestamp/user/duration) | +30.6% | ✓ positive |
Predictive validity accuracy: 7/7 consistent with refined claim (3 positive + 4 negative)。 arc として 「refined + n=3 in-scope positive + n=4 out-of-scope negative」 完全 characterization。
3. Nuance / honest scope
Dedicated vs gzip: 3/3 positive ✓
- structured_log 40.4% (STEP 1867)
- access_log_apache 43.2% (本 STEP)
- csv_metrics 30.6% (本 STEP)
Dedicated vs brotli-q11: 1/3 positive
- structured_log dedicated 94,210 < brotli 135,493 (dedicated +30.5% vs brotli)
- access_log dedicated 103,774 > brotli 19,615 (brotli の dominant win 43×)
- csv_metrics dedicated 79,323 > brotli 77,535 (brotli slight win)
Explanation: brotli has huge built-in dictionary of common English/HTML tokens。 access_log の user_agent + referer strings 大部分 が web-common vocabulary → brotli 内蔵 dict が 43× dominance。 structured_log の req_ids (random hex) は brotli dict に 含まれない → dedicated が brotli も beat する。 refined claim primary criterion は 「gzip beat 30%+」、 brotli comparison は secondary + domain の web-common content 度合い 依存。
Additional honest scope
- Synthetic corpora (deterministic PRNG seed 20260907)、 real-world Apache access log で は distribution 変わる 可能性
- csv_metrics header は 1 行 raw UTF-8、 header 圧縮 は 別 concern
- Round-trip lossless 保証 = byte identity (8/8 test PASS)
- Referer/UA dict は corpus 学習 (7 referers + 6 UAs)
- Access log は 1 date fixed (07/Sep/2026)、 multi-date は format upgrade 必要
- novelty 主張 なし: schema-aware compression は well-known (Apache Avro / Protobuf / Cap'n Proto 変形)、 本 STEP は refined claim の positive support 拡張
4. Refined predictive validity claim (完全 characterization、 STEP 1863 → 1871)
Statement: v0.3 signature が 40%+ 圧縮 improvement を 予測 する には (a) v0.3 YES + (b) explicit ASCII-encoded structured fields (timestamps / IPs / IDs / numeric measurements / status codes) の 両方 必要 = necessary but not sufficient。
Evidence stack: 7 domain の 7/7 全て が refined claim と consistent (3 positive in-scope + 4 negative out-of-scope)。
5. STEP 1848 pattern 11 段階目 完成
| STEP | イベント |
|---|---|
| 1848 → 1862 | bug + corrigendum + 崩壊 + 方向反転 |
| 1863 | anchor 拡張 (n=5) で p=0.020 統計的 validated |
| 1867 | schema-aware で structured_log 40.4% win (n=1 positive) |
| 1868 | generic word-dict 反証 (scope refine) |
| 1869 | Voynich prototype negative (NOT decoding) |
| 1870 | 内部 mechanism 分解 = fixed-width binary field encoding 決定的 |
| 1871 | refined claim positive re-confirmation n=1 → n=3、 arc 「refined + n≥2 positive support」 昇格 |
11 段階 arc で predictive validity の 完全 characterization + positive evidence 拡張 完成。 「勝ち evidence → scope refine → mechanism 分解 → refined claim の positive re-confirmation」 discipline pattern 完全 実装。
6. v0.4 送り update
- (1) positive class 拡張 ✅ 完了 (STEP 1863)
- (7) implication reversal ✅ 完了 (STEP 1868)
- (9) dedicated schema 一般化 test ✅ 完了 (STEP 1870、 negative decisive)
- (11) refined claim positive re-confirmation ✅ 完了 (本 STEP、 n=1 → n=3 昇格)
- 残: (2) held-out CV / (3) continuous score / (4) 30+ domain / (5) cmix binary / (6) english_baseline 差替 / (8) Huffman word-dict v0.2 / (10) Voynich section-conditional Huffman
7. 関連 STEP
8. 詳細参照
- Sample gen:
scripts/domain-family/generate-access-log-and-csv.ts(seed 20260907) - Compressor:
scripts/domain-family/dedicated-schema-compressors.ts(~350 行) - Test:
test/step1871-dedicated-schema-compressors-test.ts(8/8 PASS) - Report: dedicated-schema-reconfirm-report.json
- Notepad: 2026-09-07T05-45 STEP 1871
- Fragment: notes/steps/STEP_1871.md
- ← Tools index に 戻る