STEP 2204 — arxiv-fetcher withdrawal detection (Feature 2)

2026-09-23 · rei-aios-59 · 6 items sequential #1 · STEP 2203 の defer Feature 2 実装

Summary: STEP 2203 で defer した Feature 2 (fresh paper withdrawal detection in arxiv-fetcher.ts) 実装。 STEP 2203 Feature 3 (refresh-watchlist.ts) の補完 = 定期 re-check の fetch-time secondary defense、新着でいきなり撤回状態の論文を検出。

Implementation

File: scripts/research-radar/arxiv-fetcher.ts (+64 line、 185 → 249 line)

ArxivEntry に withdrawn?: boolean + withdrawalSignature?: string field 追加
WITHDRAWAL_SIGNATURES const (4 regex、 refresh-watchlist.ts と同一)
detectWithdrawalInHtml() + extractCanonicalArxivId() + sleep() helper
Main flow: recent.slice(0, 30) から updated !== published heuristic 対象絞り込み → 各 HTTP fetch abstract page + regex check → withdrawn 検出時 mark + log
Top-N display: ⚠ WITHDRAWN marker 追加

Defense-in-depth (STEP 2203 Feature 3 との関係)

Layer	Timing	Coverage
STEP 2204 (Feature 2)	Fetch-time	新着でいきなり withdrawn state (Niu v1→v2 型)
STEP 2203 (Feature 3)	Periodic (手動 or cron)	既載 papers の後発 withdrawal (Niu 4 か月後 catch 型)
STEP 2203 (Feature 1)	Scoring-time	Registry marker 表示 (already withdrawn の誤 flag 予防)

Honest scope

fm-code-duplication-detect-withdrawal: 4-signature regex が refresh-watchlist.ts と arxiv-fetcher.ts で重複、未来 shared helper 抽出 candidate
Heuristic false-negative risk: updated === published papers は検出対象外 (rare case、 Feature 3 で遅延 catch)
Rate-limit budget: max 30 candidates × 3s = 1.5 min 追加、 fetcher 通算 1.5-2 min
Fail-open behavior: HTTP error は entry.withdrawn 未 mark、 fetcher 全体 crash なし
radar-{date}.md 反映: 未対応 (Item #2 STEP 2205 で対応予定)
Test not run in-session: 次回 daily-radar 稼働時実効 verify

Backlinks

Home Hub · tools index · Memory Mirror
STEP 2203 (Radar audit-aware + Feature 3 refresh-watchlist) — 前 STEP
Attribution: [via 藤本さん explicit go 「順番にお願い致します」 6 items sequential #1 / execute: rei-aios-59]

Implementation

Defense-in-depth (STEP 2203 Feature 3 との 関係)

Honest scope

Backlinks

Defense-in-depth (STEP 2203 Feature 3 との関係)