5.2 KiB
5.2 KiB
Bugs found and fixed (bug hunt log)
One line per bug: date, symptom, cause, fix commit, how it was proven. Open items at the end. Started 4 October 2026,
20:20 BST, after two were found by hand half an hour late (three job watchers that never fired, 096b99e; a failed
shard run reported as exit 0, 7a7e873).
| Date | Symptom | Cause | Fix | Proven by |
|---|---|---|---|---|
| 4 Oct 2026 | Every ci run on master red since 67bf226 (eleven pushes), unnoticed |
sim/difficulty/records/testnet-v2-2026-10-04.schedule.log carried a home path; .log was outside the identity scrub's extension list in tools/ci/identity-check.sh (and in the mirror's tools/sync.sh) |
2996cca: .log scrubbed like the other text files; the record rewritten with ~; the same list in igneum-public tools/sync.sh (local commit e18256d, not pushed) |
bash tools/ci/identity-check.sh 0 hits locally; run 37226816xxx on master green |
| 4 Oct 2026 | collect-pc1-board3 printed PowerShell parse errors (.Name, .AdapterRAM) |
the publishing shell expanded $_ inside double quotes to nothing before the command reached the jobs file; nothing to do with Format-List or Out-String (board2 and board4 printed their values) |
publish-jobs.sh refuses a collect command that pipes into a script block without $_ or $PSItem |
the eaten form refused with the reason, the single-quoted form published to a test folder |
| 4 Oct 2026 | the same job reported done (exit 0) over command exit Some(1) |
run_collect in app/igneum-app/src/jobrun.rs builds Done from the upload count only; the command's exit code is logged and dropped |
branch bugfix-collect-exit, 3c36ee4 (app engine; merge by the main session) |
cargo test --bin igneum-app collect_outcome: the board3 shape (Some(1)) is failed exit 1, Some(0) done, cap timeout, failed uploads still fail |
| 4 Oct 2026 | publish-jobs.sh --deploy said "not reachable, differs from the local one, or does not verify yet" after a deploy that had succeeded |
one check the instant the CLI returned, while the edge still served the previous file; the deploy's own exit status was hidden by || true |
verify_live: up to --tries (12) checks 5 s apart, each failure names its condition; publish-jobs.sh verify re-checks on its own; a failed deploy stops before the check |
finished: verify --tries 2 against the live file (try 1 of 2); failed: a local server with an older file ("differs", both publish stamps named) and a closed port ("is not reachable") |
| 4 Oct 2026 | console Machines: PC 37ba0461 showed 0.0 MH/s and 0 accepted while its log held an accepted block at 1 MH/s | parseLabel in the console API knew nvidia, amd, mac, metal and opencl; the OpenCL fallback on an iGPU is labelled other-<id8>-n and the card was dropped |
parsers moved to relay/lib/parse.mjs, vendors other and intel added, node --test relay/test/parse.test.mjs in CI |
the test; the live console after the deploy shows the card |
| 4 Oct 2026 | console Machines: a card said "117.2 MH/s now" while its "status" column said 4 m ago (PC 2 during shard run 3: the prover held the GPU and the worker's STATUS line stopped) | the card's hash came from the last STATUS line in the tail with no age check; the machine total summed it | markStale: a card whose STATUS line is older than 120 s is stale, shown as "last N MH/s" with a red "stale" mark, and left out of the machine total (API, page and tools/console.mjs) |
the test (58 s fresh, 240 s stale, none stale); the live console after the deploy |
| 4 Oct 2026 | vercel env add from site/ fails with "Could not retrieve Project Settings" |
site/.vercel/project.json links the [other-business] team's igneum project; the live site (igneum.network, igneum.com, the GitHub integration) is the igneum team's project of the same name, which the igneum login reads and the [other-business] link does not |
documented in packaging/README-ship.md (link, env ls, env add, deploy); no env set |
env ls from a scratch link to the igneum-team project lists the two names; a branch push produced igneum-git-<branch> |
| 4 Oct 2026 | tools/jobs.mjs and publish-jobs.sh print the downloads-folder token inside URLs on every run (X24 pattern) |
the tokened base URL is echoed as is | the token masked as <token> in every printed URL |
by eye, this log's own transcript |
Open
- Sam's Mac (3a9bf309): CLOSED 19:15 UTC, the app came back on 0.3.3 and mines (11.4 MH/s): it was stopped by its user for 4.5 h. What stays: the last node upload (14:47:02 UTC) ends with
SIGTERM - shutting downandigneumd has stopped, the miner upload stops at 14:46:56, nothing after: a clean app-driven stop (quit or Stop), not a crash and not a network loss (the stop lines reached the intake). Its app predates the app-log upload (app ?on the console), so there is no app stream to say which. The app posts nothing on a clean quit, so the console shows "silent 4h" for a machine that was stopped on purpose. Proposed: one[ok] app quit by the userline uploaded before the engine stops, and the console card saying "stopped (quit) at 14:47" instead of "silent". collectjobs: the Format-List / Out-String loss did not reproduce (board2 printedSum, board4 printedCapacityandSpeed); only the$_case failed. Closed unless it shows again.