Cloudflare replaced the fast lane's Durable Object during the 00:00 UTC run.
The alarm restarted on a new instance while the old one carried on posting,
and the old run's results were lost because it could no longer write to its
own storage. Like the old cron, a run now takes a lock in the private R2
bucket (which a replaced instance can still write), refreshes it every 10
seconds and deletes it at the end; a run that finds a fresh lock waits and
checks again in 15 seconds. A scheduled run that never saved its results is
recorded as cut off.
Each updater now reports whether its published file changed, in its log
line and in the run's results, to see when fresh data really arrives at the
top of the hour.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The Worker's lanes, RegionAuth renewals and direct archive writes replace
app/cron.mjs, warmCaches and DataArchiver, which only spectre used. Local
runs keep every updater, social, screenshot and archive tool; there is no
local scheduler, and local snapshots stay in storage/archive/.
ARCHIVE_DATA now has to be "true": any value, including the "false" in
.env.example, used to turn archiving on.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The four Splatfest regions all save into festivals.json. The lock only
covered reading and merging the file, so regions could write at once
(R2 rejects concurrent puts to one object) or read it before another
region's write landed and drop that region. The lock now covers the
whole save.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Both Workers and their Durable Objects are wrapped with @sentry/cloudflare, so the shared
code's @sentry/core calls (failed updaters, social posts, archive snapshots) reach Sentry.
A lane run that fails outright, a failed credential renewal and a failed archive compression
are reported too. Durable Object RPC methods use instrumentPrototypeMethods; without it they
run with no Sentry client and their events are dropped.
The Node runner and the compressor's container no longer use Sentry; @sentry/node is gone.
POST /sentry-test sends one test event from the updater Worker and one from a Durable Object.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The modes mostly chose which lane's updaters ran, which the lanes now decide. The fast
lane keeps one option, translations (quick runs at :00-:04 skip them); the slow lane has
none. Runs, slots and manual requests carry the option instead of a mode, and the admin
panel shows runs as quick or full, with an "Include translations" box for manual fast
runs. Slots and runs saved with a mode run with the defaults.
The Node runner follows the same cadence: npm run splatnet:quick is the fast lane without
translations, splatnet the fast lane, and splatnet:all both lanes. The unused disableXRank
and disableFestivalRankings settings are removed.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Each region's FestivalUpdater saves the combined festivals.json, so a run saves it several
times. A newer copy now replaces the held one instead of being added alongside it, so each
snapshot is held and uploaded once.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
With ARCHIVE_DATA set, the Worker writes each published data file to the
archive Space, at the same YYYY/MM/DD/<date>.<time>.<name>.json keys, ACL,
and content type as the Node uploader (DataArchiver):
- S3ArchiveStorage signs PUTs with aws4fetch, tries three times with
backoff, and stops early on errors that will not improve.
- A snapshot that cannot be written is a warning and a Sentry event, never
a failed update.
- The fast lane holds its snapshots until after social posts (even failed
ones) and then uploads the newest copy of each key, so a slow archive
bucket never delays a post. The slow lane uploads as it goes, to avoid
holding large X-Rank files in memory.
- Dev writes to its own Space (splatoon3ink-archive-test); production has
no archive settings until cutover. Daily compression is still to come.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
A small Vue + Tailwind app in workers/updater/admin, served by the updater
Worker on its own hostname (admin.splatoon3.ink, admin.dev.splatoon3.ink)
behind Cloudflare Access:
- Timeline: both lanes, credential renewals, and social posts on one time
axis, a filterable run list, run details with per-updater timings and
the run's own log lines, lane controls (run now, pause, scheduling),
credential renewal, and a combined text log.
- Social: the post log with errors, per-account posting switches, when
each status last went to each account, and a preview that can post one
status by hand after a confirmation.
- Data: freshness of the core data files, the published file list, a
check that the site serves the new data, and a cache purge.
Worker side:
- src/admin: the Access JWT check (jose; fails closed and only answers on
ADMIN_HOSTNAME) and the API. Actions must be same-origin JSON POSTs, and
the app is served with a strict CSP from the ADMIN_ASSETS binding.
- Runs capture their console output (AsyncLocalStorage), so log lines
belong to the run that printed them. The Scheduler keeps a post log and
serves run details and log lines; RegionAuth keeps its last 24 renewals.
- A manual run from the panel only posts to social when asked to.
Shared code:
- StatusGeneratorManager records what was posted or failed, and skips
accounts turned off in private settings/social.json (the Node runner
honours this too). app/social/admin.mjs previews and posts one status.
- Updater results include their duration.
Also: npm run admin:dev runs the panel against a simulated API, deploy
scripts build the panel first, the dev environment's assets move to
dev-assets.splatoon3.ink, and the lockfile drops entries nothing depends
on any more.
Not yet run against a deployed Worker or a real Access application.
Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
Durable Object alarms are stopped after 15 minutes, and a full X-Rank or
Splatfest rankings update can take longer than that:
- RunLimits takes an optional deadline. X-Rank season details, Splatfest
rankings, and the slow lane's updater loop stop starting new work once
it passes and mark the run incomplete; what is left updates in a later
run. The current X-Rank season goes first.
- The slow lane runs with a 10-minute budget. An incomplete run is
followed a minute later by a continuation (up to 10, never past the
lane's next regular slot), which does not count as a retry. Manual runs
continue the same way through a queued follow-up.
- Ignore Wrangler's local secrets files (.dev.vars*).
Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
Run the shared app/ updaters and social posters from workers/updater:
- Scheduler Durable Object lanes: "fast" keeps the Node cron cadence
(quick at :00-:04, default at :05/:10/:15/:20/:30/:45) and posts to
social after checking SITE_URL serves the new data; "slow" runs X-Rank,
Splatfest rankings, and avatar updates hourly. Bounded retries, queued
manual runs, pause, and persisted automatic-scheduling state.
- RegionAuth Durable Object per region: the single owner of each
Nintendo login, serving bullet tokens to both lanes and renewing them
hourly at :35-:38.
- A five-minute cron watchdog that only re-arms alarms, bearer-token
control endpoints, and dev/production environments. DO migrations keep
Scheduler at v1 to match the earlier dev deployment.
- Per-run limits (RunLimits) and per-account NsoClient locks instead of
module-level limiters, since Durable Objects sharing an isolate cannot
share in-flight requests. Updaters without localization rules no longer
rewrite locale files.
- 20 workerd tests (npm run updater:test, included in npm test) with all
network access blocked.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Replace the remaining Node-only dependencies so the updaters and social
posters bundle and run in workerd, while the Node runner keeps working:
- Replace nxapi with app/splatnet/coral.mjs (fetch + WebCrypto), aligned
with nxapi 1.6.1-next.257: znca compatibility 3.5.0, the current client
version, and the slimmer Login parameter. Use one znca-api client per
Nintendo account, since its token binds to the first account it serves.
Cache the remote config in private storage instead of restarting daily.
Sessions cached by the nxapi package trigger a fresh login.
- Convert images through #image-converter: sharp in Node, the Images
binding in Workers. Read Bluesky aspect ratios from the PNG header.
- Replace twitter-api-v2 with OAuth 1.0a signed fetch; TwitterClient now
only updates the seasonal X profile (posts go through Buffer).
- Load avatars through #avatars (bundled as Data modules in Workers) and
keep the local Chrome driver out of Worker bundles via
#local-screenshot-driver.
- prefixedConsole forwards to the global console; shared code reports to
Sentry through @sentry/core.
Verified live: full credential refresh for all four regions in Node, and
the complete Coral → bullet token → GraphQL chain for EU inside workerd.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Prepare the shared updater and social code to run against R2 in a Worker
while keeping the local Node runner working:
- Add app/common/storage with public, private, and archive areas keyed like
the R2 objects. FilesystemStorage maps them onto dist/ and storage/ for
Node; BucketStorage wraps R2 bindings. Storage is configured once per
process; only image existence is cached, so JSON reads are always fresh.
- Move ValueCache, DataUpdater (data, calendars, archive snapshots),
ImageProcessor, LocalizationProcessor, festival updaters, status
generators, social translations, ImageWriter, and Buffer/Threads image
hosting onto storage. Query hashes are a JSON import.
- Add app/splatnet/auth.mjs: the existing bullet-token code behind auth(),
so the Worker can route token requests to per-region Durable Objects.
warmCaches uses auth().refresh().
- Remove the S3/R2 sync, vfs, the dual upload, the sync commands, and
s3-sync-client. Local runs no longer read from or write to remote buckets.
- Give every test fresh in-memory storage via app/test/setup.mjs.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Groundwork for running the existing updaters and social posters in a Worker:
- Derive IDs with @noble/hashes shake256; the Workers runtime's node:crypto
lacks shake256. A test pins an ID produced by node:crypto.
- Split updaters into fast (schedules, gear, co-op, festivals, stages; run
concurrently) and slow (X-Rank, Splatfest rankings; run one at a time).
The cron posts after the fast updaters, before the slow ones.
- Fetch X-Rank seasons and detail types sequentially, cutting peak heap per
division from ~85 MB to ~38 MB.
- Move Splatfest rankings into FestivalRankingsUpdater, driven by the
published festivals data, so results never wait on ranking pagination.
- Coalesce concurrent downloads of the same SplatNet image.
- Bring over the Browser-binding screenshot work from develop (f7293b6):
Cloudflare captures use the BROWSER binding with retries, Browserless is
removed, and workers/screenshots offers capture-only local testing. The
local driver keeps puppeteer-core with an installed Chrome, always serves
dist/, and fails on page-reported screenshot errors.
- Remove the Docker image, compose files, and GHCR deploy workflow.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
No major calendar client renders these inline binary attachments.
The ATTACH URL is kept, which links to the publicly hosted image.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
exists() and olderThan() now check the local filesystem first and only
consult the VFS as a fallback. This means freshly written files are
found naturally without callers needing to register them.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Uses S3 ListObjectsV2 to build an in-memory file listing at startup,
allowing exists() and olderThan() to resolve from the listing instead
of requiring files on disk. sync:download now skips assets/splatnet/,
data/xrank/, data/festivals.ranking.*, and status-screenshots/.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
cron v4: No code changes needed (positional constructor args still supported).
ical-generator v10: Removed `new` keyword (now a factory function) and
switched from `attachments` property to `createAttachment()` method.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
jsonpath v1.2.1 (published Feb 2025) fixed the security vulnerability
that prompted the switch to jsonpath-plus. Reverting to the original
package simplifies the code by removing the jsonpathQuery/jsonpathApply
wrapper functions.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Added mkdirp() helper to app/common/fs.mjs that wraps
fs.mkdir(dir, { recursive: true }). Updated all call sites to use it.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Replace silent error handling with descriptive messages: log
HTTP status in i18n locale loading, log response details in
data store fetch, and warn on unexpected localization file
read errors.
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Use strict equality in TricolorBox, add async keyword to
CoopUpdater/GearUpdater getData() for consistency, and add
missing HMR accept for useCoopGearStore.
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>