← backoffice

Library ingest

Pre-populate the catalog with authors, works, editions, descriptions, covers, and affiliate links from Open Library, Wikidata, Wikipedia, and Google Books.

Ranking & sweep

Build the priority ranking of fiction authors (popularity × prolificacy, with a living-author boost), then sweep it — running the full pipeline per author, highest score first. The sweep is continuous and resumable. While it runs, the controls below lock to prevent a conflicting run; use Stop sweep to pause it.

Loading sweep status…
Loading ranking…

Catalog

Loading…

Recent runs

# Source Kind Status Started Finished Stats Actions
Loading…

Smoke test — one author, full chain

Debug harness: fetch + import a single author, walk their works + editions, enrich author + each work via Wikidata, gap-fill descriptions from Google Books, mint affiliate listings, download assets. Use for one-off testing — the continuous sweep above does this for the whole ranked queue. Locked while a sweep is running.

Steps

Run individual steps for debugging or spot operations.

Fetch author

Pull one OL author JSON → ingest_raw.

Import author

Parse staged author → write contributor + author + user stub.

Fetch work

Pull one OL work JSON.

Import work

Map + write series + book + child rows. Author must exist.

Fetch edition

Pull one OL edition JSON.

Import edition

Map + write product under parent work.

Enrich author

Wikidata + Wikipedia → bio, awards, gender, social, education, employment.

Enrich work

Wikidata → form, awards, P179 series upgrade.

Batch enrich

Sweep every row with a Q-ID. Cooperative stop honored.

Crosswalk OL → Wikidata

SPARQL P648 reverse lookup. Run before batch enrich.

Google Books gap-fill

Descriptions + covers for ISBN-bearing products with missing data.

Mint affiliate listings

Amazon + Bookshop product_listings rows for every ISBN-bearing product.

Download assets

Fetch covers + headshots, normalize to WebP at nvllst standards, write under reader/data/.

Inspect

Raw payload

View the JSON we cached from a source.

Materialized contributor

What the catalog actually holds for an OL author.