tracker

5.1 KB

1. # w059 — tracker#26: filmography titles complete
3. **Commit**: `25a50bc` on branch `t26` (worktree loreana:/media/STORAGE/projects/tracker-wt26, based on main 1704ec4). Not pushed, not merged, not deployed. main untouched.
5. ## What the filmography stored (vs a full import)
6. - `people.hl addMinimalTitle` (#16) stores title, year/release, overview, type, tmdbId, adult, genres, language, and only that one person as cast.
7. - It stores no poster, no seasons/episodes, no imdb/tvdb/tvmaze ids, no homepage/tagline/status and no `tmdbSync`. Nothing ever completed these records, so the page stayed that way.
8. - A search import (`importTitle` + `syncShow`) has all of that, but no cast either.
9. - The live copy has 321 such titles.
11. ## Built
12. - **`details.hl` `completeStep`**:
13. - Step 1 is one TMDB request: `/movie|tv/<id>?append_to_response=external_ids,credits|aggregate_credits`. It stores the fields and the cast (TMDB's first 20, adult people left out). People we don't have yet get a new person record (slug, search entry); their page fills on the first visit.
14. - A movie is complete after step 1 (ids + poster).
15. - A series then continues in steps through `tmdbsync.hl syncShowPart`: one step per ≤ 300 episodes of seasons, then a last step for ids, the TVmaze lookup + merge and the poster.
16. - `detailsAt` marks a title complete. `detailsCheck` marks TMDB 404 and adult titles, which are never asked again.
17. - **Show page** (`components/show.hl`): an incomplete title shows what it has plus shimmer skeletons (poster, cast line, 3 season rows for a series). An invisible probe calls the sessionless face `showComplete` step by step until it is done. The last answer replaces the skeletons without a reload.
18. - **Details repair** (`project.hl repairTick`):
19. - At start it queues every incomplete title that is not adult and does one step per clock tick.
20. - It paces itself with `pauseMsAfter` (TMDB ≤ 40 / 10 s, TVmaze ≤ 20 / 10 s) and runs only after the adult backfill and never during the daily sync.
21. - It resumes after a restart and retries passing failures up to 2 times.
22. - Env: `TRACKER_REPAIR` (default on), `TRACKER_REPAIR_LOG_EVERY`, `TRACKER_REPAIR_FAST` (gate only).
23. - New titles from a filmography get `minimal = true`.
24. - Adult titles are never completed: the public face refuses them and the repair skips them.
26. ## Gate
27. ```
28. TRACKER_GATE_SHOTS=/tmp/w059/shots TRACKER_GATE_PORT=8754 TRACKER_GATE_IDENT_PORT=8755 TRACKER_GATE_CHROME=8756-8758 TRACKER_GATE_TMDB_PORT=8759 node tests/browser.mjs
29. 231 passed, 0 failed
30. ```
31. - 214 → 231 checks. The new ones cover:
32. - artist page → click a new movie → skeleton → full page without a reload, one TMDB request;
33. - the series case in 4 steps;
34. - the new cast person's page and search entry;
35. - the repair: 82 titles, stopped after 6, resumes, 404s marked, adult title never asked, pages < 1.2 s meanwhile, a 3rd start has nothing to do.
36. - The offline home check now expects 6 series instead of 5, because Person Series has released episodes once it is completed.
38. ## Real data (copy of live `storage/`, real TMDB; copy deleted afterwards)
39. **Opening a title** (ms from the click):
40. - **Skeleton:** shown after 178–258 ms.
41. - **Movies:** complete after 642–712 ms.
42. - **Series:** complete after 1262–1361 ms.
43. - **Other requests meanwhile:** at most 586 ms.
44. - **Reload afterwards:** complete at once, 157–205 ms.
45. - **Biggest titles:** The Late Show (4,252 episodes) took 11.4 s in 23 steps, with other requests waiting at most 1.3 s.
47. **Repair**: 321/321 complete, 0 failed, +638 seasons, +16,528 episodes, 299 posters, 5,196 cast entries, 787 TMDB + 218 TVmaze requests, 507 s.
48. - Page latency meanwhile: median 0.13 s, p99 1.03 s, max 2.35 s.
49. - The next start logs "nothing to do".
50. - My first version did one title per step; the Late Show then blocked the server for 10.7 s. That is why series are now split into steps.
52. **Screenshots** (looked at), on Loreana:
53. - `/tmp/w059/real/`: `{movie,series}-{skeleton,complete,reload}-{390,1280}.png`, `repaired-*-{390,1280}.png`, `direct-*-1280.png`
54. - gate: `/tmp/w059/shots/{title,series}-skeleton-1280.png`
56. ## Merge notes for main (mission 014 (old 058) touches `components/show.hl`)
57. - **`components/show.hl`:** my changes are additive:
58. - 1 import;
59. - 2 statics (`completingOf`, `completedPageOf`, which calls `buildRows(show, null, cl)`);
60. - 4 members after `adultShow`;
61. - the View blocks (poster skeleton, cast skeleton, `showLoading`);
62. - the handler `completeTick`;
63. - the face `showComplete`.
64. - **`tmdbsync.hl`:** `syncMovie` gained a third parameter `pre`, and `syncShow` now calls `syncShowPart(id, null, null)`.
65. - **Gate:** new fixtures, startServer defaults (`TRACKER_REPAIR=0`, `TRACKER_DETAILS_PART_EPISODES=1`), and the #16 block's "added title" check is replaced by the #26 block.
66. - **Deploy:** on live the repair waits for the adult backfill (~80 min), then takes ~9 min.
68. ## Open points
69. 1. Merge and deploy.
70. 2. Search imports still have no cast.
71. 3. Titles added while the app runs are only completed when opened or at the next start.
72. 4. After a client-side click, the title page keeps the person page's scroll position (hl:web behaviour, not new).
74. ## Hybriel issues
75. None new.