tracker

6.9 KB

1. # Report 066 — tracker#19: franchises and timelines
3. **Commit**: `0553b51` on branch `t19` (worktree loreana:/media/STORAGE/projects/tracker-wt19, from fa1f9df). Not pushed, not merged, not deployed. main was not touched.
5. ## Built
6. - Tables `franchises.db`, `timelines.db` and `collectionchecks.db` (`franchises.hl`). A title can be in several timelines; an in-memory show → timelines map is built at boot.
7. - `/franchises` lists the franchises, then the timelines that have no franchise.
8. - `/franchises/<slug>` is the franchise index. Each timeline in it has its own toggle: Timeline (in-world order) or Release. For a series, Release uses the date of its last released episode.
9. - `/timelines/<slug>` shows one timeline with its franchise above it.
10. - Widget `‹ Prequel | Timeline | Sequel ›` on movie and series pages, one per timeline, with the franchise above it linking to the index. An end with no title is greyed out.
11. - Editor for the creator only (`TRACKER_EDITORS`, default `az5b2`; every editing face checks it again on the server):
12. - `/franchises/edit`: create a franchise or a timeline, find a timeline.
13. - `/timelines/<slug>/edit`: franchise chips to attach the timeline, rows with ↑ ↓ ✕, and "Add titles" (search of our DB).
14. - TMDB collection seed running inside the app:
15. - Own clock, one movie per step, 260 ms per request.
16. - Waits while the daily sync or the adult backfill runs.
17. - Resumes after a restart; adult titles are skipped.
18. - When a collection is fetched, all its parts that we have are marked checked, so their own details requests are never made.
19. - Decisions:
20. - A collection becomes a timeline only if it has at least 2 of our non-adult movies.
21. - Seeded timelines get no franchise.
22. - Public pages skip titles whose adult flag is not `false`; the editor shows all titles.
24. ## Files touched (merge notes)
25. | File | Change |
26. |---|---|
27. | `components/show.hl` | 1 import, 1 static, 1 member, 1 View line before `showSeasons` |
28. | `project.hl` | 5 imports; 5 routes after `/genre/:genre`; `franchisesReady` at boot; the seed clock block before `on Error` |
29. | `styles.hl` | one new section before "/ (tracker.worldapi.org#13)" and 2 lines in the media block |
30. | `tests/browser.mjs` | `TRACKER_COLLECTIONS: '0'` in `startServer` |
31. | `tests/faketmdb.mjs` | `collections` option, `belongs_to_collection`, `at` on recorded requests |
32. | `README.md`, `STATUS.md` | new section / entry at the top |
34. New files:
35. - `franchises.hl`
36. - `components/franchises.hl`, `components/franchise.hl`, `components/franchisewidget.hl`, `components/franchiseedit.hl`, `components/timelineedit.hl`
37. - `tests/franchises.mjs`, `tests/seed-franchises.hl`, `tests/realdata-066.mjs`
38. - `docs/franchises.md`
40. ## Gates
41. ```
42. TRACKER_GATE_SHOTS=/tmp/w066/shots TRACKER_GATE_PORT=8732 TRACKER_GATE_IDENT_PORT=8733 TRACKER_GATE_CHROME=8734-8736 TRACKER_GATE_TMDB_PORT=8737 node tests/franchises.mjs
43. 48 passed, 0 failed
44. TRACKER_GATE_SHOTS=/tmp/w066/main-shots TRACKER_GATE_PORT=8732 TRACKER_GATE_IDENT_PORT=8733 TRACKER_GATE_CHROME=8734-8736 TRACKER_GATE_TMDB_PORT=8737 node tests/browser.mjs
45. 266 passed, 0 failed
46. ```
48. The franchise gate (`tests/franchises.mjs`) covers:
49. - **Seed from fake collections**: parts come back in release order; parts we don't have and adult parts are left out; a collection with one of our movies gives no timeline; a TMDB 404 and "no collection" are remembered.
50. - **Resume**: stopped mid-run and restarted, no movie is asked twice and each collection is asked once.
51. - **Pacing**: any 3 requests in a row span at least 500 ms.
52. - **Widget**: previous/next links, greyed ends, a client-side Sequel click, the franchise above, two widgets for a title in two timelines.
53. - **Index**: sorts both ways; a series is placed by its last released episode, not its 2099 episode or its year.
54. - **Editor access**: signed out and a second user (bob) see the refusal; the creator can create, attach, add, move and remove.
55. - **Layout**: no sideways scroll at 390 and 1280 px.
57. ## Real data (copy of Byrodin `storage/`, ~22:47, port 8738, real TMDB)
58. - **Seed**:
59. - Checked 4,774 movies in 2,459 s (about 41 min) with 4,957 TMDB requests.
60. - Result: **110 timelines with 272 titles**.
61. - Of the rest, 235 collections had fewer than 2 of our movies and 4,143 movies had no collection.
62. - 124 TMDB 404s, 0 retries; slowest step 860 ms.
63. - **Page times during the seed** (curl, 40 runs each):
65. | Page | Average |
66. |---|---|
67. | `/` | 0.08 s (one 2.2 s outlier) |
68. | `/movies` | 0.01 s |
69. | `/shows/Foundation` | 0.18 s |
70. | `/franchises` | 0.11 s |
72. - **Star Wars and Alien could not be used**: our data has no Star Wars or Alien movies, only series. I checked these collections instead:
73. - Star Trek: The Next Generation (4 titles)
74. - Harry Potter (7)
75. - Lord of the Rings (3)
76. - In all three the order is right and the widget on the middle title is right, e.g. Star Trek: First Contact shows ‹ Generations | TNG Collection | Insurrection ›.
77. - **Full page loads**:
78. - `/franchises`: 74–109 ms (83 KB, 110 timelines)
79. - timeline pages: 49–213 ms
80. - movie pages with the widget: 403–464 ms. With curl that is 0.38 s against 0.34 s for a movie with no timeline, so the widget adds about 40 ms.
81. - Signed in as the creator (az5b2), the Edit link and the editor forms are there. 0 console problems.
82. - Copy, sessions and the `.env` symlink were removed and the server stopped. My ports 8732–8739 are free.
84. ## Screenshots (all looked at, on Loreana)
85. - Gate: `/tmp/w066/shots/{franchises,franchise,timeline,widget-aliens,widget-movie,franchise-edit,timeline-edit,timeline-edit-reload}-{390,1280}.png`
86. - Real data: `/tmp/w066/real/{franchises,timeline-*,widget-*,franchise-edit-creator,timeline-edit-creator}-{390,1280}.png`
88. ## Open points
89. 1. **Deploy**: the first start runs the seed for about 40 min, after the adult backfill.
90. 2. **Not built**: renaming or deleting franchises and timelines, editing a franchise's summary, and the franchise `shortId` (the field stays null).
91. 3. **Seed gaps**: a later run does not add new parts to a collection that already has a timeline. Titles imported later are not seeded unless their row in `collectionchecks.db` is removed.
92. 4. **Widget position**: on a phone it comes after the cast; the creator may want it higher.
93. 5. **Duplicate name**: a timeline page shows its name twice (the page title and the block heading).
94. 6. **Pattern kill**: early on I ran one `pkill -f 'hybriel project.hl'` on Loreana to stop my smoke server. That pattern could have hit another worker's tracker server if one was running at that moment. When I checked right afterwards none was; after that I only killed by PID.
95. 7. **`.env` for the real run**: the worktree has no `.env`, so for the real-data run I symlinked `../tracker.worldapi.org/.env` (I never read it) and removed the link afterwards.
97. ## Hybriel
98. No new issues. Workarounds used:
99. - A hand-written `posOf` instead of list `indexOf`.
100. - One flat row list instead of a nested `for` (hybriel#86).
101. - No member reads both a route parameter and `session` (#121/#122).