gitoriaLog in with ident

tracker

All repositories: gitoria

ReadmeCodePull requestsReleasesTicketsSettings
Commit96ba683a96ba683adeploy.sh: a gate without a 'passed,' line (check-theme) no longer ends the scriptmre96ba683a/reports/012-tracker-final-merge.md

5.0 KB

  1. # w056: tracker, #16 merged, 3 fixes, Hybriel master (mission 012 (old 056))
  2. The work is in loreana:/media/STORAGE/projects/tracker.worldapi.org, on main. Nothing was pushed and nothing was deployed.
  3. **Commits**
  4. - `2c53d5e`: merges t16-person into main.
  5. - All conflicts only added code on both sides, so both sides were kept.
  6. - The filmography now lists only public titles (`isPublicTitle`, which means `adult == false`) whose TMDB credit is not adult either.
  7. - The worktree tracker-wt16 and the branch are removed. Their `.scratch/w055` notes were moved to `.scratch/w055-wt16`.
  8. - `2b7fdd6`: the header fix and the backfill fix.
  9. - Signed out on a phone, the header is now one row. The buttons do not wrap their text, and the phone shows "Log in" ("Log in with ident" from 40rem up). It is 46 px high at 320 and 390 px (it was 73 px).
  10. - The backfill no longer downloads the posters of adult titles. Their flag and ids are still stored.
  11. - `f40c250`: the new Hybriel and the hidden adult show page.
  12. - Hybriel master is re-vendored.
  13. - The page of an adult title says "Not found" to everyone who does not follow it.
  14. - Two flaky gate checks are fixed.
  15. - `f2fe3e3`: README, STATUS, `tests/realdata-056.mjs` and `tools/check-public-slugs.hl`.
  16. **Gate**
  17. `TRACKER_GATE_SHOTS=/tmp/w056/shots TRACKER_GATE_PORT=8720 TRACKER_GATE_IDENT_PORT=8721 TRACKER_GATE_CHROME=8722-8726 TRACKER_GATE_TMDB_PORT=8727 node tests/browser.mjs`
  18. - Last line: **`208 passed, 0 failed`**. That is 203 after the merge plus 5 new checks.
  19. - I made two gate fixes:
  20. - The backfill's "start" line is written at the first clock tick, which comes after the server's first answer. The check now waits for that line; without the wait it failed every time after the merge.
  21. - The tab now goes to about:blank before each server stop. Without that, websocket reconnect errors sometimes failed the console check.
  22. - I proved two of the new checks catch the bug they are for:
  23. - With the old poster download put back, the poster check fails.
  24. - With the old Hybriel binary, the "Unfollow hides the page" check fails.
  25. **Hybriel**
  26. - Master **8590df63** (it includes 73267707 / #122 and #121 426944c7). Built read-only, ReleaseFast, sha256 `ca830ef8…`.
  27. - The old copy is in `.scratch/pre-056/`.
  28. - Duplicate @ids in the live copy: 0 in all 8 tables.
  29. - No workaround was removed. The SVG check was already in the gate.
  30. **Hiding the adult show page: it works now**
  31. - Why mission 010 (old 054)'s attempt failed: `collapsed` (which seasons are open, kept in the browser) was derived from the session-dependent `found`.
  32. - After every session face, the server re-derived it from the page's starting state. The seasons snapped back and the second click did nothing.
  33. - Now `collapsed` comes from the slug only. `showRow` itself is null when the page is hidden, because every member is sent to the browser.
  34. - What a user sees:
  35. - A follower sees the page.
  36. - If the follower unfollows on the page, it changes to "Not found" at once.
  37. - No minimal repro for Anton was needed.
  38. **Real data** (copy of the live `storage/`, one tar, real TMDB, the backfill run on the copy; the copy was deleted afterwards)
  39. | | |
  40. |---|---|
  41. | Backfill | 78 min: adult 3,450, not adult 5,866, unknown 137 |
  42. | Posters | **5,433 downloaded (was 8,740), 269 MB (was 459 MB)** |
  43. Full page loads in ms, at 390 / 1280 px:
  44. | page | 390 | 1280 |
  45. |---|---|---|
  46. | `/` | 426 | 91 |
  47. | `/movies` | 92 | 90 |
  48. | `/movies/page/2` | 93 | 37 |
  49. | `/shows` | 287 | 41 |
  50. | `/shows/page/2` | 92 | 42 |
  51. | `/search/the` | 336 | 126 |
  52. | `/search/sex` | 442 | 91 |
  53. | `/person/Jared-Harris` | 242 | 102 |
  54. | `/shows/Foundation` | 189 | 145 |
  55. | `/my/shows` | 650 | 219 |
  56. | `/my/movies` | 41 | 38 |
  57. | `/my/unwatched` | 1478 | 1655 |
  58. | `/my/schedule` | 457 | 322 |
  59. - The first visit of the person page loaded the filmography from TMDB: 97 credits, 80 titles added, 487 ms.
  60. - `/my/unwatched` took 1.5–2.4 s over repeated loads (the server part is 1.33 s, 1,595 rows). The old Hybriel gives the same times.
  61. - The header is one row on every page.
  62. - The adult page (`/shows/This-Aint-Star-Trek-XXX`) says "Not found" signed out, and its slug is not in the HTML. It also says "Not found" for az5b2, who follows no adult title.
  63. - I collected every link on all 251 list pages, `/`, 6 searches and the person page: 5,914 slugs. All of them are `adult == false`; 0 adult, 0 unknown.
  64. - 0 console problems.
  65. - Screenshots on Loreana: `/tmp/w056/real/{out,in}-*-{390,1280}.png` and the gate's `header-signed-out-{320,390,1280}.png`. I looked at them.
  66. **Open points**
  67. 1. Deploy: the backfill runs on the live data for about 80 min and adds about 270 MB of posters.
  68. 2. `/my/unwatched` is at the 2 s target (1.5–2.4 s).
  69. 3. hl:fetch blocks the whole server while a TMDB answer is slow (the slowest step in this run took 5 s).
  70. 4. When someone unfollows an adult title on its page, the page turns into "Not found" at once. That follows from the rule; tell me if a softer behaviour is wanted.
  71. 5. Still open from before: 137 TMDB-404 titles stay hidden, adult people are not hidden, and people are never refreshed.

Branches

Latest commits

  • 96ba683adeploy.sh: a gate without a 'passed,' line (check-theme) no longer ends the scriptmre
  • eb3b9205tracker: report 031mre
  • 9b5d2e89tracker mission 031: README (What it does, Test: four gates + the #32 checks, Files: theme/, new pages), STATUS (real copy, A/B load, how to repeat, open points), LOGmre
  • 39950e4ctracker#32 (mission 031): the WorldAPI theme (theme/ vendored verbatim from layouts.worldapi.org 85b5654; styles.hl inherits it: accent green-dark, type colours 1-6; own base/header rules, row lines, genre-pill and inverted-button frames removed, the season foldable keeps its line; check-theme 21 -> 0, 4th deploy gate; main actions class primary) and the #32 header (theme AppHeader/MainMenu/UserMenu/Sidebar/ContentFirst: desktop brand, search, Series|Shows|Movies|Genres|People, user icon with Unwatched..Settings, Logout; signed out the ident selector, phone the iD icon dropdown; phone menu in the sidebar overlay; marked entry by :has); /find -> /search/<q>, /genres, /people(/<letter>), /settings; main { ContentFirst { slot } } works around the hl:web one-line slot bug; gates 365/0, 32/0, 52/0, check-theme 0mre
  • a386dc92tracker: reports 029 + 030mre
  • 71e0fd7dtracker missions 029 + 030: README (What it does, Files, gate count), STATUS (real-copy numbers, how to repeat, open points), LOGmre
  • d36ea6eatracker#34 + #35 (mission 030): Follow directly under the poster, as wide as the poster (show.hl, styles.hl); the status pill next to a series' title — TVmaze's status (new tvmazeStatus, stored by the sync's TVmaze merge) else TMDB's, TVmaze Ended + TMDB Canceled = Canceled, inverted (filled, dark text, no border), green running / yellow pending / red canceled / muted ended (shows.hl statusOf); the daily delta asks TVmaze's status of an unfollowed series TVmaze's change list names (dailysync.hl syncRunStep, sync.hl syncTvmazeStatus); the status backfill after the details repair (backfill.hl, jobs.hl statusTick; resumable, 550 ms per TVmaze request); gates 354/0, 32/0, 52/0mre
  • 7d7d4487tracker#33 (mission 029): reduced titles — every title TMDB's details never went through this app (no detailsAt, no tmdbSync) is incomplete (shows.hl isIncomplete; the old tracker's migrated rows passed #26's test: 5,697 non-adult on the live copy, 691 series without seasons); the repair job does the visibly reduced first (shows.hl missingParts), the page completes one on open; a title TMDB has no poster for (The Remaining) shows the placeholder; tools/count-incomplete.hl; gate fixtures stand for synced titles (tmdbSync), tests/seed-reduced.hl + #33 checks; gates 347/0, 32/0, 52/0mre
  • 661c2592tracker: report 028mre
  • 27c916fatracker mission 028: README ("Code order", the new file map), STATUS (counts before/after, tests, how to repeat, open), LOGmre
  • d924f398tracker mission 028: comments name the new files (sync.hl, dailysync.hl, backfill.hl, credits.hl, jobs.hl, images.hl …); tools/ref-params.py + tools/lambda-audit.py also scan lib/ (they globbed the root only), lambda-audit counts a plain `x = p` alias like `let x = p`mre
  • 2e89b968tracker mission 028 (code order) 5/5 let: `let` only where a variable is reassigned — 667 never-reassigned lets became plain declarations (project.hl, lib/, components/, tools/, tests/); kept: 264 in loop bodies (a plain declaration there is 'Cannot reassign' on the 2nd pass), 234 reassigned, 27 whose name is also a member/outer/free name (a plain write would rebind it); tools/let-audit.py decides and fixes (README 'Code order'); tests/realdata-m028.{sh,mjs} = the page-output diff on a real copy; gates 342/0, 32/0, 52/0, real-copy pages identicalmre
  • 54796ff2tracker mission 028 (code order) 4/5 thin faces + last copies: the show page's check/follow faces call lib/watches.hl toggleWatched / toggleSeasonWatched (seasonAllWatched moved there) and lib/follows.hl toggleFollowed; both logins (header selector face, /login/callback) share lib/users.hl userOfCode; todayStr/listOf copies in components and the export readers copied into tools/migrate.hl + tools/old-short-ids.hl now once (lib/util.hl, lib/export.hl); gates 342/0, 32/0, 52/0; old-short-ids output byte-identical, migrate output identicalmre
  • 06b078e3tracker mission 028 (code order) 3/5 project.hl is the map: config, routes, wiring and a feature → file index (914 → 258 lines); the background jobs (daily sync run, backfills, details repair, credits job, merge, short ids, collection seed) moved unchanged into lib/jobs.hl (a class: their state is reassigned every step, a static cannot be; one instance made after the server), the login callback into lib/users.hl, poster/photo serving into lib/images.hl, the /shows/<slug> rule into lib/shows.hl showsMovedPath; route handlers are thin wrappers; gates 342/0, 32/0, 52/0, real-copy pages identicalmre
  • 94716fd2tracker mission 028 (code order) 2/5 util + topics: lib/util.hl holds envOr, storageDir, postersDir, profilesDir, newId, hexDigits, todayStr, dateOr, textOr, hasId, listOr, firstOf, sortDesc once (were copied into up to 5 files); tmdbsync.hl split into tmdb.hl (TMDB/TVmaze requests), sync.hl (one title's sync), sync-helpers.hl, backfill.hl; details.hl split into details.hl, credits.hl, credits-helpers.hl (isIncomplete to shows.hl); search-helpers.hl (words, query, ranking, slugs); collections.hl (the TMDB collection seed, out of franchises.hl); deltasync.hl renamed dailysync.hl; no behaviour change: gates 342/0, 32/0, 52/0, real-copy pages identicalmre
  • 186079b0tracker mission 028 (code order) 1/5 move: every root .hl except project.hl into lib/ (styles.hl into components/), import paths only; gates 342/0, 32/0, 52/0; real-copy pages identicalmre
  • 4f47f181tracker: report 027mre
  • dc1d4be4tracker mission 027: Hybriel master 06617221 vendored (plugin allocator fixes 3a781359 + 413f60e4); real copy RSS through first-start jobs + 400 loads flat ~2.55 GB (190aa11d 2.3 -> 5.6 GB), page times <= 1.1x; gates 342/0, 32/0, 52/0mre
  • 84e1b3e1tracker: reports 025 + 026mre
  • dc40d859tracker#31 (mission 026): duplicate titles merged — the 68 type+tmdbId pairs held by 157 records were the old tracker's (all migrated); merge.hl repair job (own clock, before the TMDB jobs) keeps one keeper per title (follows/watches > old short id > oldest), moves follows, watches, seasons, cast, credits, timelines, tombstones the rest (mergedInto, never deleted), slugs + short ids 301 to the keeper; stray seasons merged into their listed twin (Reacher S3 watches) or linked when watched; search import re-checks before its put; deploy.sh waits up to 90 s for 200; real copy 68 -> 0 dup ids, az5b2 follows/watches equal; gates 342/0, 32/0, 52/0mre