gitoriaLog in with ident

tracker

All repositories: gitoria

ReadmeCodePull requestsReleasesTicketsSettings
Commit5cb85d755cb85d75deploy.sh: a backup taken while a background job writes (tar exit 1) is a warning; archive checked with gzip -tmre5cb85d75/tests/faketmdb.mjs

12.9 KB

  1. // tests/faketmdb.mjs — A FAKE TMDB for the gate (tracker.worldapi.org#9): a tiny local HTTP server that answers
  2. // the three calls lib/sync.hl makes, from fixed JSON — no real TMDB call ever happens in the gate. The app is
  3. // pointed at it with TMDB_BASE_URL=<base>/3 and TMDB_IMAGE_URL=<base>/t/p.
  4. //
  5. // GET /3/tv/<id> details (shows[id] minus the episodes)
  6. // GET /3/tv/<id>?append_to_response=season/1,… the same + "season/<n>" = { name, overview, air_date, episodes }
  7. // GET /t/p/w342|w780/<file>.png a 1×1 png (w780: a backdrop, mission 032)
  8. // …?append_to_response=…,external_ids + "external_ids" = shows[id].external_ids (tracker.worldapi.org#12)
  9. // GET /3/movie/<id>[?append_to_response=external_ids] movies[id]: { id, title, poster_path } (+ external_ids)
  10. // GET /3/search/multi?query=… tracker.worldapi.org#14: { results = search[query in lower case] }
  11. // — recorded in `fake.searchRequests`, NOT in `fake.requests`
  12. // GET /t/p/w92/<file>.png the search page's small posters → `fake.thumbRequests`
  13. // GET /3/person/<id>[?append_to_response=combined_credits] tracker.worldapi.org#16: persons[id] (+ its combined_credits)
  14. // GET /t/p/w185/<file>.png a person's photo (1×1 png) — both recorded in `fake.personRequests`
  15. // and A FAKE TVMAZE under /tvmaze (the app gets TVMAZE_BASE_URL=<base>/tvmaze):
  16. // GET /tvmaze/lookup/shows?imdb=tt…|thetvdb=<id> 301 → /tvmaze/shows/<id> (like the real one), 404 when unknown
  17. // GET /tvmaze/shows/<id> { id, name }
  18. // GET /tvmaze/shows/<id>?embed=episodes + summary (tvmaze.summaries[id], HTML) + _embedded.episodes = tvmaze.episodes[id]
  19. // (tracker.worldapi.org#15, #18): [{ id, season, number, name, airdate }]; 404 without episodes
  20. // GET /tvmaze/updates/shows?since=day|week|month tracker.worldapi.org#18: tvmaze.updates ({ "<id>": <time> })
  21. // both /tvmaze/shows/<id> answers carry `status` = tvmaze.statuses[id] (tracker#35; null when none); an id in tvmaze.missing → 404
  22. // GET /3/tv/changes, /3/movie/changes?start_date=…&end_date=…&page=n tracker.worldapi.org#18: `fake.changes` { tv: [ids], movie: [ids] },
  23. // `fake.changesPageSize` (100) per page — recorded in `fake.requests` like every TMDB call;
  24. // `fake.changesFail` = true answers 503
  25. //
  26. // GET /3/collection/<id> tracker.worldapi.org#19 (mission 066): collections[id] = { id, name, parts }; a
  27. // movie's details carry `belongs_to_collection` when its fixture has one
  28. // …?append_to_response=…,credits (movie) / aggregate_credits (tv) tracker.worldapi.org#26: the fixture's `credits` /
  29. // `aggregate_credits` ({ cast: [...] }); details also carry homepage,
  30. // tagline, status, genres of the fixture
  31. // tracker.worldapi.org#28: a series' details carry the fixture's `created_by`
  32. // (default []); credits may carry `crew` (movie: { job }, series: { jobs })
  33. // mission 054: every details / search answer carries TMDB's `adult` (false unless the fixture sets it). Mission 068 (tracker#21):
  34. // a TV details answer carries the fixture's `type` (Scripted, Talk Show, …; none when the fixture has none).
  35. // `fake.shows` is mutable (the gate adds an episode before the in-app run), `fake.delayMs` slows every answer
  36. // down, `fake.requests` records every TMDB/image request (path, authorization) so the gate can prove what was asked;
  37. // TVmaze requests go to `fake.tvmazeRequests` (paths) instead.
  38. import http from 'node:http';
  39. export const PNG = Buffer.from('iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+M9QDwADhgGAWjR9awAAAABJRU5ErkJggg==', 'base64');
  40. export async function startFakeTmdb({ port, shows, movies = {}, tvmaze = { imdb: {}, thetvdb: {} }, search = {}, persons = {}, collections = {} }) {
  41. const fake = { shows, movies, tvmaze, search, persons, collections, changes: { tv: [], movie: [] }, changesPageSize: 100, changesFail: false, delayMs: 0, personDelayMs: 0, requests: [], tvmazeRequests: [], searchRequests: [], thumbRequests: [], personRequests: [], base: `http://127.0.0.1:${port}` };
  42. const details = (s) => ({
  43. id: s.id, name: s.name, adult: s.adult ?? false, overview: s.overview, status: s.status, poster_path: s.poster_path, backdrop_path: s.backdrop_path ?? null,
  44. first_air_date: s.first_air_date, genres: s.genres, original_language: s.original_language, homepage: s.homepage, tagline: s.tagline, created_by: s.created_by || [], type: s.type,
  45. number_of_seasons: s.seasons.filter(x => x.season_number > 0).length,
  46. number_of_episodes: s.seasons.filter(x => x.season_number > 0).reduce((a, x) => a + x.episodes.length, 0),
  47. seasons: s.seasons.map(x => ({ id: x.id, season_number: x.season_number, name: x.name, overview: x.overview || '', air_date: x.air_date, episode_count: x.episodes.length })),
  48. });
  49. const server = http.createServer((req, res) => {
  50. const url = new URL(req.url, fake.base);
  51. if (url.pathname.startsWith('/tvmaze/')) {
  52. fake.tvmazeRequests.push(url.pathname + url.search);
  53. const json = (code, body, headers = {}) => { res.writeHead(code, { 'content-type': 'application/json', ...headers }); res.end(JSON.stringify(body)); };
  54. if (url.pathname === '/tvmaze/lookup/shows') {
  55. const [param, value] = [...url.searchParams.entries()][0] || [];
  56. const id = param && (fake.tvmaze[param] || {})[value];
  57. return id ? json(301, {}, { location: `${fake.base}/tvmaze/shows/${id}` }) : json(404, { name: 'Not Found', status: 404 });
  58. }
  59. if (url.pathname === '/tvmaze/updates/shows') return json(200, fake.tvmaze.updates || {});
  60. const em = url.pathname.match(/^\/tvmaze\/shows\/(\d+)\/episodes$/);
  61. if (em) return (fake.tvmaze.episodes || {})[em[1]] ? json(200, fake.tvmaze.episodes[em[1]].map(e => ({ type: 'regular', summary: '<p>tvmaze</p>', ...e }))) : json(404, { name: 'Not Found', status: 404 });
  62. const sm = url.pathname.match(/^\/tvmaze\/shows\/(\d+)$/);
  63. if (sm && url.searchParams.get('embed') === 'episodes') {
  64. const eps = (fake.tvmaze.episodes || {})[sm[1]];
  65. return eps ? json(200, { id: Number(sm[1]), name: 'fake TVmaze show ' + sm[1], summary: (fake.tvmaze.summaries || {})[sm[1]] ?? null, status: (fake.tvmaze.statuses || {})[sm[1]] ?? null,
  66. _embedded: { episodes: eps.map(e => ({ type: 'regular', summary: '<p>tvmaze</p>', ...e })) } }) : json(404, { name: 'Not Found', status: 404 });
  67. }
  68. return sm && !(fake.tvmaze.missing || []).includes(Number(sm[1])) ? json(200, { id: Number(sm[1]), name: 'fake TVmaze show ' + sm[1], status: (fake.tvmaze.statuses || {})[sm[1]] ?? null }) : json(404, { name: 'Not Found', status: 404 });
  69. }
  70. if (url.pathname === '/3/search/multi') {
  71. fake.searchRequests.push({ path: url.pathname + url.search, authorization: req.headers['authorization'] || null });
  72. // like the real one, every title result carries `adult` (false unless the fixture says otherwise, mission 054)
  73. const results = (fake.search[(url.searchParams.get('query') || '').toLowerCase()] || []).map(r => r.media_type === 'person' || 'adult' in r ? r : { ...r, adult: false });
  74. res.writeHead(200, { 'content-type': 'application/json' });
  75. return res.end(JSON.stringify({ page: 1, results, total_pages: 1, total_results: results.length }));
  76. }
  77. // the search page's small posters (w92, loaded by the BROWSER from TMDB's image host) — kept out of `requests` too
  78. if (/^\/t\/p\/w92\/[a-z0-9]+\.png$/.test(url.pathname)) { fake.thumbRequests.push(url.pathname); res.writeHead(200, { 'content-type': 'image/png' }); return res.end(PNG); }
  79. // tracker.worldapi.org#16: the person page's fetch (kept out of `requests`, like the search's) — `personDelayMs` slows it
  80. // down so the gate sees the page's "loading" state
  81. const pm = url.pathname.match(/^\/3\/person\/(\d+)$/);
  82. if (pm || /^\/t\/p\/w185\/[a-z0-9]+\.png$/.test(url.pathname)) {
  83. fake.personRequests.push({ path: url.pathname + url.search, authorization: req.headers['authorization'] || null });
  84. const answerPerson = () => {
  85. if (!pm) { res.writeHead(200, { 'content-type': 'image/png' }); return res.end(PNG); }
  86. const pr = fake.persons[pm[1]];
  87. if (!pr) { res.writeHead(404, { 'content-type': 'application/json' }); return res.end('{"status_code":34,"status_message":"The resource you requested could not be found."}'); }
  88. const { combined_credits, ...out } = pr;
  89. if ((url.searchParams.get('append_to_response') || '').split(',').includes('combined_credits')) out.combined_credits = combined_credits || { cast: [], crew: [] };
  90. res.writeHead(200, { 'content-type': 'application/json' });
  91. res.end(JSON.stringify(out));
  92. };
  93. if (pm && fake.personDelayMs > 0) return setTimeout(answerPerson, fake.personDelayMs);
  94. return answerPerson();
  95. }
  96. fake.requests.push({ path: url.pathname + url.search, authorization: req.headers['authorization'] || null, at: Date.now() });
  97. const answer = () => {
  98. const ch = url.pathname.match(/^\/3\/(tv|movie)\/changes$/);
  99. if (ch) {
  100. if (fake.changesFail) { res.writeHead(503, { 'content-type': 'application/json' }); return res.end('{"status_code":11}'); }
  101. const all = fake.changes[ch[1]] || [], size = fake.changesPageSize, page = Number(url.searchParams.get('page') || 1);
  102. const results = all.slice((page - 1) * size, page * size).map(id => ({ id, adult: false }));
  103. res.writeHead(200, { 'content-type': 'application/json' });
  104. return res.end(JSON.stringify({ results, page, total_pages: Math.max(1, Math.ceil(all.length / size)), total_results: all.length }));
  105. }
  106. const appended = (url.searchParams.get('append_to_response') || '').split(',').filter(Boolean);
  107. const mv = url.pathname.match(/^\/3\/movie\/(\d+)$/);
  108. if (mv && fake.movies[mv[1]]) {
  109. const m = fake.movies[mv[1]];
  110. const out = { id: m.id, title: m.title, adult: m.adult ?? false, poster_path: m.poster_path, release_date: m.release_date, overview: m.overview, genres: m.genres,
  111. homepage: m.homepage, tagline: m.tagline, status: m.status, backdrop_path: m.backdrop_path ?? null, runtime: m.runtime ?? 0 };
  112. if (appended.includes('external_ids')) out.external_ids = m.external_ids || {};
  113. if (appended.includes('credits')) out.credits = m.credits || { cast: [], crew: [] };
  114. if (m.belongs_to_collection !== undefined) out.belongs_to_collection = m.belongs_to_collection;
  115. res.writeHead(200, { 'content-type': 'application/json' });
  116. return res.end(JSON.stringify(out));
  117. }
  118. const cm = url.pathname.match(/^\/3\/collection\/(\d+)$/);
  119. if (cm && fake.collections[cm[1]]) {
  120. res.writeHead(200, { 'content-type': 'application/json' });
  121. return res.end(JSON.stringify(fake.collections[cm[1]]));
  122. }
  123. let m = url.pathname.match(/^\/3\/tv\/(\d+)$/);
  124. if (m && fake.shows[m[1]]) {
  125. const s = fake.shows[m[1]];
  126. const out = details(s);
  127. if (appended.includes('external_ids')) out.external_ids = s.external_ids || {};
  128. if (appended.includes('aggregate_credits')) out.aggregate_credits = s.aggregate_credits || { cast: [], crew: [] };
  129. for (const part of appended) {
  130. const sm = part.match(/^season\/(\d+)$/);
  131. const season = sm && s.seasons.find(x => x.season_number === Number(sm[1]));
  132. if (season) out[part] = { id: season.id, season_number: season.season_number, name: season.name, overview: season.overview || '', air_date: season.air_date,
  133. episodes: season.episodes.map(e => ({ id: e.id, season_number: season.season_number, episode_number: e.episode_number, name: e.name, overview: e.overview || '', air_date: e.air_date })) };
  134. }
  135. res.writeHead(200, { 'content-type': 'application/json' });
  136. return res.end(JSON.stringify(out));
  137. }
  138. // mission 032 (tracker#33): w780 = a backdrop the sync takes as the poster when TMDB has none
  139. if (/^\/t\/p\/w(342|780)\/[a-z0-9]+\.png$/.test(url.pathname)) { res.writeHead(200, { 'content-type': 'image/png' }); return res.end(PNG); }
  140. res.writeHead(404, { 'content-type': 'application/json' });
  141. res.end('{"status_code":34,"status_message":"The resource you requested could not be found."}');
  142. };
  143. if (fake.delayMs > 0) setTimeout(answer, fake.delayMs); else answer();
  144. });
  145. await new Promise((ok, fail) => { server.once('error', fail); server.listen(port, '127.0.0.1', ok); });
  146. fake.stop = () => new Promise(r => server.close(() => r()));
  147. return fake;
  148. }

Branches

Latest commits

  • 5cb85d75deploy.sh: a backup taken while a background job writes (tar exit 1) is a warning; archive checked with gzip -tmre
  • 9abda75dtracker: report 035mre
  • 12595e47mission 035: theme re-vendored from layouts.worldapi.org 0222f67 (two corner radii: radiusSmall 5px, radiusLarge 10px); the tracker's 18 own radii -> radiusSmall/radiusLarge (--layout-radius is gone); check-theme 0; gates 379/0, 32/0, 53/0, 229/0, 26/0; real copy: every computed radius in {0, 5px, 10px, 50%}mre
  • e7305014tracker: report 032 (art + photos)mre
  • fbb903cctracker#33/#37 (mission 032): a title without a TMDB poster gets its backdrop (w780, posterFromBackdrop, shown 2:3 centre-cropped); movies store runtime, the page shows release date + runtime; art backfill (public titles without poster file / movies without runtime) and person photo backfill (tmdbProfile / photoCheck) as the last start jobs (TRACKER_ART, TRACKER_PHOTOS; off in every gate start); gates 379/0, 32/0, 53/0, 229/0, 26/0, check-theme 0; live copy: art 4977 titles in 42 min (115 posters, 15 backdrops, 4609 runtimes), The Remaining shows its backdrop + 7 minmre
  • 4ecc67b2tracker: STATUS/LOG for the t38 + t40 merge (gates 374/0, 32/0, 53/0, 229/0, 26/0, check-theme 0; live copy checks)mre
  • e5945d2fMerge t40 (tracker#40 curated franchises, Franchises menu, superseded collections) into main: deploy.sh lists all six gates (browser, kinds, franchises, pager, franchiseseed, check-theme); search.hl keeps #37's personPhotoOf + #40's importWithCredits; pager gate runs with TRACKER_FRANCHISE_SEED=0; gates 374/0, 32/0, 53/0, 229/0, 26/0, check-theme 0mre
  • b638e99dMerge t38 (tracker#38 pagination, #35 Returning/Airing label) into main: LOG/STATUS keep both sides; pager gate follows #37's /people (everyone, last updated first: seed updatedAt); gates pager 229/0, browser 374/0mre
  • f8ffa4dbtracker: report 032 + The Remaining + #39mre
  • 7565a863tracker: LOG timemre
  • b10f00c8tracker#39: double episodes — migrated episodes whose TMDB id TMDB replaced are adopted by their number in the sync (old id -> migratedTmdbId); merge.hl step 3 merges each season's doubles at start (keeper: most watches > synced > first; watches moved/parked; tombstones into mergedEpisodes, nothing deleted); tools/count-duplicate-episodes.hl; gate fixture + paths-m039; live copy 850 -> 0 in 64 s; gates 373/0, 32/0, 52/0mre
  • 8f1d4542tracker#40: superseded collections — a TMDB collection timeline whose titles are all in one curated timeline is hidden (supersededBy; kept: own page + editor finder), set by the collection seed when it makes one and by the curated build (lifted when the cover is gone); partly covered ones join that franchise; no second widget (First Contact: only Star Trek — Prime); gate franchiseseed 26/0, browser 365/0, kinds 32/0, franchises 53/0, check-theme 0; real copy 24 supersededmre
  • 9448d643tracker#35 follow-up (mission 033): TVmaze 'Running' is labelled 'Returning', or 'Airing' while a non-special episode of the two newest seasons is released within today +-7 days (data unchanged); gate fixtures Running/Airing/Aired + a special; browser 366/0, kinds 32/0, franchises 52/0, pager 229/0, check-theme 0mre
  • 7d4b293dtracker#40: "Franchises" in the main menu (desktop header after People, phone sidebar) → /franchises, marked on franchise and timeline pages; gates 365/0, 32/0, 53/0, 24/0, check-theme 0mre
  • 8751adb8tracker: report 032mre
  • 9bce1f65tracker mission 032: STATUS gate files + the hour-boundary flakemre
  • 718bfb89tracker#37 (mission 032): /people = everyone, last updated first (updatedAt stamped by the person fill; view built at boot, touched people first at once), photo + name tiles (person colour) with the /movies pagination, /people/<letter> removed; photo = our file, tmdbProfile, a cast/crew entry's profile (in-memory map at boot), else the new 'no photo' placeholder; new cast/crew/created_by people keep tmdbProfile; search people rows with the photo; /settings = the heading only; util.hl sortDesc starts from sorted runs (same result, 105k: 1.6 s -> 0.15 s); gates 369/0, 32/0, 52/0, check-theme 0; README/STATUS/LOGmre
  • 93dfb0batracker#40 (mission 034): the curated franchises — data/franchises.json (17 franchises, 31 timelines, 285 TMDB titles, movies + series, in-universe/release order, 12 TMDB collections attached); lib/franchiseseed.hl + jobs.hl franchiseSeedTick (last start job, imports missing titles via details.hl importWithCredits = the search's Add, one per step paced, then one build; franchiseseed.db: editor changes win, the creator's same-name franchise adopted / timeline left alone, 404 remembered, resumable, idempotent); timeline heads 'N titles · in-universe order' (orderKind) and wrap on a phone; series pages show the widget; new gate tests/franchiseseed.mjs (5th in deploy.sh), the others run with TRACKER_FRANCHISE_SEED=0; gates 365/0, 32/0, 52/0, 24/0, check-theme 0; real copy 196 imported, 0 failed, 7 min, restart unchanged=31mre
  • 03ec792ftracker#38 (mission 033): pagination goes exactly to the clicked page — tilelist read the clicked button's text after pagination.hl's own handler had rebuilt the buttons (real clicks only); now li.current, else the button's own text; new gate tests/pager.mjs (5 lists x 11 pages, 390/1280, real + script clicks, Back/Forward) 229/0; browser 365/0, kinds 32/0, franchises 52/0, check-theme 0mre
  • 96ba683adeploy.sh: a gate without a 'passed,' line (check-theme) no longer ends the scriptmre