gitoriaLog in with ident

tracker

All repositories: gitoria

ReadmeCodePull requestsReleasesTicketsSettings
Commit93be947693be9476tracker#16: person pages /person/<slug> with the filmography fetched from TMDB on the first visit (step by step), gatemre93be9476/catalog.hl

7.9 KB

  1. // catalog.hl — THE PUBLIC LISTS (tracker.worldapi.org#13): every movie, newest release first, and every series, the one
  2. // whose newest RELEASED episode is newest first — the homepage's two rows (10 each) and /movies, /shows (24 per page).
  3. // Movies and series are both rows of `shows` (`type` 'movie' / 'series', the old tracker's shape).
  4. //
  5. // BUILT ONCE when the app starts — one scan of shows and of episodes (real data: 9,453 shows, 232k episodes, ~1 s) — and
  6. // kept in memory as two sorted lists of { id, key }. A request only slices its page and fetches those 24 shows: no scan.
  7. // Kept up to date without a rebuild:
  8. // - the daily TMDB sync (project.hl syncTick) calls `refreshCatalogShow(id)` after each show: its entry is recomputed
  9. // from its own seasons/episodes (new episodes, moved release dates) and moved to its new place;
  10. // - a NEW DAY: an episode upcoming yesterday may be out today — each series keeps the release dates of its upcoming
  11. // episodes (`upcoming`), and the first read of a new day moves the ones that are out into `latest` and re-sorts.
  12. // tools/sync-tmdb.hl runs with the app stopped (hybriel#21): the next start builds the lists afresh.
  13. //
  14. // ORDER: a movie by its `release` ('YYYY-MM-DD'; none → last). A series by its newest released episode (release ≤
  15. // today, UTC like the rest of the app); a series with none released yet comes after all that have one, by its own
  16. // `release`. Ties keep the table's order. `key` is one string so one comparison sorts: series '1<date>' / '0<date>'.
  17. import { now, timestamp } from 'hl:time'
  18. import { allShows, allEpisodes, showById, seasonsOfShow, episodesOfSeason, showYear, posterUrlOf } from './shows.hl'
  19. static pageSize = 24
  20. static todayStr = () => { return timestamp(now()).slice(0, 10) }
  21. static dateOr = (v) => { return v != null && hlTypeName(v) == 'String' && v.length >= 4 ? v : '' }
  22. static seriesKey = (latest, release) => { return latest != null && latest != '' ? '1' + latest : '0' + release }
  23. // ---- sorting, hand-written (no list sort(), hybriel#1): a bottom-up merge sort, newest key first, stable ----------
  24. static mergeDesc = (a, b) => {
  25. let out = []
  26. let i = 0
  27. let j = 0
  28. while (i < a.length && j < b.length) {
  29. if (b[j].key > a[i].key) { out.push(b[j]) j = j + 1 } else { out.push(a[i]) i = i + 1 }
  30. }
  31. while (i < a.length) { out.push(a[i]) i = i + 1 }
  32. while (j < b.length) { out.push(b[j]) j = j + 1 }
  33. return out
  34. }
  35. static sortDesc = (list) => {
  36. if (list.length == 0) { return [] }
  37. let runs = []
  38. for (x of list) { runs.push([x]) }
  39. while (runs.length > 1) {
  40. let next = []
  41. let k = 0
  42. while (k + 1 < runs.length) { next.push(mergeDesc(runs[k], runs[k + 1])) k = k + 2 }
  43. if (k < runs.length) { next.push(runs[k]) }
  44. runs = next
  45. }
  46. return runs[0]
  47. }
  48. // one entry moved to its place: out of the list, then in before the first entry with a smaller key (linear)
  49. static placed = (list, entry) => {
  50. let out = []
  51. let done = false
  52. for (x of list) {
  53. if (x.id != entry.id) {
  54. if (!done && entry.key > x.key) { out.push(entry) done = true }
  55. out.push(x)
  56. }
  57. }
  58. if (!done) { out.push(entry) }
  59. return out
  60. }
  61. // ---- the index -------------------------------------------------------------------------------------------------
  62. static buildIndex = () => {
  63. let today = todayStr()
  64. let movies = []
  65. let seriesIds = []
  66. let release = {}
  67. for (s of allShows()) {
  68. if (s.type == 'movie') { movies.push({ id = s.id key = dateOr(s.release) }) }
  69. else if (s.type == 'series') { seriesIds.push(s.id) release[s.id] = dateOr(s.release) }
  70. }
  71. let latest = {}
  72. let upcoming = {}
  73. for (e of allEpisodes()) {
  74. if (e.show != null && dateOr(e.release) != '') {
  75. if (e.release <= today) {
  76. let l = latest[e.show]
  77. if (l == null || e.release > l) { latest[e.show] = e.release }
  78. } else {
  79. let u = upcoming[e.show]
  80. if (u == null) { u = [] }
  81. u.push(e.release)
  82. upcoming[e.show] = u
  83. }
  84. }
  85. }
  86. let series = []
  87. for (id of seriesIds) { series.push({ id = id key = seriesKey(latest[id], release[id]) }) }
  88. return { day = today movies = sortDesc(movies) series = sortDesc(series) latest = latest upcoming = upcoming release = release }
  89. }
  90. static index = buildIndex()
  91. // a new day: upcoming episodes that are out now become their series' newest released one
  92. static rollDay = () => {
  93. let today = todayStr()
  94. if (index.day == today) { return null }
  95. let moved = false
  96. for (id of index.upcoming.keys()) {
  97. let rest = []
  98. let l = index.latest[id]
  99. for (d of index.upcoming[id]) {
  100. if (d <= today) {
  101. if (l == null || d > l) { l = d }
  102. moved = true
  103. } else { rest.push(d) }
  104. }
  105. index.upcoming[id] = rest
  106. if (l != null) { index.latest[id] = l }
  107. }
  108. if (moved) {
  109. let series = []
  110. for (x of index.series) { series.push({ id = x.id key = seriesKey(index.latest[x.id], index.release[x.id]) }) }
  111. index.series = sortDesc(series)
  112. }
  113. index.day = today
  114. return null
  115. }
  116. // after the sync touched a show: its entry from its own data again (only that show's seasons/episodes are read)
  117. static refreshCatalogShow = (showId) => {
  118. rollDay()
  119. let show = showById(showId)
  120. if (show == null) { return null }
  121. if (show.type == 'movie') {
  122. index.movies = placed(index.movies, { id = show.id key = dateOr(show.release) })
  123. return null
  124. }
  125. if (show.type != 'series') { return null }
  126. let today = index.day
  127. let l = null
  128. let up = []
  129. for (s of seasonsOfShow(show)) {
  130. for (e of episodesOfSeason(s)) {
  131. if (dateOr(e.release) != '') {
  132. if (e.release <= today) { if (l == null || e.release > l) { l = e.release } } else { up.push(e.release) }
  133. }
  134. }
  135. }
  136. index.latest[show.id] = l
  137. index.upcoming[show.id] = up
  138. index.release[show.id] = dateOr(show.release)
  139. index.series = placed(index.series, { id = show.id key = seriesKey(l, index.release[show.id]) })
  140. return null
  141. }
  142. // ---- what the pages read ---------------------------------------------------------------------------------------
  143. // one poster tile: poster, title, year, the show page (movies use the same /shows/<slug> page and its Follow button)
  144. static tileOf = (show) => {
  145. let y = showYear(show)
  146. return { id = show.id title = show.title year = y != null ? y : '' href = '/shows/' + show.urlSegment posterUrl = posterUrlOf(show) }
  147. }
  148. static tilesOf = (entries) => {
  149. let out = []
  150. for (x of entries) {
  151. let show = showById(x.id)
  152. if (show != null) { out.push(tileOf(show)) }
  153. }
  154. return out
  155. }
  156. // the homepage: the n latest RELEASED movies (none dated after today) and the n series with the newest released episode
  157. static latestMovies = (n) => {
  158. rollDay()
  159. let want = []
  160. for (x of index.movies) {
  161. if (want.length < n && x.key != '' && x.key <= index.day) { want.push(x) }
  162. if (want.length >= n) { return tilesOf(want) }
  163. }
  164. return tilesOf(want)
  165. }
  166. static latestSeries = (n) => {
  167. rollDay()
  168. let want = []
  169. for (x of index.series) {
  170. if (want.length < n && x.key.slice(0, 1) == '1') { want.push(x) }
  171. if (want.length >= n) { return tilesOf(want) }
  172. }
  173. return tilesOf(want)
  174. }
  175. // a page number from the address (`/movies/page/:page`, a String) — anything that is not a whole number ≥ 1 is page 1;
  176. // past the last page is the last page
  177. static pageNumberOf = (raw, pages) => {
  178. if (raw == null) { return 1 }
  179. let s = '' + raw
  180. if (s == '' || s.length > 6) { return 1 }
  181. let i = 0
  182. while (i < s.length) {
  183. let c = s.charCodeAt(i)
  184. if (c < 48 || c > 57) { return 1 }
  185. i = i + 1
  186. }
  187. let p = toNumber(s)
  188. if (p < 1) { return 1 }
  189. return p > pages ? pages : p
  190. }
  191. static pagesOf = (count) => {
  192. let p = 1
  193. while (p * pageSize < count) { p = p + 1 }
  194. return p
  195. }
  196. // { page, pages, tiles } of one list
  197. static pageOf = (list, raw) => {
  198. let pages = pagesOf(list.length)
  199. let page = pageNumberOf(raw, pages)
  200. return { page = page pages = pages tiles = tilesOf(list.slice((page - 1) * pageSize, page * pageSize)) }
  201. }
  202. static moviesPage = (raw) => { rollDay() return pageOf(index.movies, raw) }
  203. static seriesPage = (raw) => { rollDay() return pageOf(index.series, raw) }
  204. static catalogCounts = () => { return { movies = index.movies.length series = index.series.length } }

Branches

Latest commits

  • 93be9476tracker#16: person pages /person/<slug> with the filmography fetched from TMDB on the first visit (step by step), gatemre
  • 47a3cae6STATUS: mission 053 merge commit idsmre
  • dcc5eecaMerge branch 't14-search'mre
  • 03edc783Merge branch 't15-tvmaze'mre
  • 71b46345tracker#15: numbering check by date or title, placeholder titles in other languages, docs + real-data proofmre
  • 6bb2daf1tracker#13: homepage (tiles, intro, latest movies/shows), /shows, /movies/page/N, /my/movies; lists cached in memorymre
  • b8bd1157tracker#14: README + STATUS (search, real-data numbers, gate, merge notes)mre
  • 65c694a8tracker#14: search — header magnifier, /search/<text> (in-memory word-prefix index over titles + people), Fetch from web (TMDB search/multi, ours left out), Add = import via syncShow; gate +25 checks, real-data scriptmre
  • 34f2c15btracker#15: TVmaze merge in the sync (gaps only: new episodes/seasons, empty titles/air dates; numbering check), fake TVmaze episodes + gatemre
  • cbdc4ea7tracker#12: link icons TMDB/IMDb/TVDB/TVmaze; sync fills missing ids (TVmaze lookup); movies fetched via /movie/mre
  • b105bcd8tracker#11: Hybriel master ff51cf46 (checks no longer vanish), mobile-first styles, carets, follow button, sign-in modal, inverted check, orange castmre
  • 31b758aatracker#10: installable app (manifest, service worker, offline shell), own icon + faviconmre
  • 2fa9d997tracker#9: TMDB sync (followed shows: seasons, episodes, posters), tools/sync-tmdb.hl + daily run 04:00 UTC, fake TMDB in gatemre
  • 49e1f61edeploy.sh: back up live storage/.sessions/.env before every deploy (newest 5 kept)mre
  • 54070a4etracker#8: /my/unwatched + /my/schedule (301 from old), S01E01, title (year), 1 episode, watched-set lookup (unwatched 15s -> 1s)mre
  • 3251488atracker#7: /my/shows (followed shows, newest follow first, poster, title, last watched SxxEyy); gate can take screenshots (TRACKER_GATE_SHOTS)mre
  • 44b7d9f9tracker#6: /schedule — upcoming episodes of followed shows, soonest firstmre
  • 91c9fc8ctracker#5: /unwatched — unwatched released episodes of followed shows, newest firstmre
  • a97c0295tracker#4: show page /shows/:slug (header, seasons, episodes, watch checks) + tools/relink-episode-seasons.hlmre
  • 05f407c5tracker: no border on any button except inverted ones (Log out, ident status and identities too); header brand weight 100mre