tracker

26.4 KB

1. // lib/sync.hl — THE TMDB SYNC OF ONE TITLE (tracker.worldapi.org#9; tmdbsync.hl before mission 028 — its requests are in tmdb.hl,
2. // its small helpers in sync-helpers.hl, the backfills in backfill.hl): for every show SOMEONE follows, fetch the show's
3. // details, seasons and episodes from TMDB and bring storage/mpackdb/ up to date, plus the show's poster.
4. // Used by BOTH runners: the daily run inside the app (jobs.hl `syncTick`, one show per step) and the
5. // command-line tool (tools/sync-tmdb.hl). Reference for the API use: the old tracker's
6. // crates/sync/commands/sync.js (read-only).
7. //
8. // GET <TMDB_BASE_URL>/tv/<tmdbId>?append_to_response=external_ids,aggregate_credits the details (status,
9. // counts, overview, poster_path, seasons[])
10. // + external_ids (imdb_id, tvdb_id) + the cast/crew
11. // of every season (tracker#28: the answer goes back
12. // as `res.details`, the caller stores the credits —
13. // credits.hl applyCredits; no extra request)
14. // GET <TMDB_BASE_URL>/tv/<tmdbId>?append_to_response=season/1,season/2… up to 20 seasons with their
15. // episodes in ONE request
16. // GET <TMDB_IMAGE_URL>/w342<poster_path> the poster → storage/mpackdb/posters/
17. // Authorization: Bearer $TMDB_READ_TOKEN
18. // GET <TVMAZE_BASE_URL>/lookup/shows?imdb=tt… (else ?thetvdb=<id>) the TVmaze id, ONLY when the show
19. // has none (301 → /shows/<id>, 404 = unknown)
20. // GET <TVMAZE_BASE_URL>/shows/<tvmzId>?embed=episodes a SERIES on TVmaze with its episodes (#15), see
21. // below; its summary → `tvmazeSummary` (tracker#18),
22. // its status → `tvmazeStatus` (tracker#35)
23. // A MOVIE (`type = 'movie'`, 7814 of the migrated rows, 1 followed): only
24. // GET <TMDB_BASE_URL>/movie/<tmdbId>?append_to_response=external_ids,credits its imdb id + poster (+ credits); no seasons,
25. // status, overview (it is no TV show)
26. //
27. // EXTERNAL IDS (tracker.worldapi.org#12, the show page's link icons): a MISSING imdbId/tvdbId is filled from TMDB's
28. // external_ids, a missing tvmzId from TVmaze's lookup — an id the show already has is NEVER overwritten.
29. // RULES (ticket): new seasons/episodes are ADDED, existing ones UPDATED (title, summary, release) —
30. // matched by tmdbId, never duplicated; NOTHING is deleted. An episode without a tmdbId (161 migrated ones)
31. // is matched by its S/E number instead and gets the tmdbId. Tracker#39 (mission 032): so is an episode whose tmdbId TMDB no longer
32. // lists in that season — TMDB re-creates episodes now and then (Scrubs S1E1: 326465 → 6992247); the old id is kept as
33. // `migratedTmdbId`. Before, such a migrated episode stayed and a SECOND one of the same number was added (850 on the live copy,
34. // merged by merge.hl). A season (no tmdbId in the migrated data) is
35. // matched by (show, seasonNumber). A TMDB value that is empty/null never overwrites a stored one.
36. // Season 0 ("Specials") is only synced for a show that already has a season 0 (else every followed show
37. // would suddenly flood /my/unwatched with specials); a TMDB season with no episodes is not created.
38. //
39. // TVMAZE MERGE (tracker.worldapi.org#15): AFTER TMDB, a series with a tvmzId gets TVmaze's episode list (one request)
40. // and TVmaze FILLS GAPS only — matched by season/episode number: a missing episode (and its season) is ADDED, an empty
41. // title or air date of an existing one is FILLED; a value TMDB gave is never overwritten. A placeholder title
42. // ("Episode 4", "TBA") counts as empty — and TMDB's own placeholder never overwrites a real title either (else the
43. // two would flip it every day). When TMDB later lists the episode, the TMDB step adopts it by number (it has no tmdbId)
44. // and TMDB's values win. TVmaze specials (no episode number) are skipped, season 0 only if the show has one. SAFETY:
45. // when the two number a show differently (fewer than 80 % of the episodes both know air within a day of each other or
46. // share the title — `numberingAgrees`), TVmaze is ignored for that show (`tvmazeSkipped`). Summaries are not taken
47. // (TVmaze's are HTML; the ticket asks for episodes, air dates, titles). The SHOW's TVmaze summary is kept, HTML stripped, as
48. // `tvmazeSummary` (tracker#18; the page shows summary > tmdbSummary > tvmazeSummary, shows.hl summaryOf).
49. //
50. // WHICH TITLES, WHEN (tracker#18): the daily run asks TMDB's and TVmaze's change lists first and syncs only the titles of ours
51. // that changed — dailysync.hl. THE SHOW RECORD (title, tagline, homepage, status, genres …) is refreshed from the same details
52. // answer by details.hl `applySynced`.
53. //
54. // IDS ARE SELF-ASSIGNED (randomBytes, like watches.hl): hl:mpackdb's own generated @id can repeat within
55. // one millisecond, which is what made update() lose rows (hybriel#113, fixed upstream, not in the vendored
56. // build) — a table holding only unique ids is safe to update().
57. //
58. // ONE PROCESS PER STORAGE: hl:mpackdb does not coordinate two processes (hybriel#21) — the in-app run uses
59. // the app's own open tables (imported from shows.hl); the tool only ever runs against a stopped app or a copy.
60. import { now } from 'hl:time'
61. import { newId, textOr } from './util.hl'
62. import { showsTable, seasonsTable, episodesTable, kindOfTitle } from './shows.hl'
63. import { tmdbGet, numIdOr, externalIdsFor, tvmazeEpisodes, tvmazeShow, syncPoster, adultOf } from './tmdb.hl'
64. import { isPlaceholderTitle, numberingAgrees, wantedSeasonNumbers, batchesOf, changedText, isMigratedRow } from './sync-helpers.hl'
66. // Merge TVmaze's episodes of a series into what we have AFTER the TMDB step (gaps only, rules at the top).
67. // `seasonsByNumber` / `epByNumber` = the show's seasons by number and episodes by '<s>x<e>', as the TMDB step left them.
68. // Answers { tvmazeRequests, newSeasons, newEpisodes, filledEpisodes, skipped, errors, error, showSeasons }.
69. static mergeTvmaze = (title, &showKey, tvmzId, seasonsIn, episodesIn, &showSeasonsIn) => {
70. seasonsByNumber = seasonsIn
71. epByNumber = episodesIn
72. out = { tvmazeRequests = 1 newSeasons = 0 newEpisodes = 0 filledEpisodes = 0 skipped = 0 errors = 0 error = '' showSeasons = showSeasonsIn summary = null status = null }
73. got = tvmazeEpisodes(tvmzId)
74. if (got.failed != null) { out.errors = 1 out.error = title + ': ' + got.failed return out }
75. out.summary = got.summary
76. out.status = got.status
77. // the numbered episodes TVmaze has in seasons we take (no specials; season 0 only when the show has one)
78. list = []
79. for (te of got.list) {
80. if (numIdOr(te.season) != null && numIdOr(te.number) != null) { list.push(te) }
81. else if (te.season == 0 && numIdOr(te.number) != null && seasonsByNumber['0'] != null) { list.push(te) }
82. }
83. if (!numberingAgrees(epByNumber, list).ok) { out.skipped = 1 return out }
85. added = {}
86. addedFirstDate = {}
87. for (te of list) {
88. let key = te.season + 'x' + te.number
89. let e = epByNumber[key]
90. if (e == null) {
91. let seasonKey = seasonsByNumber['' + te.season] != null ? seasonsByNumber['' + te.season].id : null
92. if (seasonKey == null) {
93. if (added['' + te.season] == null) { added['' + te.season] = [] addedFirstDate['' + te.season] = textOr(te.airdate) seasonsByNumber['' + te.season] = { id = newId() isNew = true } }
94. seasonKey = seasonsByNumber['' + te.season].id
95. }
96. let fresh = { id = newId() episodeNumber = te.number seasonNumber = te.season
97. title = textOr(te.name) summary = '' release = textOr(te.airdate)
98. show = showKey season = seasonKey tmdbId = null tvmzId = te.id oldId = 'tvmaze-episode:' + te.id }
99. if (episodesTable.put(fresh) == null) {
100. out.errors = out.errors + 1
101. out.error = title + ': TVmaze episode ' + te.id + ' not stored: ' + episodesTable.lastError()
102. } else {
103. if (added['' + te.season] == null) { added['' + te.season] = [] }
104. let l = added['' + te.season]
105. l.push(fresh.id)
106. added['' + te.season] = l
107. epByNumber[key] = fresh
108. out.newEpisodes = out.newEpisodes + 1
109. }
110. } else {
111. let changed = false
112. if (isPlaceholderTitle(e.title) && !isPlaceholderTitle(te.name)) { e.title = te.name changed = true }
113. if (textOr(e.release) == null && textOr(te.airdate) != null) { e.release = te.airdate changed = true }
114. if (changed) {
115. if (episodesTable.update(e.id, e) == null) {
116. out.errors = out.errors + 1
117. out.error = title + ': episode ' + e.id + ' not filled from TVmaze: ' + episodesTable.lastError()
118. } else {
119. epByNumber[key] = e
120. out.filledEpisodes = out.filledEpisodes + 1
121. }
122. }
123. }
124. }
125. // the seasons that got episodes: an existing one is updated, a new one stored and linked to the show
126. showSeasons = []
127. for (sid of showSeasonsIn) { showSeasons.push(sid) }
128. for (n of added.keys()) {
129. let ids = added[n]
130. let s = seasonsByNumber[n]
131. if (ids.length > 0 && s.isNew == true) {
132. let season = { id = s.id seasonNumber = toNumber(n) title = 'Season ' + n release = addedFirstDate[n] summary = ''
133. show = showKey episodes = ids oldId = 'tvmaze-season:' + tvmzId + ':' + n }
134. if (seasonsTable.put(season) == null) {
135. out.errors = out.errors + 1
136. out.error = title + ': TVmaze season ' + n + ' not stored: ' + seasonsTable.lastError()
137. } else {
138. showSeasons.push(season.id)
139. out.newSeasons = out.newSeasons + 1
140. }
141. } else if (ids.length > 0) {
142. let season = seasonsTable.fetch(s.id)
143. let eps = []
144. for (eid of season.episodes) { eps.push(eid) }
145. for (eid of ids) { eps.push(eid) }
146. season.episodes = eps
147. if (seasonsTable.update(season.id, season) == null) {
148. out.errors = out.errors + 1
149. out.error = title + ': season ' + season.id + ' not updated: ' + seasonsTable.lastError()
150. }
151. }
152. }
153. out.showSeasons = showSeasons
154. return out
155. }
157. // a MOVIE: one request — its imdb id (if missing) and its poster; nothing else of the record is touched. `pre` = that
158. // request's answer when the caller already made it (details.hl firstStep, tracker#26), else null
159. static syncMovie = (show, res, &pre) => {
160. out = res
161. out.requests = 1
162. details = pre != null ? pre : tmdbGet('/movie/' + show.tmdbId + '?append_to_response=external_ids,credits')
163. if (details.failed != null) { out.errors = 1 out.error = show.title + ': ' + details.failed return out }
164. if (pre == null) { out.details = details }
165. ids = externalIdsFor(show, details.external_ids, false, false)
166. out.ids = ids.filled
167. poster = syncPoster(show, details.poster_path)
168. out.requests = out.requests + poster.requests
169. out.posters = poster.saved
170. if (poster.failed != null) { out.errors = out.errors + 1 out.error = show.title + ': ' + poster.failed }
171. m = show
172. m.imdbId = ids.imdbId
173. m.image = poster.image
174. m.tmdbPoster = poster.tmdbPoster
175. if (adultOf(details) != null) { m.adult = adultOf(details) }
176. m.tmdbSync = now()
177. if (showsTable.update(m.id, m) == null) { out.errors = out.errors + 1 out.error = show.title + ': movie not updated: ' + showsTable.lastError() }
178. return out
179. }
181. // Sync ONE show (by our id). Answers counts: { requests, tvmazeRequests, newSeasons, newEpisodes, updatedEpisodes,
182. // updatedSeasons, posters, ids, tvmazeEpisodes, tvmazeSeasons, tvmazeFilled, tvmazeSkipped, errors, error } + `details` (the
183. // details answer with its credits when this call asked for it, else null — tracker#28: the caller stores the credits). Never throws for a TMDB failure — it is counted and the show left as is.
184. static syncShow = (&showId) => { return syncShowPart(showId, null, null) }
185. // the same with the details request (`/tv|movie/<id>?append_to_response=external_ids…`) already answered — `pre`, counted as
186. // this show's first request — so details.hl (tracker#26) asks TMDB once for details, ids AND the cast
187. static syncShowWith = (&showId, &pre) => { return syncShowPart(showId, pre, null) }
188. // ONE PART of a series' sync (tracker#26: a talk show with 4,000 episodes took 10 s in one step, blocking every request):
189. // `only` = { seasons (the TMDB season numbers of this part), finish (false: only those seasons — new ones linked to the show,
190. // nothing else; true: the ids, TVmaze, poster and the show record), tvmaze (false: no TVmaze lookup/merge — tracker#18's light
191. // step) }; null = everything at once. `pre` is required with `only` (its request is the caller's: a part counts only its own
192. // requests).
193. static emptyResult = () => { return { requests = 0 tvmazeRequests = 0 newSeasons = 0 newEpisodes = 0 updatedEpisodes = 0 updatedSeasons = 0 posters = 0 ids = 0 tvmazeEpisodes = 0 tvmazeSeasons = 0 tvmazeFilled = 0 tvmazeSkipped = 0 errors = 0 error = '' details = null } }
194. static syncShowPart = (&showId, &pre, &only) => {
195. let res = emptyResult()
196. show = showsTable.fetch(showId)
197. if (show == null) { res.errors = 1 res.error = 'no show ' + showId return res }
198. if (show.tmdbId == null) { res.errors = 1 res.error = show.title + ': no tmdbId' return res }
199. if (show.type == 'movie') { return syncMovie(show, res, pre) }
201. res.requests = only != null ? 0 : 1
202. details = pre != null ? pre : tmdbGet('/tv/' + show.tmdbId + '?append_to_response=external_ids,aggregate_credits')
203. if (details.failed != null) { res.errors = 1 res.error = show.title + ': ' + details.failed return res }
204. if (pre == null) { res.details = details }
206. // what we have: seasons by number, episodes by tmdbId and by S/E number
207. // (tracker#18: a part reads only ITS seasons' episodes, unless it finishes with the TVmaze merge, which compares them all —
208. // Today, 15,716 episodes, read them all for a one-season change: 20 s and GBs of memory)
209. tvmazeToo = only == null || only.tvmaze != false
210. allEpisodes = only == null || (only.finish && tvmazeToo)
211. seasonsByNumber = {}
212. epByTmdb = {}
213. epByNumber = {}
214. for (sid of show.seasons) {
215. let s = seasonsTable.fetch(sid)
216. if (s != null) {
217. seasonsByNumber['' + s.seasonNumber] = s
218. let epIds = allEpisodes || only.seasons.includes(s.seasonNumber) ? s.episodes : []
219. for (eid of epIds) {
220. let e = episodesTable.fetch(eid)
221. if (e != null) {
222. if (e.tmdbId != null) { epByTmdb['' + e.tmdbId] = e }
223. epByNumber[e.seasonNumber + 'x' + e.episodeNumber] = e
224. }
225. }
226. }
227. }
229. // plain locals for the record literals below: inside a literal, an entry named `show`/`season` would shadow
230. // the variable for every later entry (SPEC "A literal's entries are evaluated in order")
231. showKey = show.id
232. showTmdb = show.tmdbId
233. let showSeasons = []
234. for (sid of show.seasons) { showSeasons.push(sid) }
235. let showChanged = false
237. let wanted = wantedSeasonNumbers(details, seasonsByNumber)
238. if (only != null) {
239. part = []
240. for (n of wanted) { if (only.seasons.includes(n)) { part.push(n) } }
241. wanted = part
242. }
243. for (batch of batchesOf(wanted, 20)) {
244. let names = []
245. for (n of batch) { names.push('season/' + n) }
246. res.requests = res.requests + 1
247. let withSeasons = tmdbGet('/tv/' + show.tmdbId + '?append_to_response=' + names.join(','))
248. if (withSeasons.failed != null) {
249. res.errors = res.errors + 1
250. res.error = show.title + ': ' + withSeasons.failed
251. } else {
252. for (n of batch) {
253. let ts = withSeasons['season/' + n]
254. if (ts != null && ts.episodes != null) {
255. let season = seasonsByNumber['' + n]
256. let seasonIsNew = season == null
257. let seasonChanged = false
258. if (seasonIsNew) {
259. season = { id = newId() seasonNumber = n title = textOr(ts.name) != null ? ts.name : 'Season ' + n
260. release = textOr(ts.air_date) summary = textOr(ts.overview) != null ? ts.overview : ''
261. show = showKey episodes = [] oldId = 'tmdb-season:' + showTmdb + ':' + n }
262. } else {
263. let seasonMigrated = isMigratedRow(season)
264. if (changedText(season.title, textOr(ts.name))) {
265. if (seasonMigrated && season.migratedTitle == null && textOr(season.title) != null) { season.migratedTitle = season.title }
266. season.title = ts.name seasonChanged = true
267. }
268. if (changedText(season.summary, textOr(ts.overview))) {
269. if (seasonMigrated && season.migratedSummary == null && textOr(season.summary) != null) { season.migratedSummary = season.summary }
270. season.summary = ts.overview seasonChanged = true
271. }
272. if (changedText(season.release, textOr(ts.air_date))) { season.release = ts.air_date seasonChanged = true }
273. }
274. let seasonKey = season.id
275. let seasonEpisodes = []
276. for (eid of season.episodes) { seasonEpisodes.push(eid) }
277. // tracker#39: the episode ids TMDB lists in this season now — a stored one with an id not among them is stale
278. let listed = {}
279. for (te of ts.episodes) { if (te.id != null) { listed['' + te.id] = true } }
280. for (te of ts.episodes) {
281. if (te.id != null && te.episode_number != null) {
282. let e = epByTmdb['' + te.id]
283. if (e == null) {
284. let byNum = epByNumber[n + 'x' + te.episode_number]
285. if (byNum != null && (byNum.tmdbId == null || listed['' + byNum.tmdbId] != true)) { e = byNum }
286. }
287. if (e == null) {
288. let fresh = { id = newId() episodeNumber = te.episode_number seasonNumber = n
289. title = textOr(te.name) summary = textOr(te.overview) != null ? te.overview : '' release = textOr(te.air_date)
290. show = showKey season = seasonKey tmdbId = te.id oldId = 'tmdb-episode:' + te.id }
291. let putId = episodesTable.put(fresh)
292. if (putId == null) {
293. res.errors = res.errors + 1
294. res.error = show.title + ': episode ' + te.id + ' not stored: ' + episodesTable.lastError()
295. } else {
296. seasonEpisodes.push(fresh.id)
297. epByTmdb['' + te.id] = fresh
298. epByNumber[n + 'x' + te.episode_number] = fresh
299. res.newEpisodes = res.newEpisodes + 1
300. seasonChanged = true
301. }
302. } else {
303. let changed = false
304. if (e.tmdbId != te.id) {
305. if (e.tmdbId != null && e.migratedTmdbId == null) { e.migratedTmdbId = e.tmdbId }
306. if (e.tmdbId != null) { epByTmdb['' + e.tmdbId] = null }
307. e.tmdbId = te.id
308. changed = true
309. }
310. // #15: TMDB's "Episode 4" never replaces a real title (one TVmaze filled, or the migrated one)
311. let epMigrated = isMigratedRow(e)
312. if (changedText(e.title, textOr(te.name)) && !(isPlaceholderTitle(te.name) && !isPlaceholderTitle(e.title))) {
313. if (epMigrated && e.migratedTitle == null && textOr(e.title) != null) { e.migratedTitle = e.title }
314. e.title = te.name changed = true
315. }
316. if (changedText(e.summary, textOr(te.overview))) {
317. if (epMigrated && e.migratedSummary == null && textOr(e.summary) != null) { e.migratedSummary = e.summary }
318. e.summary = te.overview changed = true
319. }
320. if (changedText(e.release, textOr(te.air_date))) { e.release = te.air_date changed = true }
321. if (changed) {
322. if (episodesTable.update(e.id, e) == null) {
323. res.errors = res.errors + 1
324. res.error = show.title + ': episode ' + e.id + ' not updated: ' + episodesTable.lastError()
325. } else {
326. epByTmdb['' + e.tmdbId] = e
327. epByNumber[e.seasonNumber + 'x' + e.episodeNumber] = e
328. res.updatedEpisodes = res.updatedEpisodes + 1
329. }
330. }
331. }
332. }
333. }
334. season.episodes = seasonEpisodes
335. if (seasonIsNew) {
336. if (seasonsTable.put(season) == null) {
337. res.errors = res.errors + 1
338. res.error = show.title + ': season ' + n + ' not stored: ' + seasonsTable.lastError()
339. } else {
340. seasonsByNumber['' + n] = season
341. showSeasons.push(season.id)
342. showChanged = true
343. res.newSeasons = res.newSeasons + 1
344. }
345. } else if (seasonChanged) {
346. if (seasonsTable.update(season.id, season) == null) {
347. res.errors = res.errors + 1
348. res.error = show.title + ': season ' + season.id + ' not updated: ' + seasonsTable.lastError()
349. } else {
350. res.updatedSeasons = res.updatedSeasons + 1
351. }
352. }
353. }
354. }
355. }
356. }
358. // a part that is not the last: only the new seasons are linked to the show (the next part reads them)
359. if (only != null && !only.finish) {
360. if (showChanged) {
361. show.seasons = showSeasons
362. if (showsTable.update(show.id, show) == null) { res.errors = res.errors + 1 res.error = show.title + ': show not updated: ' + showsTable.lastError() }
363. }
364. return res
365. }
367. // the external ids (tracker.worldapi.org#12): missing ones from TMDB's external_ids, a missing TVmaze id from TVmaze
368. ids = externalIdsFor(show, details.external_ids, true, tvmazeToo)
369. res.ids = ids.filled
370. res.tvmazeRequests = ids.tvmazeRequests
371. if (ids.failed != null) { res.errors = res.errors + 1 res.error = show.title + ': ' + ids.failed }
373. // tracker.worldapi.org#15: what TVmaze has and TMDB not yet (new episodes/seasons, empty titles and air dates)
374. let tvmazeSummary = null
375. let tvmazeStatus = null
376. if (numIdOr(ids.tvmzId) != null && tvmazeToo) {
377. tvm = mergeTvmaze(show.title, showKey, ids.tvmzId, seasonsByNumber, epByNumber, showSeasons)
378. res.tvmazeRequests = res.tvmazeRequests + tvm.tvmazeRequests
379. res.tvmazeEpisodes = tvm.newEpisodes
380. res.tvmazeSeasons = tvm.newSeasons
381. res.tvmazeFilled = tvm.filledEpisodes
382. res.tvmazeSkipped = tvm.skipped
383. if (tvm.errors > 0) { res.errors = res.errors + tvm.errors res.error = tvm.error }
384. showSeasons = tvm.showSeasons
385. tvmazeSummary = tvm.summary
386. tvmazeStatus = tvm.status
387. }
389. // the show itself: status, counts, TMDB's overview, the poster, when it was synced
390. poster = syncPoster(show, details.poster_path)
391. res.requests = res.requests + poster.requests
392. res.posters = poster.saved
393. if (poster.failed != null) { res.errors = res.errors + 1 res.error = show.title + ': ' + poster.failed }
394. show.seasons = showSeasons
395. if (textOr(details.status) != null) { show.status = details.status }
396. if (details.number_of_seasons != null) { show.seasonsCount = details.number_of_seasons }
397. if (details.number_of_episodes != null) { show.episodesCount = details.number_of_episodes }
398. // tracker#18: TMDB's text → tmdbSummary, TVmaze's → tvmazeSummary; `summary` is the creator's own text, never written here
399. if (textOr(details.overview) != null) { show.tmdbSummary = details.overview }
400. if (tvmazeSummary != null) { show.tvmazeSummary = tvmazeSummary }
401. // tracker#35: TVmaze's status beside TMDB's (`status`) — the page's pill shows TVmaze's when there is one (fresher)
402. if (tvmazeStatus != null) { show.tvmazeStatus = tvmazeStatus }
403. show.image = poster.image
404. show.tmdbPoster = poster.tmdbPoster
405. show.imdbId = ids.imdbId
406. show.tvdbId = ids.tvdbId
407. show.tvmzId = ids.tvmzId
408. if (adultOf(details) != null) { show.adult = adultOf(details) }
409. if (textOr(details.type) != null) { show.tmdbType = details.type show.kind = kindOfTitle(details.type, show.genres) }
410. show.tmdbSync = now()
411. if (showsTable.update(show.id, show) == null) { res.errors = res.errors + 1 res.error = show.title + ': show not updated: ' + showsTable.lastError() }
412. return res
413. }
415. // ---- the LIGHT step of the daily delta run (tracker#18) ---------------------------------------------------------------
416. // A changed title NOBODY follows (dailysync.hl): its details (+ ids + credits: the record, applySynced) and only the seasons
417. // that can have changed — the ones we don't have, the ones where TMDB counts MORE episodes than we have (fewer: TVmaze's
418. // extras, nothing to fetch), and the newest one (new or renamed episodes land there). No TVmaze (its merge only matters for the followed shows' lists; their full step still does
419. // it). Real data (2026-10-01): Today (67 seasons / 15,716 episodes) and EastEnders (43 / 7,349) change every day; their full
420. // sync blocked the server 20.8 s each and grew the process by ~5 GB each.
421. static changedSeasonNumbers = (&details, &show) => {
422. ours = {}
423. for (sid of show.seasons) {
424. let s = seasonsTable.fetch(sid)
425. if (s != null) { ours['' + s.seasonNumber] = s.episodes.length }
426. }
427. let latest = -1
428. for (x of (details.seasons != null ? details.seasons : [])) {
429. if (x != null && x.season_number != null && x.season_number > latest && (x.episode_count == null || x.episode_count > 0)) { latest = x.season_number }
430. }
431. out = []
432. for (x of (details.seasons != null ? details.seasons : [])) {
433. if (x != null && x.season_number != null) {
434. let n = x.season_number
435. if (n == latest || ours['' + n] == null || (x.episode_count != null && x.episode_count > ours['' + n])) { out.push(n) }
436. }
437. }
438. return out
439. }
440. // tracker#35: `withStatus` — TVmaze's change list named this series too: its TVmaze status as well (one more TVmaze request)
441. static syncShowDelta = (&showId, &withStatus) => {
442. show = showsTable.fetch(showId)
443. if (show == null || show.tmdbId == null || show.type == 'movie') { return syncShow(showId) }
444. details = tmdbGet('/tv/' + show.tmdbId + '?append_to_response=external_ids,aggregate_credits')
445. if (details.failed != null) {
446. let res = emptyResult()
447. res.requests = 1
448. res.errors = 1
449. res.error = show.title + ': ' + details.failed
450. return res
451. }
452. r = syncShowPart(showId, details, { seasons = changedSeasonNumbers(details, show) finish = true tvmaze = false })
453. r.requests = r.requests + 1
454. r.details = details
455. if (withStatus) {
456. st = syncTvmazeStatus(showId)
457. r.tvmazeRequests = r.tvmazeRequests + st.tvmazeRequests
458. if (st.error != '') { r.errors = r.errors + 1 r.error = st.error }
459. }
460. return r
461. }
463. // tracker#35: TVmaze's status of ONE series (`GET /shows/<tvmzId>`, one TVmaze request) → `tvmazeStatus` when it changed — the
464. // daily delta run for a series nobody follows that TVmaze's change list names (a followed one gets TVmaze's merge, which
465. // brings it). Answers the sync's counts (emptyResult: tvmazeRequests, errors, error; no `details`).
466. static syncTvmazeStatus = (&showId) => {
467. let res = emptyResult()
468. show = showsTable.fetch(showId)
469. if (show == null || show.tvmzId == null || ('' + show.tvmzId).trim() == '') { return res }
470. res.tvmazeRequests = 1
471. got = tvmazeShow(show.tvmzId)
472. if (got.failed != null) { res.errors = 1 res.error = show.title + ': ' + got.failed return res }
473. if (got.status != null && got.status != show.tvmazeStatus) {
474. show.tvmazeStatus = got.status
475. if (showsTable.update(show.id, show) == null) { res.errors = 1 res.error = show.title + ': show not updated: ' + showsTable.lastError() }
476. }
477. return res
478. }
480. // flush the three tables' index/meta state to disk (after a run, and every few shows)
481. static persistSync = () => {
482. showsTable.persist()
483. seasonsTable.persist()
484. episodesTable.persist()
485. return true
486. }