gitoriaLog in with ident

tracker

All repositories: gitoria

ReadmeCodePull requestsReleasesTicketsSettings
Main branchmain5cb85d75deploy.sh: a backup taken while a background job writes (tar exit 1) is a warning; archive checked with gzip -tmremain/plugins/mpackdb/MPackDB.hl

4.0 KB

  1. \* hl:mpackdb — the MessagePack file database. Construct it and it opens
  2. (the file root IS the constructor):
  3. db = new MPackDB(file = '/tmp/users.db', primaryKey = '*id',
  4. indexes = ['!email', 'age'])
  5. Key prefixes follow the JS API: `*name` auto-increment number pk (a fresh
  6. table counts from 1; an existing one keeps its stored counter), `@name`
  7. uuid pk, plain `name` string pk; a LEADING `!` on an index makes it
  8. unique, `*`/`@` on an index select numeric/uuid key parsing. On-disk
  9. format is compatible with the JS mpackdb 1.0.7 — a db written by either
  10. side is readable and mutable by the other. *\
  11. /* Wraps the Zig engine (plugins/mpackdb/{msgpack,engine}.zig, mission 066).
  12. `>` / `<>` hydration does NOT run the run body — construct with args. */
  13. \* The database is open (fired from the constructor's run body). *\
  14. emit opened(
  15. MPackDB db \\ this database
  16. )
  17. \* Opening failed. *\
  18. emit error(
  19. Hybrid e \\ the failure
  20. )
  21. \* close() finished. *\
  22. emit closed(
  23. MPackDB db \\ this database
  24. )
  25. String file = "" \\ the .db path, script-relative
  26. String primaryKey = "" \\ pk declaration: *name | @name | name | '' for none
  27. Hybrid indexes = [] \\ index declarations, '!' prefix = unique
  28. Boolean compact = true \\ compact the file on open
  29. Hybrid #handle
  30. String #pk \\ the primary key FIELD NAME, prefixes stripped (null when none)
  31. open() {
  32. #handle = __native("mpackdb.open", file, primaryKey, indexes, compact)
  33. if (#handle != null) {
  34. #pk = #handle.pk_name()
  35. emit opened(this)
  36. } else {
  37. emit error(new Error("mpackdb: cannot open " + file))
  38. }
  39. }
  40. open()
  41. \* The primary key field name, prefixes stripped (null when none). *\
  42. pkField() {
  43. return #pk
  44. }
  45. \* Insert one record. Answers the primary key it was stored under (a
  46. generated one for `*`/`@` pks), true for a pk-less db, or null on failure
  47. — lastError() has the reason (e.g. a unique-index violation). *\
  48. put(
  49. Hybrid record \\ the record to store
  50. ) {
  51. return #handle.insert(record)
  52. }
  53. \* First record with this primary key, or null. (Named fetch(), not get():
  54. `get` is reserved for getter syntax.) *\
  55. fetch(key) {
  56. let it = #handle.find_pk(key)
  57. if (it == null) {
  58. return null
  59. }
  60. let first = it.next()
  61. // run it to its end: the plugin frees what the lookup read there (hybriel#126)
  62. while (it.next() != null) {}
  63. return first
  64. }
  65. \* Raw iterator over matches. field null → every live record; the pk and any
  66. declared index are binary-searched — other fields need an index declared. *\
  67. iterate(field, value) {
  68. if (field == null) {
  69. return #handle.find_all()
  70. }
  71. if (field == #pk) {
  72. return #handle.find_pk(value)
  73. }
  74. return #handle.find_index(field, value)
  75. }
  76. \* All matching records as a Hybrid; find(null) answers everything. *\
  77. find(field, value) {
  78. return drain(iterate(field, value))
  79. }
  80. \* Ascending index range scan, both bounds inclusive; null bound = open end. *\
  81. range(field, low, high) {
  82. return drain(#handle.find_range(field, low, high))
  83. }
  84. \* Lazy Cursor over the same matches — records decode one at a time. *\
  85. cursor(field, value) {
  86. return {
  87. #iter = iterate(field, value);
  88. } > new Cursor()
  89. }
  90. \* Delete every record with this primary key; answers how many went. *\
  91. delete(key) {
  92. return #handle.delete_pk(key)
  93. }
  94. \* Replace the record(s) at this pk. `record` must carry the pk (the JS
  95. update() contract); answers how many were replaced. A record without it
  96. is refused — null, the stored record untouched, lastError() says why. *\
  97. update(key, record) {
  98. return #handle.update_pk(key, record)
  99. }
  100. \* Live record count. *\
  101. count() {
  102. return #handle.count()
  103. }
  104. \* Rewrite the data file without tombstones and rebuild the indexes. *\
  105. compactNow() {
  106. #handle.compact()
  107. }
  108. \* Flush meta/index state to disk now. *\
  109. persist() {
  110. #handle.persist()
  111. }
  112. \* Reason for the last failed put/update ('' when none). *\
  113. lastError() {
  114. return #handle.last_error()
  115. }
  116. \* Close the database; the closed event fires. *\
  117. close() {
  118. #handle.close()
  119. emit closed(this)
  120. }
  121. // Internal: collect an iterator into an array.
  122. drain(it) {
  123. let out = []
  124. if (it == null) {
  125. return out
  126. }
  127. for (rec of it) {
  128. out.push(rec)
  129. }
  130. return out
  131. }

Branches

Latest commits

  • 5cb85d75deploy.sh: a backup taken while a background job writes (tar exit 1) is a warning; archive checked with gzip -tmre
  • 9abda75dtracker: report 035mre
  • 12595e47mission 035: theme re-vendored from layouts.worldapi.org 0222f67 (two corner radii: radiusSmall 5px, radiusLarge 10px); the tracker's 18 own radii -> radiusSmall/radiusLarge (--layout-radius is gone); check-theme 0; gates 379/0, 32/0, 53/0, 229/0, 26/0; real copy: every computed radius in {0, 5px, 10px, 50%}mre
  • e7305014tracker: report 032 (art + photos)mre
  • fbb903cctracker#33/#37 (mission 032): a title without a TMDB poster gets its backdrop (w780, posterFromBackdrop, shown 2:3 centre-cropped); movies store runtime, the page shows release date + runtime; art backfill (public titles without poster file / movies without runtime) and person photo backfill (tmdbProfile / photoCheck) as the last start jobs (TRACKER_ART, TRACKER_PHOTOS; off in every gate start); gates 379/0, 32/0, 53/0, 229/0, 26/0, check-theme 0; live copy: art 4977 titles in 42 min (115 posters, 15 backdrops, 4609 runtimes), The Remaining shows its backdrop + 7 minmre
  • 4ecc67b2tracker: STATUS/LOG for the t38 + t40 merge (gates 374/0, 32/0, 53/0, 229/0, 26/0, check-theme 0; live copy checks)mre
  • e5945d2fMerge t40 (tracker#40 curated franchises, Franchises menu, superseded collections) into main: deploy.sh lists all six gates (browser, kinds, franchises, pager, franchiseseed, check-theme); search.hl keeps #37's personPhotoOf + #40's importWithCredits; pager gate runs with TRACKER_FRANCHISE_SEED=0; gates 374/0, 32/0, 53/0, 229/0, 26/0, check-theme 0mre
  • b638e99dMerge t38 (tracker#38 pagination, #35 Returning/Airing label) into main: LOG/STATUS keep both sides; pager gate follows #37's /people (everyone, last updated first: seed updatedAt); gates pager 229/0, browser 374/0mre
  • f8ffa4dbtracker: report 032 + The Remaining + #39mre
  • 7565a863tracker: LOG timemre
  • b10f00c8tracker#39: double episodes — migrated episodes whose TMDB id TMDB replaced are adopted by their number in the sync (old id -> migratedTmdbId); merge.hl step 3 merges each season's doubles at start (keeper: most watches > synced > first; watches moved/parked; tombstones into mergedEpisodes, nothing deleted); tools/count-duplicate-episodes.hl; gate fixture + paths-m039; live copy 850 -> 0 in 64 s; gates 373/0, 32/0, 52/0mre
  • 8f1d4542tracker#40: superseded collections — a TMDB collection timeline whose titles are all in one curated timeline is hidden (supersededBy; kept: own page + editor finder), set by the collection seed when it makes one and by the curated build (lifted when the cover is gone); partly covered ones join that franchise; no second widget (First Contact: only Star Trek — Prime); gate franchiseseed 26/0, browser 365/0, kinds 32/0, franchises 53/0, check-theme 0; real copy 24 supersededmre
  • 9448d643tracker#35 follow-up (mission 033): TVmaze 'Running' is labelled 'Returning', or 'Airing' while a non-special episode of the two newest seasons is released within today +-7 days (data unchanged); gate fixtures Running/Airing/Aired + a special; browser 366/0, kinds 32/0, franchises 52/0, pager 229/0, check-theme 0mre
  • 7d4b293dtracker#40: "Franchises" in the main menu (desktop header after People, phone sidebar) → /franchises, marked on franchise and timeline pages; gates 365/0, 32/0, 53/0, 24/0, check-theme 0mre
  • 8751adb8tracker: report 032mre
  • 9bce1f65tracker mission 032: STATUS gate files + the hour-boundary flakemre
  • 718bfb89tracker#37 (mission 032): /people = everyone, last updated first (updatedAt stamped by the person fill; view built at boot, touched people first at once), photo + name tiles (person colour) with the /movies pagination, /people/<letter> removed; photo = our file, tmdbProfile, a cast/crew entry's profile (in-memory map at boot), else the new 'no photo' placeholder; new cast/crew/created_by people keep tmdbProfile; search people rows with the photo; /settings = the heading only; util.hl sortDesc starts from sorted runs (same result, 105k: 1.6 s -> 0.15 s); gates 369/0, 32/0, 52/0, check-theme 0; README/STATUS/LOGmre
  • 93dfb0batracker#40 (mission 034): the curated franchises — data/franchises.json (17 franchises, 31 timelines, 285 TMDB titles, movies + series, in-universe/release order, 12 TMDB collections attached); lib/franchiseseed.hl + jobs.hl franchiseSeedTick (last start job, imports missing titles via details.hl importWithCredits = the search's Add, one per step paced, then one build; franchiseseed.db: editor changes win, the creator's same-name franchise adopted / timeline left alone, 404 remembered, resumable, idempotent); timeline heads 'N titles · in-universe order' (orderKind) and wrap on a phone; series pages show the widget; new gate tests/franchiseseed.mjs (5th in deploy.sh), the others run with TRACKER_FRANCHISE_SEED=0; gates 365/0, 32/0, 52/0, 24/0, check-theme 0; real copy 196 imported, 0 failed, 7 min, restart unchanged=31mre
  • 03ec792ftracker#38 (mission 033): pagination goes exactly to the clicked page — tilelist read the clicked button's text after pagination.hl's own handler had rebuilt the buttons (real clicks only); now li.current, else the button's own text; new gate tests/pager.mjs (5 lists x 11 pages, 390/1280, real + script clicks, Back/Forward) 229/0; browser 365/0, kinds 32/0, franchises 52/0, check-theme 0mre
  • 96ba683adeploy.sh: a gate without a 'passed,' line (check-theme) no longer ends the scriptmre