tracker
All repositories: gitoria
14.4 KB
# hl:web — the web framework`hl:web` serves an app's pages from the server and keeps them live in the browser. It is writtenin Hybriel: `WebFramework.hl` is the server half, `client.hl` the browser half, and `compile.hl`turns each component's View into that component's own code. The model behind it (components,Views, realms, the boundary) is in [COMPONENTS.md](../../COMPONENTS.md). This page lists the rulesan app is held to. Each rule is a located refusal at boot unless it says otherwise.## Starting an app```hybrielimport WebFramework from 'hl:web'import Home from './components/home.hl'import Styles from './styles.hl'routes = [ { pattern = "/" component = Home } ]server = new WebFramework(routes = routes, styles = Styles, port = 8080)```Settings may be passed as named arguments. Most of them may instead be members of the file thatruns the `new`:| setting | default | meaning ||---|---|---|| `routes` | `[]` | the route table (below); pass it as an argument || `styles` | none | the app's styles file: the imported class, or a path string. It must be in the project graph || `port` | 8080 | the port to listen on || `host` | `HL_HOST`/`HOST`, else 0.0.0.0 | the interface to bind || `audience` | `{}` | per outward event, who receives it (see Events) || `minify` | false | one-line HTML and compact modules || `watchMode` | true | a saved `.hl` file re-analyses the app and reloads every open tab || `sessionDir` | `<app>/.sessions` | where sessions are stored; `false` keeps them in memory || `sessionMaxAge`, `sessionIdle`, `sweepInterval` | 14 days, 15 min, 5 min | the session clocks, in seconds || `sessionCookie` | `hlsid` | the cookie's name: letters, digits, `-` and `_` || `sessionSecure` | false | set the cookie's `Secure` flag (for an app behind https) || `appTitle`, `appDescription`, `appImage`, `appFavicon`, `meta` | none | the head every page gets unless it declares its own || `links` | none | a list of hybrids, one `<link>` each in every page's head (`{ rel = 'preconnect' href = '…' }`) || `appIcons`, `appShortName`, `appThemeColor`, `appBackgroundColor`, `appTouchIcon`, `appManifest` | none | make the app installable: a web app manifest, linked from every head (see Offline and installable) || `offline` | none | the pages kept offline: a service worker, their state in IndexedDB, a queue for their emits || `pingEvery`, `pongWithin` | 25, 10 | the dead-socket clock, in seconds: the browser pings every `pingEvery`, and a pong missing after `pongWithin` closes the socket and reconnects || `uploadMax` | 1 GiB | the largest file an emit may carry, in bytes (see Files in an emit) |An app runs on one web framework. If its files reach two packages that hold a `WebFramework.hl`(for example an old vendored copy beside this one), it is refused at boot, naming the import rowof each.## RoutesEach entry has a `pattern` (`/posts/:id`, `/assets/*`) and one kind:| kind | answers with ||---|---|| `component = Home` or `"./components/home.hl"` | the page, rendered on the server; the component must be imported by the app, and must declare a View || `function = (route, req) => { … }` | what the function returns (a Hybrid becomes JSON); `req.session` is the cookie's session, or null || `direct = "text"` | that text || `file = "./x"` | one file || `directory = "./assets"` | the files under a directory |A named group (`:id`) reaches the component as a construction argument of the same name: declare`id = null` at its root. A named wildcard does the same with the rest of the path:`/code/*path` gives `path = 'src/lib/util.hl'` for `/code/src/lib/util.hl`, on the first load andon a navigation. A bare `*` has no name a member could take; it is what a `directory` routeserves from.The request itself reaches a component the same way, and only one that declares the member(COMPONENTS.md): `session = null` gets the session, `host = null` the host without its port,`headers = null` the request's headers as a hash with lowercase names —`headers['accept-language']`. On a client navigation they are the headers of the request thenavigation crossed on, so they are still the browser's own: the socket's upgrade request, or the`POST /__hl/emit` under the fallback. `cookie`, `authorization` and `proxy-authorization` are leftout, because a member is state and state reaches page script.## ComponentsA component is a `.hl` file with a `View`. Its root members are its state, and are constructed onthe server for each request.**A View attribute is a literal, a member or a field path.** `href = "/"`, `href = url` and`href = p.url` are allowed. `href = '/posts/' + id` is refused at its line: declare`postUrl = '/posts/' + id` at the file's root and write `href = postUrl`. The same holds for avalue bound on a component reference (`Card { title = t }`) and for the condition of an `if` in aView, which may also be a `for` row variable.**An attribute name that is not an identifier is quoted.** `"aria-hidden" = "true"` and`"data-page" = it.target` render as written and bind like any attribute, in a `for` row too. AcamelCase name is not rewritten (`ariaHidden` renders as `ariaHidden`). `data-page = it.target`unquoted is refused at its line, naming the quoted form.**A bound attribute in a `for` row follows the row** on every update of the list: a new list, a`push`, an `upsert` and a write into a row's record (`items[0].title = …`) repaint it, as theyrepaint the row's text and class.**The tree carries the elements the HTML parser implies.** `table { tr { td { … } } }` is renderedas `table > tbody > tr > td`, because that is the tree the browser builds from the HTML, and thepage is continued from the tree the browser built. The pairs are listed in `view.hl`(`impliedElements`): `tr`, `td` and `th` under `table` get a `tbody`, `td` and `th` under `tbody`,`thead` or `tfoot` get a `tr`, and `col` gets a `colgroup`. Consecutive children that need the samecontainer share one.The other rules:- A View reads only names the file declares. A name it declares nowhere is refused.- `parent './main.hl'` wraps a page in a shell. The shell declares `slot = null` and places`slot` in its View exactly once. A component that is filled (`Card { p { … } }`) must declare aslot too.- `body { … }` is allowed only as the root of a View, and a page wrapped by a parent cannot haveone: the shell owns the body.- A View cannot render itself, directly or through other components.- A Style rule cannot be written on a component reference. Write it on an element inside thatcomponent.- A page's head comes from its members `__title`, `__description`, `__image`, `__favicon` and`__meta`, and falls back to the app's `appTitle`, `appDescription`, `appImage`, `appFavicon` and`meta`. A handler that writes one of them updates the document.## Events`on name(…)` handlers and `emit` statements cross between the browser and the server over aWebSocket on the app's own port. `POST /__hl/emit` is the fallback for a peer without a socket.A handler that takes `session` as its last parameter gets the connection's session from theserver, never from the peer.An outward event reaches the tab that caused it. To send it to other connections, give it an`audience` entry: a function of the event's arguments and the receiving connection's session thatanswers true or false.A value-form emit (`answer = emit server ask()`) waits for one answer, so it has one answerer.If two files in the target realm answer the event, it is refused.**A write anywhere repaints what it wrote** (tickets #98, #99), from the compiler's writesets, never by watching the members:- A listener repaints what its handler writes when the handler is done. A handler stillwaiting after the task that started it (a network answer, `new Promise(…)`) has itswrite set painted then too, so what it wrote before the wait shows while it waits.- A function made inside a component — an `XMLHttpRequest`'s `onload` or `onprogress`, atimer, a Promise's executor, a `then` — is compiled so that every return of it isannounced with the site it was made at. What it writes (a member, a push into one, afield inside one, and what the methods it calls and the events it emits write) isrepainted after the task that ran it. A function that writes no member repaints nothing.- A repaint the listener already made in the same task is not made twice.**After a face that takes `session`** (tickets #121, #122), the server re-derives themembers that read `session` for the tabs that mounted the component, with the page's ownroute params, and ships them in the ack (`sync`); the browser takes them as writes.- A member that reads `session` and calls an imported class, directly or through a localmethod or static, is computed on the server only and never re-derived in the browser.- Such a member is already up to date when the handler continues, so a client handler thatappends the face's returned row to a list derived from `session` shows it twice. Assignfrom what the sync brought, or leave the list to the sync.- A member derived from `session` that needs a server-only resource (a database) must reachit through an imported class or a static of one; a plain copy (`me = session.user.id`) isderived everywhere.### Files in an emitA browser `File` (an input's `ev.target.files[0]`, a dropped file) or a list of them(`ev.target.files`) may be an argument of an `emit server …`. It never rides the socket:before the emit goes out, the client half sends each file to `/__hl/upload` as its own HTTPrequests, with the page's session cookie, in parts of 1 MiB. The face gets the file in itsplace as `{ bytes, name, type, size }` (`bytes` a `Bytes`), or a list of those for a list:```hybrielinput { type = 'file' on change(ev) { emit send(ev) } }on send(ev) { saved = emit server saveFile(ev.target.files[0]) }on server saveFile(file) {writeFile('uploads/' + file.name, file.bytes)return file.size}```- **Progress.** While a file is sent, every mounted component that declares`on client uploadProgress(p)` gets `p = { event, index, name, sent, size }`: the emit'sevent, the file's position among the emit's files, its name, the bytes sent so far andits size.- **A dropped connection.** A part that did not come back is asked for again: the clientwaits (250 ms, doubling up to 4 s), asks the server how much of the file it has, and goeson from there. After 8 drops in a row it gives up.- **A failed upload ends the emit.** A file the server refuses (bigger than `uploadMax`, anupload of another session) or a connection that stays down ends the emit with that errorinstead of sending it — except a queueable emit in an offline app, which is queued with itsfiles when the connection is what failed (COMPONENTS §10): it gets the failed ack a failing face sends(`{ t: 'ack', i, ok: false, error }`), so a value-form emit answers null and the error islogged. The face does not run.- An upload belongs to the session that started it, and one emit takes it. An upload thatnothing takes within an hour is dropped. The parts are held in the server's memory untilthe emit takes them.## Offline and installableThe full model is [COMPONENTS.md §10](../../COMPONENTS.md). An app writes no JavaScript for anyof it.```hybrielappTitle = "Hybriel Notes"appIcons = [ { src = "/static/icon-192.png" sizes = "192x192" } { src = "/static/icon-512.png" sizes = "512x512" } ]offline = [ NoteList, NoteEditor ]```- `appIcons` (or `appManifest`, or `offline`) serves `/__hl/manifest.webmanifest` and links it,with an apple-touch-icon, from every page's head. `appManifest`'s entries are written over thegenerated manifest.- `offline` lists pages: route components, as classes or path strings. Anything else is refusedat its line. The framework generates the service worker and registers it. The shell and thelisted pages' documents are cached, and a navigation is network-first. What the server lastsaid about a listed page is kept in IndexedDB and shown over an older cached document. Astatement-form `emit server …` from a listed page that does not reach the server is queued andreplayed in order when the socket reopens. Each queued emit carries a stable id, and theserver runs it once: a replay whose ack was lost is answered again without running the handler(the last 200 ids per session are kept). A socket that goes silent without closing is noticedby the ping and reopened. A queued emit keeps its files: IndexedDB holds them with the entry,and they go up on the replay under the emit's id, once (COMPONENTS §10). A page thatdeclares `__hlQueued = 0` /`__hlQueue = []` shows the queue.- In any app, an emit in flight when its socket closes is sent again with its id over the POSTfallback or the next socket, and answered there (ticket #107). A page being left(`beforeunload`, `pagehide`) reopens nothing and posts nothing.- `import { notify, notifyAt, notifyIn } from 'hl:web'` shows a notification now, or at a time while the pageis open. A closed app cannot be woken at a set time without a server push.## What it serves| url | what ||---|---|| `/<file key>` (e.g. `/components/home.hl`) | a component's browser module || `/__hl/hl-runtime.js` | the runtime every module imports || `/__hl/web/client.js` | this package's browser half (other packages' halves are at `/__hl/<name>/client.js`) || `/__hl/app.css` | the one stylesheet, built from the styles file and every component's `Style` || `/__hl/emit` | the POST fallback for emits || `/__hl/manifest.webmanifest` | the web app manifest, for an installable app || `/__hl/sw.js`, `/__hl/web/worker.js` | the service worker's entry script and its compiled module, for an app with `offline` || `/__hl/upload` | a file of an emit, in parts (`POST` `{ name, type, size, q, n }` → `{ id, have }`, or `{ handled }` when the session handled emit `q` already; `POST ?id=&at=` one part → `{ have }`; `GET ?id=` → `{ have }`) |The page loads the modules and the stylesheet as `<url>?v=<hash>`, where the hash covers everything the build serves. A url with the current hash is sent with `Cache-Control: public, max-age=31536000, immutable`, and any other url with `no-cache`. A deploy therefore changes every url, and a tab that navigates into a newer build loads that page as a full document.An app's own `file` and `directory` routes keep the same url across deploys, so they answer with an `ETag` of the content and `Cache-Control: no-cache` (a route's own `Cache-Control` header replaces that). A request whose `If-None-Match` names the current tag gets a `304` with no body.
Branches
- mainmain branch
Latest commits
- 1ed5457etracker#20 + #21 (mission 068): typed headings "<Type> | <name>" in type colours; TV titles split into Series (/series) and Shows (/shows) by TMDB type + Reality/Talk/News genres — kind stored by sync/import/adult backfill + new kind backfill (resumes), /movies/<slug>, /shows/<slug> of a series/movie → 301, /my/series + /my/shows, home 5 tiles + 3 rows, search/filmography labels; gates kinds 32 + browser 266, tests/realdata-068.mjs, tools/count-kinds.hl, docs/kinds.md, README + STATUSmre
- fa1f9dfatracker#29 (mission 063): unwatched check muted grey outline + check (accent only on hover), watched stays solid — no code regression, the accent outline read as ticked; gate checks real checks visibly (computed style + screenshot pixel) on /my/unwatched, show, movie, /my/movies; gate 266, tests/realdata-063.mjs, README + STATUSmre
- d8b12d67tracker#27 (mission 060): short ids for movies, series and persons — old 702 kept (data/old-short-ids.json), new random [a-z0-9]{5} unique across both, claimed at creation, background backfill (resumes), shown under poster/photo, /<shortId> → 301; gate 259, tests/realdata-060*, README + STATUSmre
- f14db671tracker#22-#25 (mission 058): episode air dates, season check = all episodes watched, movie watched check (+ /my/movies count), /genres/<genre> pages (movies + series, newest first, paginated); gate 238, tests/realdata-058.mjs, README + STATUSmre
- 1704ec45tracker#17 (mission 057): season caret down/up, skeleton rows while a season loads, sessionless showSeasonEpisodes face (no page re-mount), client-only close; gate 214, tests/realdata-057.mjs, README + STATUSmre
- f2fe3e36mission 056: README + STATUS (merge, fixes, Hybriel 8590df63, real-data check), tests/realdata-056.mjs, tools/check-public-slugs.hlmre
- f40c250emission 056: re-vendor hybriel master 8590df63 (#121, #122); an adult title's page is Not found for non-followers; gate: leave the page before stopping the servermre
- 2b7fdd6cmission 056: signed-out header one row on phones ("Log in", nowrap), backfill skips adult titles' posters, gate checksmre
- 2c53d5efMerge branch 't16-person' (tracker#16 person pages) into main; filmography shows only public titles (054 adult flag), gate race fix (backfill start line)mre
- c171227emission 054: hide adult/unknown titles from the public lists and the search; in-app adult-flag backfill (TMDB details + poster per title, resumes), gate + real-data proofmre
- 139fafd8tracker#16: short bio (4 lines, click = all), real-data check script, README + STATUSmre
- 93be9476tracker#16: person pages /person/<slug> with the filmography fetched from TMDB on the first visit (step by step), gatemre
- 47a3cae6STATUS: mission 053 merge commit idsmre
- dcc5eecaMerge branch 't14-search'mre
- 03edc783Merge branch 't15-tvmaze'mre
- 71b46345tracker#15: numbering check by date or title, placeholder titles in other languages, docs + real-data proofmre
- 6bb2daf1tracker#13: homepage (tiles, intro, latest movies/shows), /shows, /movies/page/N, /my/movies; lists cached in memorymre
- b8bd1157tracker#14: README + STATUS (search, real-data numbers, gate, merge notes)mre
- 65c694a8tracker#14: search — header magnifier, /search/<text> (in-memory word-prefix index over titles + people), Fetch from web (TMDB search/multi, ours left out), Add = import via syncShow; gate +25 checks, real-data scriptmre
- 34f2c15btracker#15: TVmaze merge in the sync (gaps only: new episodes/seasons, empty titles/air dates; numbering check), fake TVmaze episodes + gatemre