clo/sitegen
1
0
Fork 0
Code Issues 16 Pull requests Projects Releases Packages Wiki Activity Actions

file scanner 3 #15

New issue
Open
opened 2025-06-22 11:47:38 -07:00 by clo · 0 comments
clo commented 2025-06-22 11:47:38 -07:00
Owner
Copy link
  • rewritten file scanner
    • indexing logic but a better system for "please run these processes on these extensions"
    • directory processing
    • new media proxy and backend
    • process read duration
    • process read dimensions
    • process run syntax highlighter
    • process copy contents
    • process alternate image resolutions (encode 200w, 512w, 1000w; jxl, avif, web)
    • process videos
      • av1, webm
      • ultra (basically no loss), high (reasonable 1080p), medium (average user), low (slow), and data-saver (0.5mbps)
  • "source of truth" server
    • derived assets
    • authentication for private files
    • detect database changes via web socket
  • new cache layer in paperclover.net (hopefully fixing edge cases where files hang)
    • "smart" prefetching rules
      • for a video page, queue up all of the playlist files
      • for a playlist file, queue up the first three chunks
      • for a video chunk, queue up the next three chunks.
      • for image page, send the viewport size in a header to prefetch the file content
      • viewing partial pages should prefetch
  • frontend for videos
    • does it need a master playlist?
    • make sure hls.js works for chrome firefox. seeking, quality selection
    • make sure it works in safari. seeking, quality selection.
  • component for optimizied images
    • in file viewer
    • in blog
- [x] rewritten file scanner - [x] indexing logic but a better system for "please run these processes on these extensions" - [x] directory processing - [x] new media proxy and backend - [x] process read duration - [x] process read dimensions - [x] process run syntax highlighter - [x] process copy contents - [x] process alternate image resolutions (encode 200w, 512w, 1000w; jxl, avif, web) - [x] process videos - av1, webm - ultra (basically no loss), high (reasonable 1080p), medium (average user), low (slow), and data-saver (0.5mbps) - [x] "source of truth" server - [x] derived assets - [x] authentication for private files - [ ] detect database changes via web socket - [ ] new cache layer in paperclover.net (hopefully fixing edge cases where files hang) - [ ] "smart" prefetching rules - [ ] for a video page, queue up all of the playlist files - [ ] for a playlist file, queue up the first three chunks - [ ] for a video chunk, queue up the next three chunks. - [ ] for image page, send the viewport size in a header to prefetch the file content - [ ] viewing partial pages should prefetch - [ ] frontend for videos - [ ] does it need a master playlist? - [ ] make sure hls.js works for chrome firefox. seeking, quality selection - [ ] make sure it works in safari. seeking, quality selection. - [ ] component for optimizied images - [ ] in file viewer - [ ] in blog
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
typefix
No results found.
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: clo/sitegen#15
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?