Commit Graph

21 Commits

Author SHA1 Message Date
Simon
4f83dae3fa rule34video: drop per-video enrichment; add on-demand page resolver proxy (off)
Listings no longer fetch every video page for formats/tags/artist, which
ran into the site's 429 limit. /proxy/rule34video/{id}/{slug} resolves the
page at play time and 302s to the signed mp4; the resolver lives in
util/rule34video_resolve.rs. Handing out proxy URLs is gated behind
USE_MEDIA_PROXY, currently false.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01AEp724zDpCWNaSeCrMSvjx
2026-11-05 20:26:50 +00:00
Simon
aa00abdd5b rule34video: probe the space-less artist slug (e.g. /models/biggreen/) for multi-word queries
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MUYdCh2nCVsQYgJAT7gwSi
2026-10-27 21:45:09 +00:00
Simon
b131910ea2 rule34video: make queries robust (single-page results, safe search paths, 429-proof enrichment)
- Parser no longer requires a pagination block: single-page results
  (small tags, short searches) used to parse to zero items.
- Search path is slugged like the site's own form: "2b/9s" 404'd, "%20"
  is refused with 403 and "&" truncated the query.
- Probed archives need >= 4 videos to beat keyword search ("elf girl" was a
  one-video tag); conclusive query -> target resolutions are remembered for 6h
  so later pages and the prefetch skip the probes.
- Enriched details are cached per video URL for 2h (tokens last ~12h);
  detail fetches go through get_probe so a lasting 429 stops the batch instead
  of escalating each page to Jina/FlareSolverr. Archive failures serve stale
  cache.
- requester: get_probe waits before retrying 429/5xx and compares redirect
  paths percent-decoded (non-ASCII archives like /tags/pokémon-species/ were
  treated as redirected away); get_with_headers backs off 1/2/4s on 429.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MUYdCh2nCVsQYgJAT7gwSi
2026-10-21 20:17:58 +00:00
Simon
ad2abe0057 rule34video: artist, category and tag archives; resolve bare queries by probing; credit artists as uploader
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MUYdCh2nCVsQYgJAT7gwSi
2026-10-19 17:06:00 +00:00
Simon
316c317c81 Fix rule34video: thumbs, views and playback
Thumbs moved to data-rd-src, views to title="Views: ..", and yt-dlp no
longer resolves the page URL, so formats and tags come from the detail
page flashvars.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MUYdCh2nCVsQYgJAT7gwSi
2026-10-09 22:27:29 +00:00
Simon
d1a05de50e ytdlp command and xgroovy 2026-07-06 16:07:54 +00:00
Simon
ce1afd9873 status upgrade 2026-03-18 12:13:28 +00:00
Simon
2627505ade fixes and cleanup 2026-03-05 18:18:48 +00:00
Simon
8157e223fe provider refactors and fixes 2026-03-05 13:28:38 +00:00
Simon
27e2bcdbba fixes 2026-01-15 19:04:28 +00:00
Simon
cacd45d893 upgrades 2026-01-14 11:49:27 +00:00
Simon
d856ade32b adjusted requester to supply http::version itself 2025-11-30 06:53:21 +00:00
Simon
28a4c57616 overhault to fix warnings etc 2025-10-04 14:28:29 +00:00
Simon
24e4c5dfd7 cargo auto fix 2025-08-20 14:02:51 +00:00
Simon
d01436ab6a adapted proxies 2025-08-19 10:43:41 +00:00
Simon
0f2983ca15 delete hentaihavem (not possible) + bugfix on rule34video 2025-08-18 10:03:29 +00:00
Simon
97066a184a all provider 2025-08-10 14:02:09 +00:00
Simon
3feeb02251 testing and fixing 2025-08-09 12:21:43 +00:00
Simon
62f467ca68 fixed bug on rule34video 2025-08-03 16:25:45 +00:00
Simon
d1a4975aa3 removed proxies 2025-08-01 14:42:04 +00:00
Simon
e18e4da559 rul34video 2025-07-20 09:10:07 +00:00