109 Commits

Author SHA1 Message Date
Dylan Knutson
3174032ac3 rake job fixes, optimize fa favs backfill 2025-09-10 16:30:51 +00:00
Dylan Knutson
7f7728366b Sep 2025 posted_at fixes 2025-09-07 18:27:22 +00:00
Dylan Knutson
a1fab9e645 bmp support, buggy fa user, url decode usernames 2025-08-16 04:44:04 +00:00
Dylan Knutson
1058a53d18 montior hashtag impl 2025-08-14 20:48:19 +00:00
Dylan Knutson
ca937eb2bc process mp4 file thumbnailing 2025-08-14 18:16:14 +00:00
Dylan Knutson
e9ac97be29 split out common bsky post creation logic into Bluesky::ProcessPostHelper 2025-08-14 17:55:17 +00:00
Dylan Knutson
cfffe50541 add monitor scanned at to bsky monitor 2025-08-14 17:16:21 +00:00
Dylan Knutson
390f0939b0 video post downloading 2025-08-12 00:24:32 +00:00
Dylan Knutson
eba4b58666 feat: implement Bluesky scan posts job and enhance user scanning
- Add new ScanPostsJob for scanning Bluesky posts
- Enhance ScanUserJob with improved error handling and logging
- Update BlueskyPost model with new fields and validation
- Add auxiliary tables for Bluesky posts
- Improve job base classes with better color logging
- Update specs with proper HTTP mocking patterns
- Add factory for BlueskyPost testing
2025-08-10 18:41:01 +00:00
Dylan Knutson
5f5a54d68f Add Bluesky user scanning job and related infrastructure
- Add Domain::Bluesky::Job::ScanUserJob for processing user media
- Add Domain::Bluesky::Job::Base as parent class for Bluesky jobs
- Update BlueskyUser and BlueskyPostFile models with media handling
- Add migration for Bluesky media fields in post_files table
- Update StaticFileJob to handle Bluesky media downloads
- Add comprehensive test coverage for new functionality
- Update Sorbet RBI files for type checking
2025-08-08 05:07:07 +00:00
Dylan Knutson
24a59d50f2 telegram bot logs, first pass 2025-08-05 05:05:21 +00:00
Dylan Knutson
572c61cebb add proxies 2025-07-23 04:51:44 +00:00
Dylan Knutson
537821a1a9 remove BlobEntry model 2025-07-21 19:30:44 +00:00
Dylan Knutson
e67eb94e44 add HasAuxTable 2025-07-18 06:23:40 +00:00
Dylan Knutson
878ca2fe32 fix progress saving for for-user backfill_favs_and_dates_task 2025-07-15 01:19:45 +00:00
Dylan Knutson
c37e3c1024 refactor to put fav_id on FaUserPostFav 2025-07-11 03:34:39 +00:00
Dylan Knutson
acc2f9a240 refactoring regression model code 2025-07-11 01:45:39 +00:00
Dylan Knutson
9f1fc93267 trained regression model evaluation 2025-07-10 22:40:35 +00:00
Dylan Knutson
0e262f99b9 add tests for expression 2025-07-10 22:19:34 +00:00
Dylan Knutson
5f81edea92 more equastion refactoring 2025-07-10 21:59:31 +00:00
Dylan Knutson
58b8321333 Add FA favorites backfill task with date tracking
- Add BackfillFavsAndDatesTask for systematic favorites/dates processing
- Enhance FavsJob with FavsAndDatesStats for date tracking
- Add supporting utilities and parser improvements

This enables robust collection and backfill of user favorites with associated dates.
2025-07-10 17:07:14 +00:00
Dylan Knutson
d14dc6d3c1 Domain::FaFavIdAndDate for tracking when fa favs are made 2025-07-10 01:17:30 +00:00
Dylan Knutson
c5b4374def detect tz based on logged in user 2025-07-09 23:45:45 +00:00
Dylan Knutson
9a4b1b891d compute timezone offset for submission posted at times 2025-07-09 22:35:24 +00:00
Dylan Knutson
7f57d4363f compute timezone offset from difference between requested_at and server local time 2025-07-09 21:57:00 +00:00
Dylan Knutson
5a20e4af98 Tasks::CreatePostFileFingerprintsTask conversion 2025-07-08 16:29:46 +00:00
Dylan Knutson
4f8a5cfcff Migrate create_post_file_fingerprints rake task to typed class
- Extract rake task logic into Tasks::CreatePostFileFingerprintsTask class
- Add full Sorbet strict typing with comprehensive method signatures
- Implement Mode enum with proper string serialization for execution modes
- Inherit from InterruptableTask for signal handling (SIGINT/SIGTERM)
- Add comprehensive test coverage with 24 examples covering all modes
- Update Rakefile to instantiate and use the new task class
- Support all existing execution modes: post_file_descending, posts_descending, user, users_descending
- Maintain backward compatibility with existing environment variable interface
2025-07-08 05:10:43 +00:00
Dylan Knutson
a2460a5327 blob file migration task refactor 2025-07-08 02:52:57 +00:00
Dylan Knutson
0427ac43c7 bootsnap, spring, sofurry type fixes 2025-07-08 01:25:00 +00:00
Dylan Knutson
5a9efa798d more sofurry fixes 2025-07-01 21:02:23 +00:00
Dylan Knutson
66d1e06b4b sofurry user/gallery/post scanning 2025-07-01 19:16:44 +00:00
Dylan Knutson
ca5649a28f initial sofurry impl 2025-06-28 18:46:45 +00:00
Dylan Knutson
3a06181db8 better job dedup key computation 2025-06-26 17:59:32 +00:00
Dylan Knutson
70c65ffdbd remove legacy Domain::{Fa,InkBunny,E621} model usage 2025-06-24 17:51:59 +00:00
Dylan Knutson
85c4c7e75c FurArchiver fallback for FA posts missing media 2025-06-24 02:19:51 +00:00
Dylan Knutson
7ee3b30180 incremental favs on user pages, user page enqueue job 2025-06-19 22:35:53 +00:00
Dylan Knutson
94533b6e45 FA submission pages no longer have gender field 2025-06-18 15:53:53 +00:00
Dylan Knutson
305ddd2cb6 visual fingerprinting 2025-03-11 01:06:58 +00:00
Dylan Knutson
55f806c5b4 factor out resizing logic 2025-03-09 22:40:37 +00:00
Dylan Knutson
7453db4ba5 tweaks for march 2025 user page updates 2025-03-04 17:30:27 +00:00
Dylan Knutson
a98d9c49ee user page job improvement for skipping gallery scans 2025-03-02 19:28:47 +00:00
Dylan Knutson
9256d78bf5 improve cache busting based on policy 2025-03-02 07:45:07 +00:00
Dylan Knutson
7048b3002d better behavior for users that are not found 2025-02-28 21:51:29 +00:00
Dylan Knutson
a296688123 move entirely to BlobFile 2025-02-25 19:59:41 +00:00
Dylan Knutson
3490e28cb4 enqueue from links 2025-02-25 05:47:44 +00:00
Dylan Knutson
b1cefa763f more precise fa job priorities 2025-02-25 02:57:44 +00:00
Dylan Knutson
44209ac89b make sorbet structs comparable 2025-02-17 19:35:45 +00:00
Dylan Knutson
25a86d6464 separate out blob file migrator 2025-02-17 04:57:43 +00:00
Dylan Knutson
3285e56c10 more typing 2025-02-15 06:17:25 +00:00
Dylan Knutson
51be64abba backfill user search names 2025-02-12 21:03:53 +00:00