Commit Graph

74 Commits

Author SHA1 Message Date
Dylan Knutson
3174032ac3 rake job fixes, optimize fa favs backfill 2025-09-10 16:30:51 +00:00
Dylan Knutson
5a20e4af98 Tasks::CreatePostFileFingerprintsTask conversion 2025-07-08 16:29:46 +00:00
Dylan Knutson
4f8a5cfcff Migrate create_post_file_fingerprints rake task to typed class
- Extract rake task logic into Tasks::CreatePostFileFingerprintsTask class
- Add full Sorbet strict typing with comprehensive method signatures
- Implement Mode enum with proper string serialization for execution modes
- Inherit from InterruptableTask for signal handling (SIGINT/SIGTERM)
- Add comprehensive test coverage with 24 examples covering all modes
- Update Rakefile to instantiate and use the new task class
- Support all existing execution modes: post_file_descending, posts_descending, user, users_descending
- Maintain backward compatibility with existing environment variable interface
2025-07-08 05:10:43 +00:00
Dylan Knutson
5ebd924780 favs scans backfill job 2025-06-27 21:37:02 +00:00
Dylan Knutson
3a06181db8 better job dedup key computation 2025-06-26 17:59:32 +00:00
Dylan Knutson
e3b2463cbe better progress bar, new thumbnails/fingerprints bust cache 2025-06-26 07:02:53 +00:00
Dylan Knutson
70c65ffdbd remove legacy Domain::{Fa,InkBunny,E621} model usage 2025-06-24 17:51:59 +00:00
Dylan Knutson
79a6fee997 rake task to compute user null counter caches 2025-06-23 19:54:58 +00:00
Dylan Knutson
7ee3b30180 incremental favs on user pages, user page enqueue job 2025-06-19 22:35:53 +00:00
Dylan Knutson
305ddd2cb6 visual fingerprinting 2025-03-11 01:06:58 +00:00
Dylan Knutson
a209c64149 create multiple fingerprints wip 2025-03-09 20:33:49 +00:00
Dylan Knutson
99fe3d951c create domain factors, similar posts/users sections implemented 2025-02-27 07:05:51 +00:00
Dylan Knutson
d237250c4b tweak to post scan enqueue logic 2025-02-21 22:36:07 +00:00
Dylan Knutson
9a779c1add lots of tweaks, thruster proxy 2025-02-20 22:07:45 +00:00
Dylan Knutson
8181628bb0 more e621 user fav migration tweaks 2025-02-20 02:04:42 +00:00
Dylan Knutson
d8eadfd416 specs for user favs scanning 2025-02-19 20:37:22 +00:00
Dylan Knutson
25a86d6464 separate out blob file migrator 2025-02-17 04:57:43 +00:00
Dylan Knutson
3285e56c10 more typing 2025-02-15 06:17:25 +00:00
Dylan Knutson
85075fbf68 script for fixing e621 posts 2025-02-13 21:18:54 +00:00
Dylan Knutson
e8f5b2ee92 GoodJob argument rendering, fix e621 post scanning, manual GoodJob execution by job class 2025-02-13 19:21:28 +00:00
Dylan Knutson
a09ddfa32b kaminari types, move views around 2025-02-13 07:35:08 +00:00
Dylan Knutson
51be64abba backfill user search names 2025-02-12 21:03:53 +00:00
Dylan Knutson
8fc32e64e9 migrate e621 jobs to unified domain models 2025-02-12 18:35:40 +00:00
Dylan Knutson
9c38bfce13 backfill fa posted_at field 2025-02-12 05:22:51 +00:00
Dylan Knutson
369fa71007 more migrating views, get user search working 2025-02-12 01:59:33 +00:00
Dylan Knutson
dd14f1d521 more migrating views over to new unified schema 2025-02-07 04:55:46 +00:00
Dylan Knutson
ea20ece8e2 migration script 2025-02-05 03:46:16 +00:00
Dylan Knutson
b62f7094f4 basic indexes fixed, migration script 2025-02-04 19:41:30 +00:00
Dylan Knutson
172f47b649 good_job cron for periodic tasks 2025-01-27 18:41:05 +00:00
Dylan Knutson
1cbc94b43c remove delayed_job, use structure.sql 2025-01-27 17:05:25 +00:00
Dylan Knutson
e781ed8f43 Enhance Inkbunny job processing and update post handling
- Updated Rakefile to enqueue periodic jobs for Inkbunny latest posts, improving background processing.
- Added a check in UpdatePostsJob to handle cases with empty post IDs, preventing unnecessary processing.
- Enhanced IndexedPost model to support posting dates for Inkbunny posts.
- Refined view for displaying indexed posts, improving the presentation of posting dates and user experience.
2024-12-30 21:57:32 +00:00
Dylan Knutson
15c11b2b89 Update blob entry handling and enhance staging configuration
- Changed the staging server port from 3000 to 3001 in the Procfile for better port management.
- Introduced a new BlobEntry model to replace BlobEntryP, ensuring a more consistent data structure across the application.
- Updated various controllers and views to utilize the new BlobEntry model, enhancing data retrieval and rendering processes.
- Added a new BlobEntriesController to manage blob entries, including a show action for retrieving content based on SHA256.
- Enhanced the Rakefile to enqueue periodic jobs for updating posts, improving background processing capabilities.
- Updated routes to reflect the new BlobEntry model and ensure proper resource handling.
- Improved tests for blob entry functionality, ensuring robust coverage and reliability in data handling.
2024-12-30 19:35:27 +00:00
Dylan Knutson
7a7cc84b94 more policy and auth work 2024-12-27 20:27:16 +00:00
Dylan Knutson
2381df7d10 indexed posts enums 2024-12-25 21:53:47 +00:00
Dylan Knutson
eca9b2e5cb fix specs, add migrator 2024-12-18 22:53:05 +00:00
Dylan Knutson
9de3c1b5e8 remove proxy code 2024-12-17 17:57:17 +00:00
Dylan Knutson
404baccbdf create inkbunny 2023-09-14 18:31:31 -07:00
Dylan Knutson
3f516938c2 update csv import job 2023-08-24 21:02:26 -07:00
Dylan Knutson
db258633cb add e621 to periodic tasks 2023-08-22 17:47:39 -07:00
Dylan Knutson
1e249e0ece add taggings to e621 posts 2023-08-22 17:44:03 -07:00
Dylan Knutson
3ccc08d0c7 add e621 posts job 2023-08-22 16:44:25 -07:00
Dylan Knutson
1a7b6c7c3c Home page job while browse page is protected 2023-07-07 11:08:08 -07:00
Dylan Knutson
63994d5a62 fa user and post controller cleanup 2023-05-21 18:55:16 -07:00
Dylan Knutson
79c2b9728e db sampler script for creating realistic development environment 2023-05-20 20:11:10 -07:00
Dylan Knutson
b608d3ed21 periodic tasks 2023-05-19 17:40:29 -07:00
Dylan Knutson
18a29fb57c remove unused proxies 2023-05-18 20:43:18 -07:00
Dylan Knutson
52320955b3 Blob entry migration util 2023-05-18 20:12:10 -07:00
Dylan Knutson
1e4a3905f5 Blob entry import/export helper 2023-05-18 18:13:48 -07:00
Dylan Knutson
1be5811e14 look at wildcard queues 2023-04-14 09:26:08 -07:00
Dylan Knutson
c387143134 fa_user_avatar queue working 2023-04-07 12:10:04 -07:00