dymk/redux-scraper
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
696 Commits 5 Branches 0 Tags
main
Commit Graph

198 Commits

Author SHA1 Message Date
Dylan Knutson
a76b10634e more migration of fa user favs to own table 2025-08-20 04:58:06 +00:00
Dylan Knutson
4830a4ce54 separate table for fa post favs 2025-08-19 01:22:56 +00:00
Dylan Knutson
a68e5b0112 bsky fixes, ib missing post enqueuer 2025-08-18 16:28:53 +00:00
Dylan Knutson
cdcd574d02 monitor bsky user button 2025-08-16 21:27:55 +00:00
Dylan Knutson
c1b63275e8 show number of files associated with post if > 1 2025-08-16 19:23:35 +00:00
Dylan Knutson
b6e2e5e502 Update telegram bot task, user view, and type definitions 
- Modified telegram bot task implementation
- Updated domain users index view
- Updated telegram-bot-ruby type shims
 2025-08-15 05:59:11 +00:00
Dylan Knutson
3c83ed3ba7 fixes for bsky monitoring 2025-08-14 21:13:37 +00:00
Dylan Knutson
62f14d10d4 visual search fixes 2025-08-14 19:29:28 +00:00
Dylan Knutson
cfffe50541 add monitor scanned at to bsky monitor 2025-08-14 17:16:21 +00:00
Dylan Knutson
1d248c1f23 user follows/followed by scans for bluesky 2025-08-14 17:03:50 +00:00
Dylan Knutson
b33a267a83 by descending post id 2025-08-13 08:20:32 +00:00
Dylan Knutson
dea2071662 better user list 2025-08-12 22:52:52 +00:00
Dylan Knutson
6df6f63060 bsky user registerd at scanning 2025-08-12 22:27:22 +00:00
Dylan Knutson
420a44a27d bsky page scanning auditing 2025-08-12 21:56:05 +00:00
Dylan Knutson
2de7f85a99 bsky descriptions with newlines 2025-08-12 21:33:40 +00:00
Dylan Knutson
ad0675a9aa Add Bluesky post helper with facet rendering and external link support 
- Add BlueskyPostHelper for rendering Bluesky post facets (mentions, links, hashtags)
- Implement facet parsing and rendering with proper styling
- Add external link partial for non-Bluesky URLs
- Update DisplayedFile and PostFiles components to handle Bluesky posts
- Add comprehensive test coverage for helper methods
- Update scan user job to handle Bluesky-specific data
 2025-08-12 20:43:08 +00:00
Dylan Knutson
d08c896d97 show reply / quotes for bsky posts 2025-08-12 18:31:17 +00:00
Dylan Knutson
127dd9be51 Add Bluesky file display components and utilities 
- Add SkySection component for displaying Bluesky-specific file information
- Add byteCountToHumanSize utility for formatting file sizes
- Update PostFiles, FileCarousel, FileDetails, and DisplayedFile components
- Enhance posts helper with file display logic
- Update post model and view templates
- Remove deprecated file details sky section partial
 2025-08-12 18:14:13 +00:00
Dylan Knutson
40c6d44100 Convert ScanPostsJob tests to use SpecUtil.enqueued_job_args and add rescan tests 
- Convert existing job mocking to use SpecUtil.enqueued_job_args helper
- Remove allow(Domain::StaticFileJob).to receive(:perform_later) mocking
- Add comprehensive test context for rescanning users with pending files
- Create domain_post_file_bluesky_post_file factory for test objects
- Add tests verifying enqueue_pending_files_job behavior during rescans
- Ensure only pending files get jobs enqueued, not already processed files
- Use force_scan: true to bypass scan frequency limits in tests
 2025-08-10 20:49:26 +00:00
Dylan Knutson
f2f8a9c34a Refactor PostFiles component to use URL parameters and simplify implementation 
- Change from hash fragments (#file=2) to URL parameters (?idx=2) for server-side prerendering support
- Simplify React component by removing complex client-side hydration logic
- Remove unnecessary props: totalFiles, hasMultipleFiles (derive from files.length)
- Remove redundant useCallback and popstate handlers
- Update Rails helper to read URL parameter and pass correct initialSelectedIndex
- Maintain all functionality: carousel, keyboard navigation, URL state management
 2025-08-09 00:59:26 +00:00
Dylan Knutson
36ceae80fe Refactor file carousel into React component hierarchy 
- Create PostFiles top-level component managing file display state
- Add FileCarousel component for thumbnail navigation
- Add DisplayedFile component for content rendering
- Add FileDetails component for metadata display
- Update props_for_post_files helper to generate HTML content server-side
- Replace HTML/JS carousel with prerendered React components
- Maintain single file layout compatibility
- Add proper TypeScript interfaces and error handling
- Register components in application and server bundles

Components now handle:
- Multiple file carousel display above content
- File content switching via React state
- Server-side rendered HTML injection
- File details metadata display
- Responsive thumbnail grid with selection states
 2025-08-09 00:31:07 +00:00
Dylan Knutson
e30e20b033 tests for bsky posts 2025-08-08 00:40:28 +00:00
Dylan Knutson
fe2f6e8b90 Add telegram bot configuration views and policy methods 
- Add telegram_config.html.erb view to display current bot token (masked)
- Add edit_telegram_config.html.erb view for editing configuration
- Update index.html.erb to include 'Manage Telegram Config' navigation
- Add missing edit_telegram_config? and update_telegram_config? policy methods

All views follow established patterns from FA/IB cookie management.
Tests pass: 1011 examples, 0 failures.
 2025-08-05 06:44:25 +00:00
Dylan Knutson
e78baa6594 Refactor Telegram bot logs with performance enhancements and view improvements 
- Add comprehensive file information display (content type, size, dimensions)
- Move complex image dimension logic from views to TelegramBotLogsHelper
- Add percentage calculations to performance metrics section
- Use Rails associations instead of manual BlobFile lookups
- Update slow requests filtering to use total_request_time column
- Enhance search result thumbnails and improve post linking
- Add comprehensive test coverage for helper methods
- Improve error handling and type safety throughout
 2025-08-05 06:30:42 +00:00
Dylan Knutson
ff18b5f75c Refactor TelegramBotLog status handling and add helper 
- Remove no_results status enum value, treat zero results as successful searches
- Add processing status for initial log creation
- Create TelegramBotLogsHelper#status_color_class to eliminate view duplication
- Refactor TelegramBotTask to use Stopwatch class for timing measurements
- Add total_request_time column to track end-to-end request duration
- Update factories, tests, and views to support new status model
- Add comprehensive helper tests and maintain full test coverage
 2025-08-05 05:22:50 +00:00
Dylan Knutson
24a59d50f2 telegram bot logs, first pass 2025-08-05 05:05:21 +00:00
Dylan Knutson
55dfc81436 fallback creator, focus dragdrop on paste 2025-07-31 02:34:47 +00:00
Dylan Knutson
eefcd9eb93 opengraph meta tags 2025-07-30 23:30:44 +00:00
Dylan Knutson
335c1a3c6d time taken to do search, increase ivfflat probes 2025-07-30 19:51:39 +00:00
Dylan Knutson
154c9787d6 updates to visual search form, show close matches if they exist 2025-07-30 19:44:45 +00:00
Dylan Knutson
1bab697a43 visual search form react component 2025-07-30 17:26:54 +00:00
Dylan Knutson
0ecada567d allow paste of images on mobile 2025-07-30 07:15:18 +00:00
Dylan Knutson
3ad3517138 subtitle 2025-07-30 07:01:36 +00:00
Dylan Knutson
4e94a8911c refactor user nav bar and log entry index 2025-07-30 06:59:34 +00:00
Dylan Knutson
f7f17ee3fe fix rounded borders on mobile 2025-07-30 05:12:20 +00:00
Dylan Knutson
c43d1ca197 migrate ib posts to aux table 2025-07-27 17:54:29 +00:00
Dylan Knutson
1f44ec2fa2 domain/users controller spec 2025-07-27 17:26:42 +00:00
Dylan Knutson
8b2ee14ef7 e621 user page fix for faved posts 2025-07-27 17:16:48 +00:00
Dylan Knutson
bc4143ae12 migrate fa posts to aux table 2025-07-26 05:39:32 +00:00
Dylan Knutson
56ed78faaf show pending messages on posts 2025-07-25 19:15:58 +00:00
Dylan Knutson
bd6246d29a send pre-thumbnailed images when type is content-container 2025-07-25 05:12:32 +00:00
Dylan Knutson
5b67f2ad9a show tor hle in ui, test thumbnail enqueue 2025-07-25 00:41:28 +00:00
Dylan Knutson
211d5eb62c fuzzysearch enqueue job 2025-07-24 21:45:21 +00:00
Dylan Knutson
af4d84ccb1 parse posted_at from fa static file url 2025-07-24 17:17:42 +00:00
Dylan Knutson
8333a1bb3f home page has links on it 2025-07-23 17:14:27 +00:00
Dylan Knutson
fb436e1b75 remove domain icons on user pages 2025-07-23 07:24:27 +00:00
Dylan Knutson
e027dc9bc4 Convert stats page to React components with simplifications 2025-07-23 06:55:25 +00:00
Dylan Knutson
572c61cebb add proxies 2025-07-23 04:51:44 +00:00
Dylan Knutson
f63d8cabe7 more dense post index pages 2025-07-23 02:34:36 +00:00
Dylan Knutson
1470a21bbe improve similar post lists, fallback creator models 2025-07-23 02:09:45 +00:00