|
|
e6c1bcd555
|
tw_id for users
|
2023-03-11 20:21:29 -08:00 |
|
|
|
d85fe217bd
|
add serverhost-1 proxy, basic enqueuer.user.js twitter support, rake pool_combined task
|
2023-03-11 18:22:04 -08:00 |
|
|
|
ec821332d9
|
visual tweaks on log entries index
|
2023-03-08 22:17:07 -08:00 |
|
|
|
f2c41d2330
|
move proxy config into yaml
|
2023-03-08 19:26:33 -08:00 |
|
|
|
5a4595cd57
|
add twitter scraper infra
|
2023-03-08 18:15:05 -08:00 |
|
|
|
9bd3feeac6
|
refactor user script, add deleted_at to e621 posts
|
2023-03-07 13:11:16 -08:00 |
|
|
|
406080cef6
|
moduleify color logger, use rspec
|
2023-03-06 09:58:32 -08:00 |
|
|
|
ea261b228e
|
start e621 legacy import
|
2023-03-03 21:30:15 -08:00 |
|
|
|
1566fb1063
|
add separate lite trail versions table support
|
2023-03-03 11:56:18 -08:00 |
|
|
|
8c9b2ffdc4
|
Clean up static file output
|
2023-03-02 19:16:06 -08:00 |
|
|
|
a2096b7322
|
add dedipath, filter on hle uri
|
2023-03-01 18:22:53 -08:00 |
|
|
|
eacbf7f43b
|
skip page / gallery scan in gallery job
|
2023-03-01 10:50:39 -08:00 |
|
|
|
d3a864b92f
|
basic e621
|
2023-03-01 08:13:49 -08:00 |
|
|
|
a9ef897c42
|
add performed_by to HLE
|
2023-02-28 23:16:16 -08:00 |
|
|
|
d9a1ce3e74
|
reorganize rake tasks, clean up logging, remove priority propagation
|
2023-02-27 10:06:09 -08:00 |
|
|
|
84b30ac4d5
|
add page specific stats for extension, dedup delayed jobs
|
2023-02-26 12:35:16 -08:00 |
|
|
|
b9a1921067
|
user extension for enqueueing jobs
|
2023-02-25 22:21:46 -08:00 |
|
|
|
8d980ba842
|
browser for fa posts and users, initial impl
|
2023-02-24 20:40:07 -08:00 |
|
|
|
b04be50e2d
|
http log browser initial implementation, make models immutable, create jobs for fa scraping
|
2023-02-23 15:55:19 -08:00 |
|
|
|
548daa9127
|
basic fa browse job scaffolding
|
2023-02-19 22:58:40 -08:00 |
|
|
|
d0a09a4615
|
http client creates log entries
|
2023-02-19 18:57:00 -08:00 |
|
|
|
c28ab1435f
|
add basic http client
|
2023-02-19 18:19:57 -08:00 |
|
|
|
ea24542ea1
|
add rating parsing
|
2023-02-19 13:40:19 -08:00 |
|
|
|
b1636d13b6
|
more tests for non-image submissions
|
2023-02-18 16:50:50 -08:00 |
|
|
|
d4072f6aca
|
implement fa parser for browse page / gallery page / submission page
|
2023-02-18 16:32:41 -08:00 |
|
|
|
b13851780a
|
partial completion of redux fa page parser
|
2023-02-18 15:36:33 -08:00 |
|
|
|
23a1b4f0ef
|
import legacy fa page parser
|
2023-02-17 23:08:51 -08:00 |
|
|
|
36eda43325
|
add fa users
|
2023-02-17 22:41:28 -08:00 |
|
|
|
9e0f0798aa
|
fa importer job refactors and bug fixes
|
2023-02-12 17:29:25 -08:00 |
|
|
|
f24e361e34
|
fa post importer with basic legacy log matchup
|
2023-02-09 06:20:40 +00:00 |
|
|
|
cf9122a941
|
add fa posts and basic paper trail
|
2023-02-08 21:49:47 +00:00 |
|
|
|
46bdbd396e
|
add foreign key constraints to http logs / blob entries
|
2023-02-07 20:53:46 +00:00 |
|
|
|
69e38322f6
|
add some legacy fa models
|
2023-02-07 20:47:06 +00:00 |
|
|
|
187e840571
|
create flat sst entries
|
2023-02-04 04:40:48 +00:00 |
|
|
|
c5c77b885b
|
parallel blob insert
|
2023-02-03 20:35:31 +00:00 |
|
|
|
a4062d8eb4
|
parallel reject existing
|
2023-02-03 20:19:14 +00:00 |
|
|
|
2717c0f93e
|
use parallel map via forking
|
2023-02-03 20:05:44 +00:00 |
|
|
|
56b3fd33d8
|
merge futureized cache operations
|
2023-02-03 19:03:10 +00:00 |
|
|
|
238cd9c4ae
|
untangle blob and header creation code for http entry import
|
2023-02-03 18:28:38 +00:00 |
|
|
|
b7f33dbe20
|
add fork future primitive
|
2023-02-03 17:02:42 +00:00 |
|
|
|
b276357244
|
move http log entry migration task into lib class, bulk import blob entries / http entries
|
2023-02-03 16:35:51 +00:00 |
|
|
|
49cd601862
|
refactor http log entry migration task
|
2023-02-02 18:52:40 +00:00 |
|
|
|
08bbacca65
|
migrate sst entries, start on migrating http log entries
|
2023-02-01 04:10:49 +00:00 |
|
|
|
654ff8b71a
|
implement sst entry patching
|
2023-01-30 19:50:33 +00:00 |
|
|
|
2cd4cb4403
|
add hex helpers for LSSE
|
2023-01-30 01:27:31 +00:00 |
|
|
|
63a1e6c46d
|
inital commit
|
2023-01-30 01:16:00 +00:00 |
|
