dymk/redux-scraper
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
257 Commits 5 Branches 0 Tags
2789cf2c7f44d26949351bbb8351c272d49e042c
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Dylan Knutson 2789cf2c7f Refactor and enhance scraper metrics and job processing 
- Introduced new metrics tracking for HTTP client requests and job processing, including `HttpClientMetrics` and `JobBaseMetrics`.
- Updated `Scraper::HttpClient` to utilize the new metrics for observing request start and finish events.
- Enhanced `Scraper::JobBase` with metrics for job execution, including start, finish, and enqueued jobs.
- Refactored `InkbunnyHttpClientConfig` to enforce strict typing and improve the handling of session IDs in URIs.
- Added tests for new metrics functionality and improved existing tests for job processing and URI mapping.

These changes improve observability and maintainability of the scraper and job processing systems.
2025-01-06 17:55:13 +00:00
.devcontainer
Add HTTP gem for request proxying and enhance application layout
2025-01-04 20:39:37 +00:00
.github
before redoing devcontainer files
2024-12-17 06:34:47 -08:00
.vscode
Update project configuration and enhance OpenTelemetry integration
2025-01-04 00:55:19 +00:00
app
Refactor and enhance scraper metrics and job processing
2025-01-06 17:55:13 +00:00
bin
init sorbet
2025-01-01 01:14:26 +00:00
config
Add HTTP gem for request proxying and enhance application layout
2025-01-04 20:39:37 +00:00
db
Enhance Inkbunny job processing and database schema
2025-01-05 20:15:17 +00:00
gems
add typed where possible
2025-01-01 03:29:53 +00:00
log
inital commit
2023-01-30 01:16:00 +00:00
public
inital commit
2023-01-30 01:16:00 +00:00
rake
remove sst code
2025-01-01 03:31:17 +00:00
sorbet
Enhance Inkbunny job processing and database schema
2025-01-05 20:15:17 +00:00
spec
Refactor and enhance scraper metrics and job processing
2025-01-06 17:55:13 +00:00
storage
inital commit
2023-01-30 01:16:00 +00:00
test/fixtures/files
Enhance Inkbunny job processing and database schema
2025-01-05 20:15:17 +00:00
tmp
inital commit
2023-01-30 01:16:00 +00:00
user_scripts
fix fa api endpoint
2023-09-13 08:45:47 -07:00
vendor
inital commit
2023-01-30 01:16:00 +00:00
.cursorignore
indexed posts enums
2024-12-25 21:53:47 +00:00
.dockerignore
Update project configuration and enhance OpenTelemetry integration
2025-01-04 00:55:19 +00:00
.env-cmdrc
Update project configuration and enhance OpenTelemetry integration
2025-01-04 00:55:19 +00:00
.gitattributes
inital commit
2023-01-30 01:16:00 +00:00
.gitignore
Update project configuration and enhance OpenTelemetry integration
2025-01-04 00:55:19 +00:00
.prettierrc
Update project configuration and enhance OpenTelemetry integration
2025-01-04 00:55:19 +00:00
.rspec
Refactor FA cookie management and enhance testing
2024-12-30 02:00:30 +00:00
.rubocop.yml
before redoing devcontainer files
2024-12-17 06:34:47 -08:00
.ruby-version
remove proxy code
2024-12-17 17:57:17 +00:00
babel.config.js
react_on_rails initial generate
2023-04-04 21:47:52 +09:00
config.ru
inital commit
2023-01-30 01:16:00 +00:00
Dockerfile
Update Dockerfile and Ruby files for improved dependency management and type safety
2025-01-01 02:55:10 +00:00
er_id
Add Inkbunny post management functionality
2024-12-30 08:07:27 +00:00
Gemfile
Add HTTP gem for request proxying and enhance application layout
2025-01-04 20:39:37 +00:00
Gemfile.lock
Add HTTP gem for request proxying and enhance application layout
2025-01-04 20:39:37 +00:00
justfile
Update project configuration and enhance OpenTelemetry integration
2025-01-04 00:55:19 +00:00
package.json
Update project configuration and enhance OpenTelemetry integration
2025-01-04 00:55:19 +00:00
Procfile.dev
Add HTTP gem for request proxying and enhance application layout
2025-01-04 20:39:37 +00:00
Procfile.dev-static
react_on_rails initial generate
2023-04-04 21:47:52 +09:00
Procfile.production
Add Prometheus monitoring integration and enhance application metrics
2025-01-04 05:59:26 +00:00
Procfile.staging
Add HTTP gem for request proxying and enhance application layout
2025-01-04 20:39:37 +00:00
Procfile.worker
Add Prometheus monitoring integration and enhance application metrics
2025-01-04 05:59:26 +00:00
Rakefile
Enhance Inkbunny job processing and update post handling
2024-12-30 21:57:32 +00:00
README.md
update good_job
2024-12-17 19:00:33 +00:00
TODO.md
Enhance Inkbunny job processing and database schema
2025-01-05 19:32:58 +00:00
tsconfig.json
clientside trie
2023-04-04 17:13:40 -07:00
yarn.lock
Update project configuration and enhance OpenTelemetry integration
2025-01-04 00:55:19 +00:00

README.md

README

This README would normally document whatever steps are necessary to get the application up and running.

Things you may want to cover:

  • Ruby version
  • 3.2.6
  • System dependencies
  • node 18.x

  • Configuration

  • Database creation

  • Database initialization

  • How to run the test suite

  • Services (job queues, cache servers, search engines, etc.)

  • Deployment instructions

  • Build docker image with docker build . -t redux-scraper-app
  • ...
Reference in New Issue View Git Blame Copy Permalink
Description
No description provided
Readme 86 MiB
Languages
Ruby 80%
HTML 10.8%
TypeScript 7.8%
JavaScript 0.7%
Shell 0.2%
Other 0.4%