Gergő Móricz 72d6a8179e fix(rate-limiter): raise crawlStatus limits

2024-12-15 23:08:23 +01:00

..

__tests__

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

controllers

feat: add scrapeOptions.fastMode

2024-12-15 14:28:47 +01:00

lib

fix(crawl-redis/lockURL): only add to visited_unique if lock succeeds

2024-12-15 21:01:31 +01:00

main

Nick: fix actions errors

2024-12-15 15:43:12 -03:00

routes

Nick: f-eng monitoring test

2024-12-14 21:40:46 -03:00

scraper

fix(WebScraper/tryGetSitemap): deduplicate sitemap links list

2024-12-15 22:33:36 +01:00

search

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

services

fix(rate-limiter): raise crawlStatus limits

2024-12-15 23:08:23 +01:00

control.ts

Initial commit

2024-04-15 17:01:47 -04:00

index.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

run-req.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

strings.ts

Nick: fixed prettier

2024-12-11 19:46:11 -03:00

supabase_types.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

types.ts

feat(runWebScraper): retry a scrape max 3 times in a crawl if the status code is failure

2024-12-14 00:54:05 +01:00