CrawlTarget

import type { CrawlTarget } from "@pitlane/crawler";

What crawl needs from a router. A createRouter() router satisfies it, and so does anything else that answers a Request — a built server bundle's default export, a worker-style { fetch } object, a test double.

Methods

fetch()

fetch(request): Response | Promise<Response>;

Answers one request; crawl sends a GET for each queued path.

Parameters

request

Request

Returns

Response | Promise<Response>