Japanese commerce data API

Web extraction API for Japanese commerce and public-data sites

Send a URL and get normalized HTML or reviewed JSON with request IDs, quotas, and domain policy.

POST https://api.crawl-hub.shian.space/v1/scrapecredits: 1-3

curl -X POST https://api.crawl-hub.shian.space/v1/scrape \
  -H "Authorization: Bearer $CRAWLHUB_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://jp.mercari.com/item/...", "params":{"mode":"html_json", "work_type":"auto", "include_html":false}}'

{
  "request_id": "req_...",
  "resolved_site": "mercari",
  "fetch_summary": {"status": "completed", "attempts": 1},
  "cost_units": 2,
  "data": {"title": "...", "price": 12800}
}

Crawl Hub visual system

From URL to JSON with operational guardrails

Crawl Hub connects URL policy, supported-site coverage, extraction, request IDs, and Credits in one API flow.

Request IDsSupported sitesArtifact opt-in

Scope control

Domain policy and limits protect both sites and your billing cap.

No default body storage

HTML and JSON are not persistently stored by default.

Copy-ready API

Use cURL or Python with the public API base URL.

Traceable latency

Attempts, latency, and Credits are visible in responses.

Reviewed extraction

Production JSON relies on reviewed extraction paths.

Usage visibility

Usage, quotas, and concurrency are visible in Console.

Quickstart - /v1/scrape

curl -sS -X POST https://api.crawl-hub.shian.space/v1/scrape \
  -H "Authorization: Bearer $CRAWL_HUB_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.jp/item/...","params":{"mode":"html_json","work_type":"auto","include_html":false,"store_artifact":false}}'

{"request_id":"req_...","resolved_site":"mercari","fetch_summary":{"status":"completed","attempts":1},"cost_units":2,"data":{"title":"...","price":12800}}

Supported sites

Coverage is explicit: Stable, Beta, or Experimental. Unreviewed domains are not silently enabled.

2nd STREET beta@cosme betaAmazon.co.jp betaAxes betaBrandoff betaDaikokuya betaDigimart betaDoraever betaDorajob betaF Takken beta

Operational API metadata

Request IDs

Every response includes a request ID for support and auditing.

Quotas and limits

API keys can be constrained by site, operation, output, credits, and concurrency.

Reviewed JSON

JSON extraction relies on reviewed extraction paths, with HTML available when requested.

Storage and compliance

HTML and extracted JSON are not stored by default. Artifacts are saved only when explicitly requested.

Pricing

Free

¥0/month, 500 Credits, no card required.

Starter

¥3,300/month tax included, for small production workflows.

Growth

¥11,000/month tax included, for continuous monitoring.

View pricing