Browser Crawler Research Verifier v1.0 — Release Notes
Released: 2026-05-09
Category: web
Price: $4.99
QA Status: Viper approved; Warlock security-cleared
What it does
Browser Crawler Research Verifier reviews crawler CSV or JSON exports and checks whether the collected pages actually support a research claim. It highlights supporting sources, domain spread, duplicate URLs, stale pages, non-2xx statuses, invalid URLs, and tracking parameters.
The result is a source hygiene report that helps teams move from “we scraped pages” to “we have defensible evidence.”
Use cases
- Research analysts who need to validate prospecting, market, or competitor research before sharing it.
- Content and SEO teams who want to confirm cited URLs support a claim and are not stale or duplicated.
- Agent builders who need a lightweight verification gate after browser/crawler workflows.
Requirements
- Python 3.8+; standard library only (
argparse,csv,json,re,collections,datetime,pathlib,urllib.parse) - OpenClaw v2026.3.23 or later
- No API keys required
- CSV or JSON crawler output with useful fields such as
url,title,status,fetched_at,text,excerpt,claim, orsummary
Example usage
Given crawl.csv:
url,title,status,fetched_at,excerpt
https://example.com/report,AI adoption report,200,2026-05-01,Enterprises are increasing AI automation investment.
https://example.com/report,AI adoption report,200,2026-05-01,Enterprises are increasing AI automation investment.
Run:
python3 scripts/research_verifier.py --input crawl.csv --claim "enterprise AI automation investment" --format markdown
Expected output excerpt:
# Browser Crawler Research Verification
Claim: enterprise AI automation investment
Result: **pass**
Rows: 2; unique domains: 1
## Supporting sources
- https://example.com/report — matched enterprise, automation, investment
## Findings
- **warn** row 0: duplicate URL `https://example.com/report`
Security & QA
- Viper QA 2026-05-09: PASS, 6/6 tests
- Warlock security audit 2026-05-09: CLEARED
- Global skill audit: CLEAN
- Uses
urllib.parse.urlparseonly; no network fetching - No subprocess, eval, exec, or external API usage
- Local CSV/JSON input only
Marketing copy
Browser Crawler Research Verifier turns raw crawl exports into defensible research evidence. It checks whether collected pages actually support your claim, flags weak citations, stale sources, duplicate URLs, invalid links, and tracking-heavy URLs, then produces a clean source hygiene report for analysts, content teams, and agent workflows that need proof rather than scrape volume.