Keyword: webcrawler
- @vakra-dev/readerReleased4h agoVersion0.3.2
Open source, production grade web scraping engine for LLMs. Clean markdown output, ready for your agents.
- web-tree-crawlReleased9 years agoVersion1.1.4
Simple framework for crawling/scraping web sites. The result is a tree, where each node is a single request.
- turbo-surfReleased3h agoVersion0.3.1
Native-speed, browserless web crawler + MCP server for AI agents. A standalone Rust engine (turbo-dom + a V8 JS-render tier) — fetch + parse + extract + run page JS with no headless browser. This npm package is a thin launcher that spawns the native binar
- crawlforge-mcp-serverReleased9h agoVersion4.9.0
CrawlForge MCP Server - Professional Model Context Protocol server with 27 web scraping, crawling, deep-research, and autonomous-extraction tools. Returns clean Markdown and structured JSON for Claude, Cursor, and any MCP client. Defaults to local Ollama
- crawler-tsReleased5 years agoVersion1.1.1
Lightweight crawler written in TypeScript using ES6 generators.
- gumoReleased4 months agoVersion2.0.1
A web-crawler and scraper that extracts data from a family of nested dynamic webpages with added enhancements to assist in knowledge mining applications.
- @a11ywatch/crawlerReleased1 year agoVersion0.9.9
gRPC tokio based web crawler
- browsemindReleasedyesterdayVersion0.7.0
LLM browser automation agent — crawl, navigate, extract, interact
- seo-intelReleasedyesterdayVersion1.5.52
Local Ahrefs-style SEO competitor intelligence. Crawl → SQLite → cloud analysis.
- maqamReleasedyesterdayVersion0.1.6
Maqam is an MIT-licensed agent framework for governed workflows, policy, evidence, skills, CLI workers, and crawler-backed research.