Keyword: web-crawler

• crawlforge-mcp-server

  Released

  10h ago

  Version

  4.8.1

  CrawlForge MCP Server - Professional Model Context Protocol server with 26 web scraping, crawling, deep-research, and autonomous-extraction tools. Returns clean Markdown and structured JSON for Claude, Cursor, and any MCP client. Defaults to local Ollama

  mcpmodel-context-protocolweb-scrapingscraperhtml-parsermetadata-extraction+14
• crawl4ai-cloud

  Released

  22h ago

  Version

  1.4.0

  Lightweight cloud SDK for Crawl4AI - mirrors the OSS API

  crawl4aiweb-scrapingcrawlercloudapiweb-crawler+2
• turbo-surf

  Released

  2d ago

  Version

  0.2.7

  Native-speed, browserless web crawler + MCP server for AI agents. A standalone Rust engine (turbo-dom + a V8 JS-render tier) — fetch + parse + extract + run page JS with no headless browser. This npm package is a thin launcher that spawns the native binar

  crawlerscraperweb-crawleragentllmmcp+6
• @vakra-dev/reader

  Released

  yesterday

  Version

  0.3.0

  Open source, production grade web scraping engine for LLMs. Clean markdown output, ready for your agents.

  web-scraperweb-crawlermarkdownllmragai-agents+10
• cockroach-crawler

  Released

  yesterday

  Version

  0.1.1

  Public-web crawler for agent workflows with robots.txt, sitemaps, depth limits, filters, markdown extraction, and JSONL output.

  crawlercockroach-crawleragentweb-crawlerscraperrobots.txt+4
• ajnas-agent-crawler

  Released

  yesterday

  Version

  0.1.0

  Fast, respectful web crawler for agent workflows with robots.txt, sitemap discovery, markdown extraction, and JSONL output.

  crawleragentweb-crawlerscraperrobots.txtsitemap+3
• @harshvz/crawler

  Released

  4d ago

  Version

  1.4.0

  A powerful web scraping tool built with Playwright that crawls websites using BFS or DFS algorithms, captures screenshots, and extracts content

  web-scrapingplaywrightcrawlerscraperbfsdfs+8