Guides

Practical answers for agent builders: getting the data you need from the web, reliably and cheaply.

• The best MCP servers for Claude Code, testedSeven MCP servers for Claude Code run on the same tasks: Playwright, Chrome DevTools, Fetch, Firecrawl, Skryp, Context7 and DeepWiki, with setup and costs.
• Give Claude Code web access: Playwright MCP, a scraping MCP, or bothHow to add Playwright MCP and a scraping MCP server to Claude Code, which tasks each handles better, and what the same task costs in tokens both ways.
• Web search MCP servers comparedFour web search MCP servers on the same 12 searches: answers in the top five, reply size, speed and price per 1,000 searches, plus setup for Claude Code.
• Web scraping with Python: requests, BeautifulSoup, Playwright or an APIA working guide to web scraping in Python: fetch and parse with requests and BeautifulSoup, render JavaScript with Playwright, and know when an API is cheaper.
• Web scraping with Selenium and PythonScrape JavaScript pages with Selenium and Python: setup, waits, pagination and extraction, with runnable code and the cases where Selenium is overkill.
• Playwright vs Puppeteer vs Selenium for web scrapingThe same JavaScript-heavy pages scraped with Playwright, Puppeteer and Selenium: setup, speed, reliability and when a hosted API makes more sense.
• Web scraping with JavaScript and Node.jsScrape websites with Node.js: parse static pages with Cheerio, render JavaScript with Puppeteer, handle pagination, with runnable examples.
• Web crawling vs web scraping: what's the difference?Crawling finds pages; scraping extracts data from them. How they differ, when you need each and how they fit together, with a working example of both.
• Web scraping vs an official API: which should you use?When to use a site's official API, when to scrape, and when to combine them: data coverage, cost, rate limits, terms and maintenance in one decision table.
• The best web scraping tools, testedEight web scraping tools run on the same two pages: requests, Scrapy, Playwright, Selenium, Crawl4AI, Jina Reader, Firecrawl and Skryp (ours).