WebMCP is an open source JavaScript library that allows any website to integrate with the Model Context Protocol. It provides a small widget for users to connect to and interact with webpages via LLMs or agents.
Key features include:
- Tools that allow LLMs to perform specific actions on your website
- Prompts that serve as predefined templates for standardized interactions
- Resources that expose page data and content to be used as context for LLM interactions
Key features include:
- Tools that allow LLMs to perform specific actions on your website
- Prompts that serve as predefined templates for standardized interactions
- Resources that expose page data and content to be used as context for LLM interactions
This article provides a verified list of AI crawlers (GPTBot, ClaudeBot, Gemini, etc.) with user-agent strings, crawl rates, and IP verification information to help manage access and maintain inclusion in AI discovery.
The internet's new standard, RSL, is a clever fix for a complex problem, and it just might give human creators a fighting chance in the AI economy.
An open source web crawler that searches the internet. It's a minimal, real-time web search CLI that searches the internet for you. Enter a query and get search results as JSON (title, url, published_date), sorted by recency.
Notte is an open-source browser using an agent, designed to improve speed, cost, and reliability in web agent tasks through a perception layer that structures webpages for LLM consumption. It offers a full stack framework with customizable browser infrastructure, web scripting, and scraping endpoints.
This project provides an LLM Websearch Agent using a local SearXNG server for search functionality and includes Python scripts and a bash script for interacting with an LLM to summarize search results.
Parsera is a new tool for web scraping that leverages large language models (LLMs) to make the process more straightforward and efficient. It focuses on minimizing token usage for faster processing and lower costs.
Parsera is a simple and fast Python library for scraping websites using Large Language Models (LLMs). It's designed to be lightweight and minimize token usage for speed and cost efficiency.
Reworkd is a platform that simplifies web data extraction, using LLM code generation to help businesses scale their web data pipelines. No coding skills required.
