Notte is an open-source browser using an agent, designed to improve speed, cost, and reliability in web agent tasks through a perception layer that structures webpages for LLM consumption. It offers a full stack framework with customizable browser infrastructure, web scripting, and scraping endpoints.
Discussion about the Clipboard API and the differences between clipboardRead and paste events.
Exploring different methods and designs in implementing a Paste file feature that lets users quickly copy and send files between devices.
Justin Garrison demonstrates how to use a Raspberry Pi or other single-board computer to run a local Personal Data Server (PDS) for the microblogging platform Bluesky, allowing users to store and manage their own data.
This project provides an LLM Websearch Agent using a local SearXNG server for search functionality and includes Python scripts and a bash script for interacting with an LLM to summarize search results.
Scraperr is a self-hosted web application for scraping data from web pages using XPath. It supports queuing URLs, managing scrape elements, and provides features such as job management, user login, and integration with AI services.
FlowScraper is a powerful web scraper with an intuitive FlowBuilder, enabling effortless website automation and data extraction without coding. It features customizable AI actions and automatic anti-bot protection.
The crawl-delay directive is an unofficial directive in robots.txt meant to communicate to crawlers to slow down crawling to not overload the web server. However, support for this directive varies among search engines.
Crawl4AI is an open-source web crawling tool designed to efficiently collect and curate high-quality, structured data from the web for large language model training. It handles multiple URLs simultaneously and supports various data formats, including JSON and Markdown.
Google's Martin Splitt shares how to defend against malicious bots and improve site performance. SEO expert Roger Montti explains why contacting resource providers won't work and offers alternative solutions.
