A guide to common pitfalls and best practices when starting with Playwright and Python, covering topics like browser context, waiting strategies, and handling different environments.
This article provides a verified list of AI crawlers (GPTBot, ClaudeBot, Gemini, etc.) with user-agent strings, crawl rates, and IP verification information to help manage access and maintain inclusion in AI discovery.
The internet's new standard, RSL, is a clever fix for a complex problem, and it just might give human creators a fighting chance in the AI economy.
An open source web crawler that searches the internet. It's a minimal, real-time web search CLI that searches the internet for you. Enter a query and get search results as JSON (title, url, published_date), sorted by recency.
A no-install needed web-GUI for Ollama. It provides a web-based interface for interacting with Ollama, offering features like markdown rendering, keyboard shortcuts, a model manager, offline/PWA support, and an optional API for accessing more powerful models.
An introduction to the Requests-HTML library, covering its installation, core features, basic and advanced usages, and practical application scenarios for web scraping and parsing.
The article discusses Sosse, a self-hosted web scraper that allows users to archive their favorite websites. It highlights the tool's simplicity, ease of installation via Docker, and its ability to create full HTML snapshots of web pages, including stylesheets and assets. The author integrates Sosse into their workflow for archiving articles and technical documentation, praising its minimal interface and reliability.
The author details their transition from Pocket to Karakeep, a self-hosted, open-source alternative for saving and reading articles later. They discuss the benefits of owning your data and the features of Karakeep, including RSS integration and AI-powered tagging.
Notte is an open-source browser using an agent, designed to improve speed, cost, and reliability in web agent tasks through a perception layer that structures webpages for LLM consumption. It offers a full stack framework with customizable browser infrastructure, web scripting, and scraping endpoints.
Discussion about the Clipboard API and the differences between clipboardRead and paste events.
