gitcrawl is a local-first GitHub triage tool and a drop-in caching shim for the gh CLI. It mirrors repository issues and pull requests into a local SQLite database, enabling semantic clustering and full-text search while preventing API rate limit exhaustion. This setup allows maintainers and AI agents to perform heavy read operations against a local cache rather than live GitHub servers.
Main features:
Local SQLite storage for all issue, PR, and commit metadata.
A gh-compatible shim that handles most read-only calls locally.
Semantic clustering using OpenAI embeddings to group related reports.
An interactive terminal UI for cluster browsing.
JSON support for easy automation with AI agents.
Main features:
Local SQLite storage for all issue, PR, and commit metadata.
A gh-compatible shim that handles most read-only calls locally.
Semantic clustering using OpenAI embeddings to group related reports.
An interactive terminal UI for cluster browsing.
JSON support for easy automation with AI agents.
This tutorial demonstrates how to perform semantic clustering of user messages using Large Language Models (LLMs) by prompting them to analyze publicly available Discord messages. It covers methods for data extraction, sentiment scoring, KNN clustering, and visualization, emphasizing faster and less effort-intensive processes compared to traditional data science approaches.
