Emmimal P Alexander writes that while prompt engineering focuses on optimizing LLM inputs, managing these templates within evolving codebases often leads to production crashes when variables are renamed or removed. To solve this, she created `promptctl`, a Python tool that applies static analysis—similar to database schema migrations—to ensure prompt variable contracts match their call sites in the codebase.
- Performs PromptDiff (detects changes), Contract Validation (checks mismatches), and Impact Analysis (traces dependencies).
- Operates strictly via AST parsing, requiring zero LLM calls or API keys.
- Detects errors that unit tests often miss by mocking away the actual string formatting step.
- Performs PromptDiff (detects changes), Contract Validation (checks mismatches), and Impact Analysis (traces dependencies).
- Operates strictly via AST parsing, requiring zero LLM calls or API keys.
- Detects errors that unit tests often miss by mocking away the actual string formatting step.
High-level diagram representations for code. CodeBoarding is an open-source codebase analysis tool that generates high-level diagram representations of codebases using static analysis and LLM agents, that humans and agents can interact with.
