Inspectus is a versatile visualization tool for large language models, offering multiple views to provide diverse insights into language model behaviors. It runs in Jupyter notebooks via a Python API and supports visualization of attention maps, token heatmaps, and dimension heatmaps. The library can be installed using pip and provides API documentation and tutorials for Huggingface models and custom attention maps.
A Python-based, open-source visualization tool called Inspectus helps researchers and developers analyze attention patterns in large language models within Jupyter notebooks. It provides an intuitive interface with multiple views, including attention matrices, heatmaps, and dimension heatmaps, to facilitate detailed analysis.
