A script utilizing OpenAI's Llama models to interact within a terminal environment, allowing the models to execute Python code and communicate based on predefined prompts.
llama-cpp-python offers a web server which aims to act as a drop-in replacement for the OpenAI API. This allows you to use llama.cpp compatible models with any OpenAI compatible client (language libraries, services, etc).