This article discusses using entropy and variance of entropy (VarEntropy) to detect hallucinations in LLM function calling, focusing on how structured outputs allow for identifying errors through statistical anomalies in token confidence.
Sorkin and colleagues have derived an equivalent of the second law of thermodynamics for living systems, which establishes a relation between such a cell’s active uptake of energy and its random-looking path in terms of entropy production.
This review article discusses the concept of entropy in statistical physics and its role as both a tool for inference and a measure of time irreversibility. It highlights the developments in stochastic thermodynamics and the principle of maximum caliber, emphasizing the importance of cross-talk among researchers in disparate fields.
Prompted by these conversations, a subset of us eventually wrote a paper on the foundations of equilibrium thermodynamics:
John Baez, Owen Lynch and Joe Moeller, Compositional thermostatics.
John Baez, Owen Lynch and Joe Moeller, Compositional thermostatics.
