This article explains permutation feature importance (PFI), a popular method for understanding feature importance in explainable AI. The author walks through calculating PFI from scratch using Python and XGBoost, discussing the rationale behind the method and its limitations.
This article provides an introduction to Mlflow, an open-source platform for end-to-end machine learning lifecycle management. The article focuses on using MLflow as an orchestrator for machine learning pipelines, explaining the importance of managing complex pipelines in machine learning projects.
This article discusses TinyLlama, an open-source project for a smaller language model with around 1.1B parameters, capable of complex tasks with less memory usage. The article covers implementation, testing, and performance analysis.
Learn about the new Amazon time series model, which you can use to forecast energy usage, traffic congestion, and weather.
Learn about the importance of evaluating classification models and how to use the confusion matrix and ROC curves to assess model performance. This post covers the basics of both methods, their components, calculations, and how to visualize the results using Python.
This GitHub repository contains a course on Large Language Models (LLMs) with roadmaps and Colab notebooks. The course is divided into three parts: LLM Fundamentals, The LLM Scientist, and The LLM Engineer. Each part covers various topics, including mathematics, Python, neural networks, instruction datasets, pre-training, supervised fine-tuning, reinforcement learning from human feedback, evaluation, quantization, new trends, running LLMs, building a vector storage, retrieval augmented generation, advanced RAG, inference optimization, and deployment.
This article explores how to boost the performance of small language models by using supervision from larger ones through knowledge distillation. The article provides a step-by-step guide on how to distill knowledge from a teacher model (LLama 2–70B) to a student model (Tiny-LLama) using unlabeled in-domain data and targeted prompting.
Quivr is an open-source RAG framework and a robust AI assistant that helps you manage and interact with information, reducing the burden of information overload. It integrates with all your files and programs, making it easy to find and analyze your data in one place.
