SFTMill: Easily [off-policy] distill any existing LLM with an OpenAI Compatible Endpoint. Turn any behavioral goal into a comprehensive dataset.

SFTMill is a new tool that allows users to easily distill any existing Large Language Model (LLM) with an OpenAI Compatible Endpoint. It can turn any behavioral goal into a comprehensive dataset, provided the model exposes its Chain-of-Thought (CoT) without censorship. The developer released SFTMill to contribute to the community and hopes it will lead to employment opportunities as a software or ML engineer.