Making an LLM Platform

Blog:

I started working on this since 2024. Initially I attempted to do a TUI

using prompt_toolkit

to do basic inference. I just wanted something simple to use LLM API services

since for some reason I was having trouble at the time to find something I liked. The TUI quickly became too complicated so I decided to switch to Tkinter

, and I'm glad I did. Tkinter and GUIs

allow things TUIs simply can't, or present them much more nicely, and it's less hacky. Tkinter is incredibly stable: Just now it's getting an update to 9.0

, which brings a lot of improvements like proper utf-8 and 64 bit text buffers, but that's after decades, the API is basically frozen. Tkinter has provided the building blocks I've needed to build the interface and the widgets. Since I don't just use built-in advanced widgets I've had to make my own implementations, for simple and advanced stuff, and I like the control that gives me.

https://github.com/madprops/blog/blob/main/docs/meltdown/meltdown.md