Training a 4B model to produce 81% faster query plans than Postgres

A 4B model is being trained to generate query plans 81% faster than Postgres. The process involves optimizing join orderings, as demonstrated by a scenario where filtering 2m movie_companies entries to a 5% slice of Japanese companies results in approximately 100k rows. Subsequent joining with a filtered title table further reduces this to 20% of those rows. The importance of accurate early estimates is highlighted, as a single poor estimate in an initial join can negatively impact all subsequent estimates in the join tree.

This report details a specific 4B model achieving 81% faster query plans than Postgres, unlike general discussions of query optimization.