Most LLM features ship without the engineering discipline we'd never skip for regular software

Many LLM features are deployed without the rigorous engineering discipline typically applied to regular software. This often involves minimal testing, a lack of versioning, and evaluations based on intuition rather than concrete metrics. Consequently, issues can arise weeks later, with no clear understanding of what changed or when, due to the absence of initial measurements. This concern is highlighted by Bruno Gonçalves, PhD, founder of Data For Science, who trains engineers at Fortune 500 companies in this crucial discipline.