Are there any experimental small models (9B or less) which are out or currently being trained using engram/n-grams?

A developer community discussion on reddit.com explores the existence of experimental small models, specifically those 9B parameters or less, that are being trained using engram/n-grams. The user notes a lack of such models on Hugging Face and expresses interest in comparing the performance of a tiny model trained with and without n-grams on the same dataset, suggesting this might be a very new area of research.

This discussion highlights a potential gap in current AI research, noting the absence of small (under 9B) n-gram trained models on platforms like Hugging Face, unlike other model types.