My reasons to run local models

推荐理由

这条记录涉及生成能力或端侧推理进展，适合跟踪模型效率、部署门槛和应用机会。

- I can finetune any model on any dataset I want.

- I can use techniques like speculative decoding and other sota approaches to get the max tps

- The llm provides like anthropic and openai are not getting access to my data

- The hardware is reusable for vision text speech, and I can run any blend of models for free as much as I want

- I can curate any dataset/content that I want without worrying about the costs

- I like watching Dario go up in flames

主题标签模型发布端侧推理

原始关键词#reasons#models#local#run#my#to

单一来源，暂无交叉验证