@Kristennetten While it is tempting to focus on one of those arenas as the “hard one”, in fact they are all difficult & important. Tight C & custom compiler too.
An inference computer optimized for energy efficiency, reliability & long life is also critical. Can’t just jam GPUs in the trunk.
@克里斯汀内顿虽然把注意力集中在其中一个竞技场上是很有诱惑力的，但事实上它们都很难；重要的紧绷的C&；还有自定义编译器。
一台推理计算机，针对能源效率、可靠性和可靠性进行了优化；长寿也是至关重要的。不能把GPU塞进后备箱。