OctoAI

OctoAI automates machine learning code generation, making it faster and easier for enterprises to optimize and deploy trained large language models at scale across a wide array of chips, cloud services and edge devices. The company was cofounded by the authors of Apache TVM, an open-source ML deep learning compiler used at Amazon and Facebook. OctoAI is built on top of Apache TVM and helps eliminate time, expense and delays in production common to the manual process used to customize machine learning models specific to hardware. OctoAI enables clients to cut down cloud costs by building faster models as well as create new edge services previously not possible. Read Less