fai-inference-optimization

Optimize model inference latency and throughput.

Overview

Usage

Reference this skill in your fai-manifest.json:

{
  "primitives": {
    "skills": ["../../skills/fai-inference-optimization/SKILL.md"]
  }
}

Source

• GitHub: skills/fai-inference-optimization/SKILL.md

Auto-generated from the FrootAI primitive catalog .