Connexion
Idée - Efficient Network Orchestrator
ALTO: Efficient Network Orchestrator for Compound AI Systems
ALTO is a network orchestrator that efficiently serves compound AI systems, optimizing throughput and latency by streaming intermediate outputs between stages.
ALTO: Efficient Network Orchestrator for Compound AI Systems
ALTO optimizes compound AI systems by streaming partial outputs, improving throughput and reducing latency.
Produits | Ressources
© 2024 by Linnk AI