Infinity is a high-throughput, low-latency REST API for serving text-embeddings, reranking models and clip.

Optimum Library is an extension of the Hugging Face Transformers library, providing a framework to integrate third-party libraries from Hardware Partners and interface with their specific functionality.