Benchmarking is one of the best use cases for TUIs! 🚀
🤗 Here is a lightweight benchmarking tool for TGI by @huggingface
🦀 Written in Rust & built with @ratatui_rs
⭐ GitHub: github.com/huggingface/text-ge…
#rustlang #ratatui #tui #benchmarking #tgi #llms #deeplearning #gpt #commandline #terminal
text-generation-inference/benchmark at main · huggingface/text-generation-inference
Large Language Model Text Generation Inference. Contribute to huggingface/text-generation-inference development by creating an account on GitHub.GitHub