Privacy choices: we'd like to measure visits anonymously (our own cookie-free counter plus Google Analytics, which sets its own cookies; no ads) and load Beehiiv's newsletter sign-up, which may set its own cookies. Nothing optional runs until you choose. Privacy policy

AgentScout / evals & observability / InferenceX
evals & observabilityOpen sourceNewAdded Nov 15, 2026

InferenceX logoInferenceX

No ratings yet★ Rate this tool

InferenceX is SemiAnalysis' open-source inference research platform that continuously benchmarks how fast and how efficiently AI models are served on different accelerators and software stacks. It runs end-to-end serving benchmarks for new models from day zero on NVIDIA B200, B300 and GB200 and AMD MI355X systems with vLLM and SGLang, adds networking, kernel and hardware microbenchmarks, measures power draw, and publishes results on inferencex.com. Apache 2.0.

Updated

✨ Try AgentScout's free AI image generator →

Good for: research, evaluating agents

Use cases

Get featured

About InferenceX

InferenceX is listed in our evals & observability category and is aimed at builders. InferenceX is SemiAnalysis' open-source inference research platform that continuously benchmarks how fast and how efficiently AI models are served on different accelerators and software stacks. It runs end-to-end serving benchmarks for new models from day zero on NVIDIA B200, B300 and GB200 and AMD MI355X systems with vLLM and SGLang, adds networking, kernel and hardware microbenchmarks, measures power draw, and publishes results on inferencex.com. Apache 2.0. Pricing, as the maker states it: Open source. Maturity: Active. We last checked the official link on 2026-11-15.

InferenceX at a glance

InferenceX FAQ

What is InferenceX?

InferenceX is SemiAnalysis' open-source inference research platform that continuously benchmarks how fast and how efficiently AI models are served on different accelerators and software stacks. It runs end-to-end serving benchmarks for new models from day zero on NVIDIA B200, B300 and GB200 and AMD MI355X systems with vLLM and SGLang, adds networking, kernel and hardware microbenchmarks, measures power draw, and publishes results on inferencex.com. Apache 2.0.

How much does InferenceX cost?

InferenceX's pricing, as the maker states it: Open source. Open-source tools are free to use, though you may still pay for model API usage or a hosted plan. Check the official site for current plans.

Where can I find InferenceX's source code?

On GitHub at SemiAnalysisAI/InferenceX, which had 2,040 stars as of Nov 15, 2026.

What are alternatives to InferenceX?

Similar tools include Opik, ReLE Chinese LLM Benchmark, SWE-bench, Galileo Agent Leaderboard, Monocle and QAmcp.

Facts from our link-checked listing, the GitHub repository and the official site. See something wrong? Suggest an edit.

InferenceX ratings and reviews

No ratings yet. Be the first to review InferenceX.

Be the first to rate InferenceX: tap 1 to 5 stars below. A written review is optional.

Your rating of InferenceX

Star ratings count right away; written reviews appear after a quick check. One rating per tool per visitor. Reviews are from site visitors, not verified users. How reviews work

InferenceX alternatives

Other evals & observability tools in our directory. See all evals & observability tools →

Get your badge

Built InferenceX? Optional. Showing this badge does not change your rank or earn a Featured spot. It links to this page. About badges

Listed on AgentScout (light)