explainx.ai350K+ learn from us
TrendingAI News TodayPathwaysSkills
Pricing
explainx.ai

Upskill in AI — 16 free pathways, live workshops & bootcamps, and 50+ courses from practitioners. Plus the skills, tools, and MCP servers to practice on.

follow us

follow on google

Add explainx.ai as a preferred source

corporate training

support@explainx.ai

get started

Find your pathTake Free Evaluation

community

Join the community

learn

mind: share how you thinkpathways — start freeworkshopsbootcampscoursescompare Explainxcertificationsmock testsexplainx universitycorporate traininglearn skills & mcp

discover

skillsmcp serversexplainx mcpestacktoolsmdx readeragentsllmsdesignsdictionarypeopleagi trackerfelony benchranks

company

aboutvisionmissionteaminstructorsteach on explainxpartnershipscommunityhackathonscareers

content

daily AI newsstate of AI — live resultsblogreleasespromptsgeneratorsresource libraryfor LLMsexplainx.ai kids

solutions

all solutionsdeveloper upskillingmarketing upskillingproduct manager upskillingleadership upskilling

newsletter · weekly

Get AI news, tools, and insights in your inbox.

supportcontactprivacytermsdata rightshow we create contentsubmission guidelines

© 2026 AISOLO Technologies Pvt Ltd

explainx.ai

  1. Home
  2. /
  3. Dictionary
  4. /
  5. Goodput
Inference & Deployment

Goodput

Goodput is the rate of useful work a serving system delivers, such as accepted tokens per second, rather than the raw amount of compute it spends.

Ask Melo about this← all terms

In LLM serving with speculative decoding, rejected draft tokens use GPU time but add nothing to the output, so systems such as DSpark and ForeSpark optimize accepted tokens per second instead of drafted tokens per second. Some serving papers also count only requests that meet a latency target (a service level objective) as goodput.

Related terms

Speculative DecodingContinuous BatchingvLLMInference EngineAmazon BedrockInference Optimization

Where Goodput comes up

  • Meta Prometheus: Inside the Ohio Supercluster That Trained Muse Wonder, and the 1 Million GPU Target
  • NVIDIA Minerva: An AIOps Platform to Keep AI Factories From Silently Slowing Down
  • NVIDIA Recovery: Open-Source Auto-Restart for Crashed AI Training Jobs, With 8,550 Detections in 3 Months
  • ForeSpark: Meta-Hosted Code Cuts Wasted Drafting in Speculative Decoding