Disaggregated Prefill and Decode for LLM Serving on AWS - The KV Transfer, the Routing Threshold, and What Disaggregation Does Not Fix | hidekazu-konishi.com

https://hidekazu-konishi.com/entry/disaggregated_prefill_and_decode_llm_serving_on_aws.html Disaggregated Prefill and Decode for LLM Serving on AWS - The KV Transfer, the Routing Threshold, and What Disaggregation Does Not Fix.