framework,version,device,op_name,kernel_source,model,architecture,mla_dtype,kv_cache_dtype,gemm_type,num_heads,batch_size,isl,tp_size,step,compress_ratio,latency
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,262144,4,0.2015
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,16384,4,0.1592
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,131072,4,0.1765
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,65536,4,0.1640
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,1048575,4,0.3429
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,12288,4,0.1566
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,32768,4,0.1569
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,131072,4,0.1834
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,10240,4,0.1562
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,16384,4,0.1406
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,524288,4,0.2465
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,16384,4,0.1749
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,8192,4,0.1535
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,12288,4,0.1394
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,32768,4,0.1663
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,65536,4,0.1698
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,6144,4,0.1535
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,10240,4,0.1378
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,262144,4,0.1997
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,65536,4,0.1701
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,4096,4,0.1509
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,8192,4,0.1371
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,6144,4,0.1793
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,32768,4,0.1622
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,3072,4,0.1509
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,12288,4,0.1724
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,131072,4,0.1758
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,16384,4,0.1478
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,6144,4,0.1367
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,32768,4,0.1621
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,2048,4,0.1458
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,16384,4,0.1457
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,4096,4,0.1353
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,1536,4,0.1439
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,16384,4,0.1456
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,65536,4,0.1646
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,10240,4,0.1698
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,1024,4,0.1427
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,3072,4,0.1354
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,12288,4,0.1466
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,4096,4,0.1766
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,512,4,0.1409
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,2048,4,0.1296
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,12288,4,0.1439
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,12288,4,0.1433
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,32768,4,0.1571
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,256,4,0.1413
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,8192,4,0.1682
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,10240,4,0.1444
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,128,4,0.1409
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,1536,4,0.1293
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,10240,4,0.1430
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,10240,4,0.1425
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,3072,4,0.1755
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,16384,4,0.1406
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,64,4,0.1412
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,1024,4,0.1279
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,8192,4,0.1411
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,8192,4,0.1439
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,6144,4,0.1672
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,8192,4,0.1418
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,32,4,0.1338
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,512,4,0.1273
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,12288,4,0.1390
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,6144,4,0.1400
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,16,4,0.1337
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,2048,4,0.1694
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,6144,4,0.1414
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,6144,4,0.1424
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,256,4,0.1270
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,4096,4,0.1651
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,8,4,0.1347
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,4096,4,0.1397
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,10240,4,0.1376
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,4096,4,0.1393
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,128,4,0.1273
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,4,4,0.1338
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,3072,4,0.1391
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,1536,4,0.1661
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,4096,4,0.1416
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,3072,4,0.1642
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,1,1,4,0.1319
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,3072,4,0.1397
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,8192,4,0.1375
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,64,4,0.1265
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,2048,4,0.1334
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,1024,4,0.1618
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,1536,4,0.1337
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,32,4,0.1264
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,2048,4,0.1348
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,3072,4,0.1413
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,2048,4,0.1587
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,6144,4,0.1364
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,1536,4,0.1338
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,16,4,0.1269
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,512,4,0.1586
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,1024,4,0.1318
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,2048,4,0.1360
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,4096,4,0.1359
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,1536,4,0.1564
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,1024,4,0.1330
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,8,4,0.1271
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,256,4,0.1563
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,512,4,0.1322
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,4,4,0.1268
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,3072,4,0.1356
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,1024,4,0.1548
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,128,4,0.1563
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,1536,4,0.1349
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,512,4,0.1314
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,1,1,4,0.1245
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,256,4,0.1320
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,64,4,0.1560
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,2048,4,0.1295
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,512,4,0.1443
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,1024,4,0.1343
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,32,4,0.1542
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,256,4,0.1301
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,1536,4,0.1291
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,128,4,0.1306
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,256,4,0.1423
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,16,4,0.1541
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,512,4,0.1331
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,128,4,0.1304
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,1024,4,0.1279
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,64,4,0.1313
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,128,4,0.1427
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,8,4,0.1552
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,256,4,0.1329
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,64,4,0.1422
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,4,4,0.1545
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,64,4,0.1302
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,32,4,0.1303
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,512,4,0.1273
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,1,1,4,0.1519
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,32,4,0.1411
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,16,4,0.1305
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,128,4,0.1326
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,32,4,0.1298
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,16,4,0.1409
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,8,4,0.1311
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,8,4,0.1411
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,16,4,0.1291
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,4,4,0.1313
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,256,4,0.1272
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,64,4,0.1326
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,1,1,4,0.1283
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,4,4,0.1409
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,8,4,0.1292
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,1,1,4,0.1390
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,128,4,0.1286
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,4,4,0.1295
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,32,4,0.1314
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,1,1,4,0.1275
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,64,4,0.1275
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,16,4,0.1317
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,32,4,0.1271
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,8,4,0.1317
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,16,4,0.1274
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,4,4,0.1317
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,8,4,0.1269
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,4,4,0.1270
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,1,1,4,0.1295
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,1,1,4,0.1262
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,4096,4,0.2318
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,3072,4,0.2303
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,2048,4,0.2221
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,1536,4,0.2151
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,1,2048,4,0.3495
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,1024,4,0.2077
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,512,4,0.2009
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,256,4,0.1974
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,1,1536,4,0.3377
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,128,4,0.1962
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,64,4,0.1951
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,1048575,4,0.3317
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,32,4,0.1910
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,1,1024,4,0.3138
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,524288,4,0.2345
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,262144,4,0.1931
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,262144,4,0.1881
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,1,1024,4,0.5020
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,16,4,0.1918
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,1,512,4,0.3005
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,131072,4,0.1678
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,131072,4,0.1626
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,131072,4,0.1683
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,8,4,0.1910
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,65536,4,0.1559
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,1,256,4,0.2942
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,65536,4,0.1522
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,4,4,0.1913
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,1,512,4,0.4771
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,32768,4,0.1450
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,65536,4,0.1561
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,1,1,4,0.1874
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,32768,4,0.1483
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,16384,4,0.1275
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,1,128,4,0.2936
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,12288,4,0.1254
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,32768,4,0.1483
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,65536,4,0.1596
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,16384,4,0.1314
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,10240,4,0.1251
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,32768,4,0.1542
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,16384,4,0.1314
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,1,64,4,0.2925
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,8192,4,0.1233
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,12288,4,0.1296
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,1,256,4,0.4664
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,32768,4,0.1507
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,12288,4,0.1296
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,6144,4,0.1230
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,16384,4,0.1371
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,10240,4,0.1292
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,16384,4,0.1335
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,1,32,4,0.2855
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,4096,4,0.1228
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,1,128,4,0.4667
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,10240,4,0.1286
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,8192,4,0.1272
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,12288,4,0.1333
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,12288,4,0.1316
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,1,16,4,0.2855
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,3072,4,0.1218
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,8192,4,0.1273
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,2048,4,0.1171
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,10240,4,0.1332
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,6144,4,0.1272
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,10240,4,0.1303
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,1,64,4,0.4661
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,1,8,4,0.2857
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,1536,4,0.1167
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,4096,4,0.1253
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,6144,4,0.1269
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,8192,4,0.1317
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,1,4,4,0.2850
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,8192,4,0.1292
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,1024,4,0.1151
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,1,32,4,0.4530
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,1,1,4,0.2794
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,6144,4,0.1295
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,3072,4,0.1255
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,6144,4,0.1312
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,4096,4,0.1266
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,512,4,0.1156
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,1,16,4,0.4516
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,4096,4,0.1273
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,4096,4,0.1298
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,2048,4,0.1209
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,3072,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,256,4,0.1160
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,1,8,4,0.4511
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,3072,4,0.1273
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,128,4,0.1148
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,3072,4,0.1299
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,2048,4,0.1209
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,1536,4,0.1207
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,2048,4,0.1211
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,64,4,0.1142
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,1,4,4,0.4505
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,2048,4,0.1233
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,1536,4,0.1213
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,1536,4,0.1199
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,1024,4,0.1194
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,32,4,0.1147
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,1536,4,0.1232
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,1024,4,0.1200
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,1,1,4,0.4423
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,16,4,0.1149
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,1024,4,0.1184
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,512,4,0.1185
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,512,4,0.1187
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,1024,4,0.1225
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,8,4,0.1147
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,512,4,0.1181
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,256,4,0.1187
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,256,4,0.1181
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,4,4,0.1142
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,512,4,0.1216
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,256,4,0.1192
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,128,4,0.1174
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,2,1,4,0.1126
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,128,4,0.1179
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,256,4,0.1205
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,128,4,0.1189
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,64,4,0.1178
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,64,4,0.1170
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,32,4,0.1167
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,128,4,0.1206
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,16,4,0.1165
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,64,4,0.1187
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,32,4,0.1172
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,64,4,0.1213
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,8,4,0.1173
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,32,4,0.1174
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,16,4,0.1171
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,32,4,0.1192
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,4,4,0.1165
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,16,4,0.1197
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,8,4,0.1174
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,16,4,0.1189
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,2,1,4,0.1151
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,8,4,0.1198
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,8,4,0.1173
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,4,4,0.1168
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,4,4,0.1182
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,4,4,0.1207
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,2,1,4,0.1155
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,2,1,4,0.1153
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,2,1,4,0.1182
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,16384,4,0.1440
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,12288,4,0.1412
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,10240,4,0.1400
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,8192,4,0.1377
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,6144,4,0.1374
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,4096,4,0.1342
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,3072,4,0.1348
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,2048,4,0.1293
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,1536,4,0.1274
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,1024,4,0.1256
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,512,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,256,4,0.1249
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,128,4,0.1247
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,64,4,0.1237
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,32,4,0.1175
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,16,4,0.1182
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,16384,4,0.1569
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,8,4,0.1184
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,4,4,0.1173
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,12288,4,0.1538
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,2,1,4,0.1163
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,10240,4,0.1524
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,8192,4,0.1499
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,6144,4,0.1585
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,6144,4,0.1491
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,4096,4,0.2103
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,4096,4,0.1465
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,4096,4,0.1565
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,3072,4,0.2092
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,3072,4,0.1463
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,3072,4,0.1546
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,2048,4,0.1397
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,1536,4,0.1376
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,2048,4,0.2003
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,2048,4,0.1486
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,1024,4,0.1358
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,1536,4,0.1451
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,1536,4,0.1927
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,512,4,0.1254
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,1024,4,0.1417
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,256,4,0.1234
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,1024,4,0.1861
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,512,4,0.1370
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,128,4,0.1236
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,256,4,0.1355
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,512,4,0.1788
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,128,4,0.1354
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,64,4,0.1239
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,256,4,0.1756
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,2,2048,4,0.3142
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,64,4,0.1349
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,128,4,0.1742
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,1048575,4,0.3151
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,32,4,0.1333
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,32,4,0.1225
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,16,4,0.1333
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,262144,4,0.1867
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,64,4,0.1744
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,524288,4,0.2201
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,8,4,0.1334
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,32,4,0.1703
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,2,1024,4,0.4391
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,16,4,0.1217
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,4,4,0.1330
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,2,1536,4,0.3023
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,16,4,0.1705
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,262144,4,0.1749
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,131072,4,0.1619
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,2,1,4,0.1312
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,8,4,0.1229
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,8,4,0.1705
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,131072,4,0.1500
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,4,4,0.1218
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,4,4,0.1702
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,65536,4,0.1375
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,2,1024,4,0.2788
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,65536,4,0.1478
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,2,512,4,0.4156
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,32768,4,0.1313
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,2,1,4,0.1202
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,2,1,4,0.1676
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,16384,4,0.1152
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,32768,4,0.1418
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,12288,4,0.1148
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,2,256,4,0.4042
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,2,512,4,0.2656
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,10240,4,0.1130
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,8192,4,0.1130
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,16384,4,0.1236
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,2,128,4,0.4043
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,6144,4,0.1113
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,2,256,4,0.2598
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,4096,4,0.1108
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,12288,4,0.1222
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,2,64,4,0.4046
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,3072,4,0.1098
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,2,128,4,0.2595
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,2048,4,0.1048
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,10240,4,0.1214
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,1536,4,0.1038
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,2,32,4,0.3917
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,2,64,4,0.2588
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,1024,4,0.1047
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,8192,4,0.1200
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,2,16,4,0.3905
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,2,32,4,0.2510
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,2,8,4,0.3893
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,512,4,0.1048
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,6144,4,0.1191
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,2,16,4,0.2508
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,2,4,4,0.3893
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,256,4,0.1041
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,128,4,0.1034
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,2,8,4,0.2496
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,2,1,4,0.3805
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,4096,4,0.1186
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,64,4,0.1041
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,2,4,4,0.2511
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,32,4,0.1031
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,3072,4,0.1182
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,16,4,0.1027
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,2048,4,0.1123
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,2,1,4,0.2443
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,8,4,0.1027
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,1536,4,0.1104
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,4,4,0.1026
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,1024,4,0.1107
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,4,1,4,0.1006
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,512,4,0.1101
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,256,4,0.1108
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,128,4,0.1102
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,64,4,0.1107
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,32,4,0.1100
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,16,4,0.1109
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,8,4,0.1099
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,4,4,0.1108
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,4,1,4,0.1079
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,131072,4,0.1637
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,65536,4,0.1509
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,32768,4,0.1418
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,16384,4,0.1254
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,12288,4,0.1241
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,10240,4,0.1227
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,8192,4,0.1223
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,6144,4,0.1212
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,4096,4,0.1192
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,3072,4,0.1195
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,2048,4,0.1144
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,1536,4,0.1129
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,1024,4,0.1116
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,512,4,0.1102
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,256,4,0.1090
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,128,4,0.1109
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,64,4,0.1109
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,32,4,0.1101
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,16,4,0.1104
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,8,4,0.1106
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,4,4,0.1106
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,4,1,4,0.1088
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,65536,4,0.1522
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,32768,4,0.1439
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,32768,4,0.1454
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,16384,4,0.1272
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,12288,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,16384,4,0.1255
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,10240,4,0.1232
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,12288,4,0.1238
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,8192,4,0.1216
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,10240,4,0.1216
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,6144,4,0.1219
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,16384,4,0.1337
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,8192,4,0.1214
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,4096,4,0.1206
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,6144,4,0.1207
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,3072,4,0.1210
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,12288,4,0.1319
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,2048,4,0.1151
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,16384,4,0.1466
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,1536,4,0.1133
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,4096,4,0.1193
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,10240,4,0.1313
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,1024,4,0.1126
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,12288,4,0.1438
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,512,4,0.1112
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,8192,4,0.1292
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,3072,4,0.1187
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,256,4,0.1088
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,2048,4,0.1134
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,6144,4,0.1291
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,128,4,0.1096
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,10240,4,0.1422
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,1536,4,0.1114
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,64,4,0.1101
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,1024,4,0.1107
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,4096,4,0.1260
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,32,4,0.1100
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,512,4,0.1106
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,8192,4,0.1405
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,3072,4,0.1267
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,6144,4,0.1468
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,256,4,0.1072
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,2048,4,0.1210
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,16,4,0.1088
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,128,4,0.1062
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,1536,4,0.1198
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,6144,4,0.1397
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,8,4,0.1088
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,64,4,0.1064
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,4096,4,0.1443
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,1024,4,0.1170
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,4,4,0.1090
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,32,4,0.1062
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,4096,4,0.1357
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,4096,4,0.1883
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,512,4,0.1158
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,4,1,4,0.1082
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,3072,4,0.1434
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,16,4,0.1063
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,3072,4,0.1361
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,8,4,0.1062
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,256,4,0.1159
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,3072,4,0.1871
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,4,4,0.1068
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,2048,4,0.1372
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,4,1,4,0.1047
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,2048,4,0.1299
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,128,4,0.1149
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,1536,4,0.1336
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,2048,4,0.1776
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,64,4,0.1155
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,1536,4,0.1271
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,4,2048,4,0.2783
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,32,4,0.1059
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,1024,4,0.1303
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,1024,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,1536,4,0.1708
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,16,4,0.1077
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,8,4,0.1071
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,512,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,512,4,0.1158
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,4,1536,4,0.2647
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,4,4,0.1071
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,1024,4,0.1639
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,4,1,4,0.1049
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,256,4,0.1140
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,256,4,0.1235
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,512,4,0.1566
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,128,4,0.1137
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,4,1024,4,0.2423
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,128,4,0.1229
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,256,4,0.1531
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,64,4,0.1230
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,64,4,0.1142
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,4,512,4,0.2290
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,32,4,0.1213
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,32,4,0.1110
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,128,4,0.1527
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,4,256,4,0.2226
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,16,4,0.1214
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,16,4,0.1108
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,64,4,0.1518
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,8,4,0.1211
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,4,128,4,0.2228
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,8,4,0.1124
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,32,4,0.1482
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,4,4,0.1213
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,4,4,0.1116
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,4,64,4,0.2227
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,16,4,0.1476
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,4,1,4,0.1098
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,4,1,4,0.1191
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,8,4,0.1476
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,4,32,4,0.2149
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,4,4,0.1472
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,4,16,4,0.2149
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,4,1,4,0.1449
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,4,8,4,0.2134
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,4,4,4,0.2133
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,4,1,4,0.2081
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,4,1024,4,0.3726
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,4,512,4,0.3503
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,4,256,4,0.3381
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,4,128,4,0.3383
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,4,64,4,0.3382
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,4,32,4,0.3260
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,4,16,4,0.3239
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,4,8,4,0.3232
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,4,4,4,0.3230
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,4,1,4,0.3139
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,262144,4,0.1688
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,131072,4,0.1411
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,1048575,4,0.3134
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,65536,4,0.1271
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,524288,4,0.2108
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,32768,4,0.1191
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,131072,4,0.1505
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,16384,4,0.1026
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,262144,4,0.1615
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,12288,4,0.1007
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,131072,4,0.1355
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,10240,4,0.0995
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,65536,4,0.1336
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,65536,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,8192,4,0.0987
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,32768,4,0.1187
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,6144,4,0.0984
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,32768,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,16384,4,0.1008
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,4096,4,0.0965
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,12288,4,0.0989
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,16384,4,0.1085
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,3072,4,0.0965
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,10240,4,0.0986
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,2048,4,0.0911
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,12288,4,0.1066
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,8192,4,0.0969
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,1536,4,0.0904
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,6144,4,0.0967
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,10240,4,0.1047
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,1024,4,0.0891
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,8192,4,0.1029
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,4096,4,0.0965
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,512,4,0.0884
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,6144,4,0.1033
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,3072,4,0.0964
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,256,4,0.0883
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,128,4,0.0884
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,2048,4,0.0904
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,4096,4,0.1014
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,65536,4,0.1418
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,64,4,0.0883
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,1536,4,0.0894
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,3072,4,0.1006
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,32768,4,0.1313
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,1024,4,0.0884
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,32,4,0.0883
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,2048,4,0.0964
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,16384,4,0.1132
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,16,4,0.0883
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,32768,4,0.1357
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,512,4,0.0891
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,1536,4,0.0944
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,12288,4,0.1110
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,8,4,0.0885
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,256,4,0.0883
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,1024,4,0.0937
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,4,4,0.0883
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,128,4,0.0883
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,16384,4,0.1277
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,16384,4,0.1163
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,512,4,0.0919
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,10240,4,0.1098
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,2,1,8,1,4,0.0863
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,64,4,0.0883
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,256,4,0.0908
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,32,4,0.0880
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,12288,4,0.1236
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,16384,4,0.1395
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,12288,4,0.1133
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,128,4,0.0908
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,8192,4,0.1088
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,16,4,0.0867
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,10240,4,0.1221
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,64,4,0.0912
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,8,4,0.0872
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,6144,4,0.1065
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,8192,4,0.1201
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,10240,4,0.1109
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,12288,4,0.1369
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,4,4,0.0869
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,32,4,0.0904
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,6144,4,0.1188
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1,1,8,1,4,0.0863
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,4096,4,0.1050
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,4096,4,0.1171
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,8192,4,0.1116
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,16,4,0.0903
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,10240,4,0.1351
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,3072,4,0.1165
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,3072,4,0.1059
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,2048,4,0.1110
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,8,4,0.0903
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,6144,4,0.1103
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,8192,4,0.1328
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,1536,4,0.1098
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,2048,4,0.1006
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,4,4,0.0904
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,1024,4,0.1077
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,4096,4,0.1087
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,512,4,0.1052
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,1536,4,0.0986
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,4,1,8,1,4,0.0885
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,6144,4,0.1319
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,256,4,0.1039
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,3072,4,0.1078
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,1024,4,0.0965
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,128,4,0.1039
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,64,4,0.1031
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,4096,4,0.1292
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,512,4,0.0945
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,2048,4,0.1026
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,32,4,0.0922
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,256,4,0.0938
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,1536,4,0.0992
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,16,4,0.0922
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,128,4,0.0941
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,3072,4,0.1292
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,1024,4,0.0982
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,8,4,0.0924
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,64,4,0.0933
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,512,4,0.0975
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,4,4,0.0914
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,2048,4,0.1223
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,32,4,0.0925
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,32,1,8,1,4,0.0904
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,256,4,0.0951
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,16,4,0.0924
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,1536,4,0.1202
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,128,4,0.0946
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,8,4,0.0924
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,1024,4,0.1185
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,64,4,0.0961
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,4,4,0.0925
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,512,4,0.1066
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,8,1,8,1,4,0.0919
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,32,4,0.0928
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,256,4,0.1029
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,128,4,0.1025
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,16,4,0.0945
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,64,4,0.1007
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,8,4,0.0931
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,4,4,0.0941
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,32,4,0.0985
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,16,1,8,1,4,0.0914
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,16,4,0.0968
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,8,4,0.0968
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,4,4,0.0965
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,64,1,8,1,4,0.0945
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,6144,4,0.1378
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,4096,4,0.1357
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,3072,4,0.1346
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,2048,4,0.1286
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,1536,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,1024,4,0.1211
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,512,4,0.1170
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,256,4,0.1141
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,128,4,0.1146
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,64,4,0.1132
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,32,4,0.1107
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,16,4,0.1087
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,8,4,0.1103
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,4,4,0.1088
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,128,1,8,1,4,0.1054
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,4096,4,0.1758
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,3072,4,0.1738
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,8,2048,4,0.2567
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,2048,4,0.1648
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,8,1536,4,0.2443
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,1536,4,0.1581
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,1024,4,0.1510
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,8,1024,4,0.2215
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,512,4,0.1437
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,256,4,0.1400
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,8,512,4,0.2082
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,128,4,0.1399
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,8,256,4,0.2023
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,8,1024,4,0.3366
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,64,4,0.1389
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,8,128,4,0.2014
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,1048575,4,0.3343
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,32,4,0.1356
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,16,4,0.1354
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,8,64,4,0.2009
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,524288,4,0.2403
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,8,512,4,0.3141
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,8,4,0.1350
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,8,32,4,0.1935
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,262144,4,0.1955
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,4,4,0.1350
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,262144,4,0.2073
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,8,16,4,0.1928
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,131072,4,0.1721
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,256,1,8,1,4,0.1317
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,8,8,4,0.1923
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,65536,4,0.1616
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,8,256,4,0.3031
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,8,4,4,0.1914
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,131072,4,0.1834
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,32768,4,0.1548
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,512,1,8,1,4,0.1865
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,16384,4,0.1397
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,65536,4,0.1695
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,8,128,4,0.3032
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,131072,4,0.1835
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,12288,4,0.1375
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,32768,4,0.1640
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,10240,4,0.1367
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,65536,4,0.1701
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,8,64,4,0.3023
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,16384,4,0.1469
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,8192,4,0.1354
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,12288,4,0.1451
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,32768,4,0.1631
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,65536,4,0.1756
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,10240,4,0.1438
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,8,32,4,0.2908
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,6144,4,0.1357
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,16384,4,0.1452
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,8192,4,0.1434
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,32768,4,0.1676
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,6144,4,0.1419
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,4096,4,0.1342
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,8,16,4,0.2890
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,16384,4,0.1496
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,12288,4,0.1439
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,4096,4,0.1414
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,12288,4,0.1477
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,3072,4,0.1333
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,3072,4,0.1407
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,10240,4,0.1430
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,8,8,4,0.2884
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,10240,4,0.1473
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,8192,4,0.1459
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,8192,4,0.1428
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,2048,4,0.1290
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,8,4,4,0.2878
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,2048,4,0.1371
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,1536,4,0.1279
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,6144,4,0.1407
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,6144,4,0.1445
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,bfloat16,64,1024,1,8,1,4,0.2792
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,1024,4,0.1279
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,1536,4,0.1353
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,4096,4,0.1403
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,4096,4,0.1442
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,512,4,0.1266
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,3072,4,0.1397
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,256,4,0.1271
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,1024,4,0.1346
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,3072,4,0.1433
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,2048,4,0.1354
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,128,4,0.1258
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,64,4,0.1270
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,1536,4,0.1340
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,2048,4,0.1378
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,512,4,0.1339
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,32,4,0.1255
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,1024,4,0.1328
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,1536,4,0.1374
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,512,4,0.1316
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,256,4,0.1337
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,16,4,0.1253
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,1024,4,0.1370
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,256,4,0.1324
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,8,4,0.1255
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,128,4,0.1334
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,128,4,0.1312
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,512,4,0.1353
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,64,4,0.1314
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,4,4,0.1255
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,256,4,0.1353
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,64,4,0.1333
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,128,4,0.1353
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,32,4,0.1310
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,1,1,4,0.1232
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,32,4,0.1333
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,64,4,0.1342
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,16,4,0.1316
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,16,4,0.1336
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,32,4,0.1345
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,8,4,0.1311
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,16,4,0.1342
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,8,4,0.1323
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,4,4,0.1313
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,8,4,0.1341
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,4,4,0.1327
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,4,4,0.1344
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,1,1,4,0.1310
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,1,1,4,0.1292
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,1,1,4,0.1318
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,32768,4,0.1703
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,16384,4,0.1520
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,12288,4,0.1506
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,10240,4,0.1486
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,8192,4,0.1482
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,6144,4,0.1463
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,4096,4,0.1458
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,3072,4,0.1459
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,2048,4,0.1405
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,1536,4,0.1396
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,1024,4,0.1393
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,512,4,0.1386
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,256,4,0.1374
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,128,4,0.1369
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,64,4,0.1373
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,32,4,0.1354
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,16,4,0.1360
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,8,4,0.1363
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,4,4,0.1361
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,1,1,4,0.1339
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,16384,4,0.1588
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,16384,4,0.1748
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,12288,4,0.1561
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,10240,4,0.1553
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,12288,4,0.1720
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,8192,4,0.1527
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,10240,4,0.1700
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,6144,4,0.1527
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,8192,4,0.1682
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,4096,4,0.1507
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,6144,4,0.1664
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,3072,4,0.1505
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,4096,4,0.1645
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,2048,4,0.1440
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,3072,4,0.1637
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,1536,4,0.1438
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,2048,4,0.1577
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,1024,4,0.1417
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,1536,4,0.1569
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,512,4,0.1405
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,1024,4,0.1550
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,256,4,0.1402
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,512,4,0.1439
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,128,4,0.1405
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,256,4,0.1425
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,6144,4,0.1817
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,64,4,0.1397
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,128,4,0.1424
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,32,4,0.1336
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,64,4,0.1418
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,4096,4,0.1785
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,16,4,0.1337
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,32,4,0.1407
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,8,4,0.1336
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,16,4,0.1410
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,3072,4,0.1769
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,4,4,0.1332
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,8,4,0.1412
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,1,1,4,0.1313
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,2048,4,0.1703
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,4,4,0.1407
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,1536,4,0.1684
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,1,1,4,0.1384
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,1024,4,0.1633
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,512,4,0.1601
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,4096,4,0.2381
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,256,4,0.1580
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,128,4,0.1580
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,3072,4,0.2351
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,64,4,0.1582
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,32,4,0.1564
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,2048,4,0.2270
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,16,4,0.1561
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,1536,4,0.2198
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,8,4,0.1561
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,1048575,4,0.3368
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,4,4,0.1562
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,1,2048,4,0.3527
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,1,1,4,0.1541
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,1,1024,4,0.5029
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,1024,4,0.2124
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,524288,4,0.2389
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,262144,4,0.1910
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,512,4,0.2048
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,131072,4,0.1674
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,1,1536,4,0.3398
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,256,4,0.2021
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,65536,4,0.1554
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,1,512,4,0.4793
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,32768,4,0.1479
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,128,4,0.2001
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,16384,4,0.1314
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,1,1024,4,0.3154
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,1,256,4,0.4675
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,64,4,0.2011
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,12288,4,0.1296
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,1,512,4,0.3022
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,1,128,4,0.4675
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,32,4,0.1957
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,10240,4,0.1290
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,1,64,4,0.4682
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,1,256,4,0.2966
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,8192,4,0.1278
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,1,32,4,0.4551
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,16,4,0.1969
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,6144,4,0.1273
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,8,4,0.1966
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,1,16,4,0.4537
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,1,128,4,0.2958
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,4096,4,0.1269
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,1,64,4,0.2951
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,4,4,0.1969
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,1,8,4,0.4519
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,3072,4,0.1263
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,2048,4,0.1208
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,1,32,4,0.2868
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,1,1,4,0.1932
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,1,4,4,0.4519
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,1536,4,0.1203
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,262144,4,0.2014
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,1,16,4,0.2869
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,1024,4,0.1191
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,1,1,4,0.4437
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,512,4,0.1190
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,1,8,4,0.2860
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,131072,4,0.1759
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,256,4,0.1191
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,1,4,4,0.2869
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,65536,4,0.1635
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,128,4,0.1190
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,1,1,4,0.2802
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,64,4,0.1179
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,32768,4,0.1575
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,32,4,0.1181
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,16384,4,0.1394
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,16,4,0.1189
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,8,4,0.1184
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,12288,4,0.1382
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,4,4,0.1189
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,10240,4,0.1371
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,2,1,4,0.1167
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,8192,4,0.1353
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,6144,4,0.1336
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,4096,4,0.1332
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,3072,4,0.1333
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,2048,4,0.1284
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,1536,4,0.1272
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,1024,4,0.1268
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,512,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,256,4,0.1256
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,128,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,64,4,0.1253
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,32,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,16,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,8,4,0.1251
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,4,4,0.1246
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,2,1,4,0.1233
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,131072,4,0.1762
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,65536,4,0.1676
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,65536,4,0.1620
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,32768,4,0.1598
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,32768,4,0.1540
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,16384,4,0.1426
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,16384,4,0.1375
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,12288,4,0.1369
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,12288,4,0.1396
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,10240,4,0.1354
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,10240,4,0.1393
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,8192,4,0.1349
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,8192,4,0.1376
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,6144,4,0.1329
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,6144,4,0.1375
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,4096,4,0.1315
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,4096,4,0.1359
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,3072,4,0.1321
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,3072,4,0.1355
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,2048,4,0.1272
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,2048,4,0.1297
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,1536,4,0.1265
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,1536,4,0.1290
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,1024,4,0.1237
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,32768,4,0.1609
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,512,4,0.1231
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,1024,4,0.1278
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,256,4,0.1232
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,512,4,0.1269
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,128,4,0.1235
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,256,4,0.1251
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,16384,4,0.1430
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,64,4,0.1231
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,128,4,0.1259
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,32,4,0.1231
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,64,4,0.1253
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,12288,4,0.1416
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,32,4,0.1249
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,16,4,0.1216
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,16,4,0.1247
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,8,4,0.1231
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,10240,4,0.1398
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,8,4,0.1249
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,4,4,0.1231
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,8192,4,0.1390
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,4,4,0.1253
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,2,1,4,0.1210
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,6144,4,0.1373
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,2,1,4,0.1227
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,4096,4,0.1374
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,3072,4,0.1359
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,2048,4,0.1314
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,1536,4,0.1306
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,1024,4,0.1295
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,512,4,0.1286
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,256,4,0.1275
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,16384,4,0.1506
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,128,4,0.1268
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,64,4,0.1273
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,12288,4,0.1475
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,32,4,0.1257
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,16,4,0.1259
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,10240,4,0.1456
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,8,4,0.1256
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,8192,4,0.1444
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,4,4,0.1268
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,6144,4,0.1441
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,16384,4,0.1650
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,6144,4,0.1696
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,2,1,4,0.1235
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,4096,4,0.1411
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,3072,4,0.1415
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,12288,4,0.1625
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,4096,4,0.1670
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,2048,4,0.1352
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,4096,4,0.2210
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,1536,4,0.1337
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,10240,4,0.1609
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,3072,4,0.1643
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,1024,4,0.1327
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,3072,4,0.2171
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,512,4,0.1310
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,8192,4,0.1582
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,2048,4,0.1597
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,256,4,0.1305
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,1536,4,0.1558
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,2048,4,0.2098
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,128,4,0.1306
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,6144,4,0.1573
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,1024,4,0.1514
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,64,4,0.1295
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,1536,4,0.2020
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,512,4,0.1470
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,4096,4,0.1545
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,32,4,0.1233
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,256,4,0.1452
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,1024,4,0.1950
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,16,4,0.1231
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,128,4,0.1460
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,3072,4,0.1550
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,8,4,0.1235
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,64,4,0.1453
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,512,4,0.1884
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,4,4,0.1230
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,32,4,0.1435
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,2048,4,0.1485
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,256,4,0.1847
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,16,4,0.1435
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,2,1,4,0.1211
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,1536,4,0.1468
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,128,4,0.1845
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,8,4,0.1435
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,1024,4,0.1442
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,4,4,0.1435
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,64,4,0.1835
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,512,4,0.1343
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,2,1,4,0.1430
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,32,4,0.1795
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,256,4,0.1320
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,16,4,0.1796
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,128,4,0.1324
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,8,4,0.1795
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,4,4,0.1786
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,64,4,0.1317
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,2,2048,4,0.3254
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,2,1,4,0.1753
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,32,4,0.1304
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,16,4,0.1306
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,8,4,0.1298
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,2,1536,4,0.3116
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,4,4,0.1305
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,2,1,4,0.1276
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,2,1024,4,0.2888
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,2,512,4,0.2748
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,2,256,4,0.2701
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,2,128,4,0.2690
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,2,64,4,0.2684
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,2,32,4,0.2598
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,2,16,4,0.2598
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,2,8,4,0.2589
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,2,4,4,0.2584
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,2,1,4,0.2535
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,1048575,4,0.3234
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,524288,4,0.2259
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,262144,4,0.1781
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,2,1024,4,0.4470
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,131072,4,0.1533
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,65536,4,0.1416
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,32768,4,0.1349
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,16384,4,0.1178
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,2,512,4,0.4234
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,12288,4,0.1171
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,10240,4,0.1149
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,8192,4,0.1142
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,2,256,4,0.4130
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,262144,4,0.1910
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,6144,4,0.1129
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,2,128,4,0.4119
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,4096,4,0.1130
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,131072,4,0.1640
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,3072,4,0.1129
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,65536,4,0.1500
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,2,64,4,0.4117
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,2048,4,0.1068
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,32768,4,0.1439
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,2,32,4,0.3986
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,1536,4,0.1067
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,16384,4,0.1272
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,12288,4,0.1251
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,1024,4,0.1056
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,2,16,4,0.3973
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,10240,4,0.1241
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,512,4,0.1047
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,2,8,4,0.3953
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,8192,4,0.1231
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,256,4,0.1047
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,6144,4,0.1212
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,2,4,4,0.3957
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,128,4,0.1044
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,4096,4,0.1210
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,64,4,0.1047
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,3072,4,0.1209
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,2,1,4,0.3862
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,32,4,0.1047
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,2048,4,0.1160
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,16,4,0.1048
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,1536,4,0.1149
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,8,4,0.1031
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,1024,4,0.1128
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,4,4,0.1048
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,512,4,0.1124
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,4,1,4,0.1027
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,256,4,0.1117
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,128,4,0.1115
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,64,4,0.1127
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,131072,4,0.1651
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,32,4,0.1108
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,16,4,0.1108
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,65536,4,0.1499
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,8,4,0.1109
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,32768,4,0.1435
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,4,4,0.1110
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,4,1,4,0.1091
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,16384,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,12288,4,0.1234
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,10240,4,0.1224
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,65536,4,0.1596
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,8192,4,0.1211
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,6144,4,0.1205
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,32768,4,0.1487
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,32768,4,0.1518
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,4096,4,0.1200
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,3072,4,0.1190
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,16384,4,0.1315
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,16384,4,0.1323
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,2048,4,0.1148
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,12288,4,0.1293
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,12288,4,0.1293
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,1536,4,0.1127
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,10240,4,0.1280
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,10240,4,0.1274
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,1024,4,0.1111
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,16384,4,0.1417
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,8192,4,0.1260
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,8192,4,0.1273
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,6144,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,512,4,0.1104
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,6144,4,0.1265
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,12288,4,0.1386
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,4096,4,0.1257
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,256,4,0.1089
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,3072,4,0.1235
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,10240,4,0.1376
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,128,4,0.1092
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,2048,4,0.1179
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,4096,4,0.1252
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,1536,4,0.1159
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,64,4,0.1088
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,1024,4,0.1146
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,8192,4,0.1357
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,32,4,0.1091
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,3072,4,0.1245
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,512,4,0.1130
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,16,4,0.1088
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,6144,4,0.1354
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,256,4,0.1131
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,8,4,0.1087
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,2048,4,0.1192
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,128,4,0.1128
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,4096,4,0.1328
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,4,4,0.1088
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,1536,4,0.1182
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,4,1,4,0.1068
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,64,4,0.1133
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,3072,4,0.1327
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,16384,4,0.1569
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,2048,4,0.1267
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,32,4,0.1121
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,1024,4,0.1170
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,1536,4,0.1256
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,16,4,0.1115
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,512,4,0.1149
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,12288,4,0.1544
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,1024,4,0.1235
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,8,4,0.1109
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,512,4,0.1210
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,4,4,0.1118
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,256,4,0.1137
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,256,4,0.1207
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,4,1,4,0.1101
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,10240,4,0.1528
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,128,4,0.1205
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,128,4,0.1135
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,64,4,0.1199
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,32,4,0.1125
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,64,4,0.1139
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,8192,4,0.1501
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,16,4,0.1136
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,8,4,0.1125
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,32,4,0.1129
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,4,4,0.1129
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,6144,4,0.1497
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,4,1,4,0.1109
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,16,4,0.1130
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,4096,4,0.1458
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,8,4,0.1129
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,4,4,0.1129
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,3072,4,0.1457
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,4,1,4,0.1115
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,2048,4,0.1396
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,1536,4,0.1375
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,1024,4,0.1349
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,512,4,0.1233
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,256,4,0.1210
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,128,4,0.1212
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,64,4,0.1200
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,32,4,0.1189
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,16,4,0.1189
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,8,4,0.1183
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,4,4,0.1189
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,4,1,4,0.1168
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,6144,4,0.1579
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,4096,4,0.1556
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,3072,4,0.1552
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,2048,4,0.1478
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,1536,4,0.1455
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,1024,4,0.1391
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,512,4,0.1353
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,256,4,0.1325
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,128,4,0.1331
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,4096,4,0.2013
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,64,4,0.1312
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,32,4,0.1300
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,4,2048,4,0.2924
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,3072,4,0.1984
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,16,4,0.1295
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,8,4,0.1295
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,2048,4,0.1907
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,4,4,0.1280
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,4,1536,4,0.2804
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,1536,4,0.1833
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,4,1,4,0.1262
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,1024,4,0.1764
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,512,4,0.1696
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,4,1024,4,0.2569
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,256,4,0.1655
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,128,4,0.1647
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,4,512,4,0.2435
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,64,4,0.1637
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,32,4,0.1592
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,4,256,4,0.2368
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,16,4,0.1584
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,8,4,0.1578
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,4,128,4,0.2361
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,4,4,0.1582
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,4,64,4,0.2357
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,4,1,4,0.1550
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,4,32,4,0.2266
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,4,16,4,0.2270
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,4,8,4,0.2261
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,4,4,4,0.2258
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,4,1,4,0.2207
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,1048575,4,0.3180
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,524288,4,0.2163
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,262144,4,0.1692
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,131072,4,0.1456
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,65536,4,0.1344
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,32768,4,0.1286
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,4,1024,4,0.3844
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,16384,4,0.1108
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,12288,4,0.1089
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,262144,4,0.1764
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,10240,4,0.1078
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,4,512,4,0.3609
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,8192,4,0.1078
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,131072,4,0.1518
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,6144,4,0.1068
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,4096,4,0.1052
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,4,256,4,0.3500
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,65536,4,0.1395
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,3072,4,0.1049
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,131072,4,0.1560
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,2048,4,0.1006
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,32768,4,0.1329
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,4,128,4,0.3496
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,65536,4,0.1401
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,1536,4,0.0985
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,16384,4,0.1160
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,1024,4,0.0985
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,12288,4,0.1142
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,32768,4,0.1328
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,4,64,4,0.3493
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,512,4,0.0964
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,16384,4,0.1157
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,256,4,0.0966
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,10240,4,0.1130
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,128,4,0.0967
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,4,32,4,0.3365
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,12288,4,0.1148
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,64,4,0.0965
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,10240,4,0.1132
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,32,4,0.0972
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,8192,4,0.1121
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,4,16,4,0.3345
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,16,4,0.0967
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,8192,4,0.1127
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,8,4,0.0964
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,6144,4,0.1109
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,6144,4,0.1122
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,4,4,0.0965
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,4,8,4,0.3330
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,4096,4,0.1100
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1,1,8,1,4,0.0944
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,4096,4,0.1107
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,3072,4,0.1103
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,4,4,4,0.3332
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,2048,4,0.1047
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,3072,4,0.1097
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,4,1,4,0.3251
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,1536,4,0.1047
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,2048,4,0.1048
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,65536,4,0.1468
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,1024,4,0.1035
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,1536,4,0.1047
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,32768,4,0.1374
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,512,4,0.1019
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,1024,4,0.1027
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,256,4,0.1027
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,16384,4,0.1190
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,128,4,0.1017
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,512,4,0.1017
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,12288,4,0.1170
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,64,4,0.1027
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,256,4,0.1021
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,10240,4,0.1166
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,128,4,0.1022
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,8192,4,0.1149
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,32,4,0.1008
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,6144,4,0.1144
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,64,4,0.1026
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,32,4,0.1007
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,4096,4,0.1127
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,16,4,0.1010
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,16,4,0.1007
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,3072,4,0.1129
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,8,4,0.1007
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,8,4,0.1008
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,2048,4,0.1069
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,4,4,0.1008
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,4,4,0.1023
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,1536,4,0.1067
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,4,1,8,1,4,0.1006
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,2,1,8,1,4,0.0997
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,1024,4,0.1047
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,512,4,0.1047
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,256,4,0.1028
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,128,4,0.1029
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,64,4,0.1027
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,32,4,0.1027
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,16,4,0.1027
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,8,4,0.1026
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,4,4,0.1027
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,8,1,8,1,4,0.1009
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,32768,4,0.1428
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,16384,4,0.1215
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,12288,4,0.1191
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,10240,4,0.1173
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,8192,4,0.1169
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,6144,4,0.1153
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,16384,4,0.1340
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,4096,4,0.1140
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,3072,4,0.1141
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,12288,4,0.1299
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,2048,4,0.1072
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,1536,4,0.1069
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,10240,4,0.1291
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,1024,4,0.1055
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,512,4,0.1050
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,8192,4,0.1270
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,256,4,0.1040
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,6144,4,0.1258
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,128,4,0.1048
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,64,4,0.1043
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,4096,4,0.1228
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,16384,4,0.1520
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,3072,4,0.1220
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,32,4,0.1027
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,2048,4,0.1166
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,16,4,0.1026
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,1536,4,0.1148
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,8,4,0.1027
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,12288,4,0.1479
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,4,4,0.1027
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,1024,4,0.1116
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,16,1,8,1,4,0.1010
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,512,4,0.1112
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,10240,4,0.1468
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,256,4,0.1093
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,128,4,0.1100
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,8192,4,0.1441
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,64,4,0.1088
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,32,4,0.1006
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,6144,4,0.1423
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,16,4,0.1006
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,8,4,0.1006
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,4096,4,0.1407
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,4,4,0.1006
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,3072,4,0.1399
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,32,1,8,1,4,0.0985
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,2048,4,0.1333
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,1536,4,0.1316
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,1024,4,0.1295
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,512,4,0.1143
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,256,4,0.1110
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,128,4,0.1110
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,64,4,0.1088
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,32,4,0.1068
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,16,4,0.1066
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,6144,4,0.1507
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,8,4,0.1067
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,4,4,0.1068
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,4096,4,0.1480
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,4096,4,0.1902
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,64,1,8,1,4,0.1041
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,3072,4,0.1468
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,2048,4,0.1396
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,3072,4,0.1876
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,1536,4,0.1357
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,1024,4,0.1311
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,2048,4,0.1805
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,512,4,0.1267
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,1536,4,0.1729
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,256,4,0.1234
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,128,4,0.1234
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,1024,4,0.1655
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,64,4,0.1207
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,512,4,0.1582
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,32,4,0.1185
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,256,4,0.1549
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,16,4,0.1182
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,128,4,0.1541
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,8,4,0.1170
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,64,4,0.1535
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,32,4,0.1477
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,4,4,0.1176
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,16,4,0.1479
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,128,1,8,1,4,0.1149
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,8,4,0.1462
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,4,4,0.1466
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,8,2048,4,0.2726
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,256,1,8,1,4,0.1416
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,8,1536,4,0.2595
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,8,1024,4,0.3509
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,8,1024,4,0.2362
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,8,512,4,0.2221
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,8,512,4,0.3266
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,8,256,4,0.2183
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,8,128,4,0.2159
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,8,256,4,0.3155
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,8,64,4,0.2144
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,8,128,4,0.3149
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,8,32,4,0.2070
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,8,64,4,0.3155
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,8,16,4,0.2071
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,8,32,4,0.3024
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,8,8,4,0.2060
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,8,16,4,0.3004
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,8,4,4,0.2060
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,8,8,4,0.2993
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,512,1,8,1,4,0.2006
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,8,4,4,0.2992
SGLang,0.5.10rc0,NVIDIA B300 SXM6 AC,dsv4_flash_csa_generation_module,compressed_flashmla,sgl-project/DeepSeek-V4-Flash-FP8,DeepseekV4ForCausalLM,bfloat16,fp8_e4m3,fp8_block,64,1024,1,8,1,4,0.2913
