Spaces:

microsoft
/

MInference

Running on Zero

App Files Files Community

MInference / minference /configs

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

iofu728's picture

Feature(MInference): build demo

43a7079 11 months ago

Llama_3_8B_Instruct_262k_kv_out_v32_fit_o_best_pattern.json

50.1 kB

Feature(MInference): build demo 11 months ago
Phi_3_mini_128k_instruct_kv_out_v32_fit_o_best_pattern.json

61.2 kB

Feature(MInference): build demo 11 months ago
Yi_9B_200k_kv_out_v32_fit_o_best_pattern.json

75.3 kB

Feature(MInference): build demo 11 months ago
model2path.py

634 Bytes

Feature(MInference): build demo 11 months ago