Skip to content

Allow max_batch_prefill_tokens to be less than max_input_length#736

Open
ajtejankar wants to merge 1 commit intomainfrom default-mbpt
-3

Commits

Commits on Jan 9, 2025