vllm.v1.sample ΒΆ
 Modules:
| Name | Description | 
|---|---|
logits_processor |    |  
metadata |    |  
ops |    |  
rejection_sampler |    |  
sampler |    A layer that samples the next tokens from the model's outputs.  |  
tpu |    |  
 vllm.v1.sample ΒΆModules:
| Name | Description | 
|---|---|
logits_processor |    |  
metadata |    |  
ops |    |  
rejection_sampler |    |  
sampler |    A layer that samples the next tokens from the model's outputs.  |  
tpu |    |