vllm_mlx.constrained¶
Constrained decoding for grammar-guided generation.
View the complete module source at #L1-L23.
API details¶
Each callable below includes its exact signature, type annotations, inputs, defaults, return contract, documented exceptions, implementation source, and parsed docstring sections when the source provides them.
vllm_mlx.constrained
¶
Constrained decoding for grammar-guided generation.
Provides logits processors that mask token probabilities during generation
so the model can only emit sequences matching a target grammar (e.g. a JSON
schema). Used by the response_format parameter on the chat completion
and Anthropic Messages endpoints.
vllm_mlx.constrained.__all__
module-attribute
¶
__all__ = ['JSONSchemaLogitsProcessor', 'LMFormatEnforcerNotAvailableError', 'ThinkingAwareLogitsProcessor', 'is_available']
Complete contract reference¶
Expand any definition for its exact inputs, annotations, defaults, return contract, directly raised exceptions, source-grounded behavior, and immutable line link. This section includes private and nested definitions that ordinary API generators omit.
This module does not declare classes or functions.
Complete symbol map¶
This map also includes private definitions and nested helpers. The signature column exposes every explicit input even when an internal helper has no dedicated parameter prose.
This module does not declare classes or functions.