Skip to content

vllm_mlx.constrained

Constrained decoding for grammar-guided generation.

View the complete module source at #L1-L23.

API details

Each callable below includes its exact signature, type annotations, inputs, defaults, return contract, documented exceptions, implementation source, and parsed docstring sections when the source provides them.

vllm_mlx.constrained

Constrained decoding for grammar-guided generation.

Provides logits processors that mask token probabilities during generation so the model can only emit sequences matching a target grammar (e.g. a JSON schema). Used by the response_format parameter on the chat completion and Anthropic Messages endpoints.

vllm_mlx.constrained.__all__ module-attribute

__all__ = ['JSONSchemaLogitsProcessor', 'LMFormatEnforcerNotAvailableError', 'ThinkingAwareLogitsProcessor', 'is_available']

Complete contract reference

Expand any definition for its exact inputs, annotations, defaults, return contract, directly raised exceptions, source-grounded behavior, and immutable line link. This section includes private and nested definitions that ordinary API generators omit.

This module does not declare classes or functions.

Complete symbol map

This map also includes private definitions and nested helpers. The signature column exposes every explicit input even when an internal helper has no dedicated parameter prose.

This module does not declare classes or functions.