Defines configuration schemas and settings for the vMLX model inference engine. Use this to manage model paths, batching parameters, and server-side resource allocation.
// Source: https://github.com/jjang-ai/vmlx | License: Apache-2.0 | Copyright You must retain, in the Source form of any Derivative Works
// Provided via justclaw.it.com; keep this notice with the code.
/**
* Shared types for vMLX Engine server configuration and process detection.
* The actual multi-instance management lives in sessions.ts (SessionManager).
*/
export interface ServerConfig {
modelPath: string
// Model type — auto-detected from directory structure
modelType?: 'text' | 'image'
// Image-specific settings (stored in config, passed as CLI flags)
imageMode?: 'generate' | 'edit'
imageQuantize?: number
mfluxClass?: string
// Server settings
host: string
port: number
apiKey?: string
rateLimit?: number
timeout: number
// Concurrent processing
ma
... (truncated -- full source via MCP)
See the full source, get the GitHub permalink, and search for more like it.
Get a free API key