Defines data structures for tracking and reporting model loading progress and status.
// Source: https://github.com/mudler/LocalAI | License: MIT | Copyright 2023-2025 Ettore Di Giacinto (mudler@localai.io)
// Provided via justclaw.it.com; keep this notice with the code.
package schema
import "time"
// ModelLoadingStatus describes a cold load that is still in progress. In
// distributed mode a model can take tens of minutes to stage onto a worker,
// which is far longer than a request may be held; a caller that runs out of
// wait budget gets this instead of an anonymous hang or a misleading error.
type ModelLoadingStatus struct {
// JobID names the load attempt. A cancel must quote it: it is the
// precondition that keeps a cancel from hitting a replacement attempt.
JobID string `json:"job_id,omitempty"`
// LeaseExpiresIn is the seconds left on the owner's lease. It
... (truncated -- full source via MCP)
See the full source, get the GitHub permalink, and search for more like it.
Get a free API key