ModelLoadingStatus (schema/model_loading.go)

LocalAI · core/schema/model_loading.go · go · MIT
database, tag:embed-classified

Defines data structures for tracking and reporting model loading progress and status.

// Source: https://github.com/mudler/LocalAI | License: MIT | Copyright 2023-2025 Ettore Di Giacinto (mudler@localai.io)
// Provided via justclaw.it.com; keep this notice with the code.
package schema

import "time"

// ModelLoadingStatus describes a cold load that is still in progress. In
// distributed mode a model can take tens of minutes to stage onto a worker,
// which is far longer than a request may be held; a caller that runs out of
// wait budget gets this instead of an anonymous hang or a misleading error.
type ModelLoadingStatus struct {
	// JobID names the load attempt. A cancel must quote it: it is the
	// precondition that keeps a cancel from hitting a replacement attempt.
	JobID string `json:"job_id,omitempty"`
	// LeaseExpiresIn is the seconds left on the owner's lease. It 

... (truncated -- full source via MCP)

See the full source, get the GitHub permalink, and search for more like it.

Get a free API key