# `AgentDb.ML.ModelManager.State`
[🔗](https://github.com/manhvu/agent_db/blob/v0.1.0/lib/agent_db/ml/model_manager/state.ex#L1)

State struct for ModelManager

# `last_load_ms`

```elixir
@type last_load_ms() :: %{optional(:embedding | :llm) => non_neg_integer()}
```

# `load_status`

```elixir
@type load_status() :: :idle | :loading | :ready | :failed
```

# `loading_ref`

```elixir
@type loading_ref() :: %{
  optional(:embedding) => reference(),
  optional(:llm) => reference()
}
```

# `model_ref`

```elixir
@type model_ref() :: %{
  tokenizer: Bumblebee.Tokenizer.t(),
  model: term(),
  config: map(),
  serving: module(),
  chat_template: String.t()
}
```

# `t`

```elixir
@type t() :: %AgentDb.ML.ModelManager.State{
  config: map(),
  embedding_model: model_ref() | nil,
  in_flight: non_neg_integer(),
  inference_refs: MapSet.t(reference()),
  last_latency_ms: %{optional(:embedding | :llm) => non_neg_integer()},
  last_load_ms: %{optional(:embedding | :llm) => non_neg_integer()},
  llm_model: model_ref() | nil,
  loading: %{
    optional(:embedding) => load_status(),
    optional(:llm) => load_status()
  },
  loading_ref: loading_ref()
}
```

---

*Consult [api-reference.md](api-reference.md) for complete listing*