Concepts

Core concepts behind AIM Engine’s design.

• Services — Service deployment lifecycle, template selection, and caching

• Models — Model catalog, discovery, and resolution

• Model Sources — Automatic model discovery from container registries

• Profiles — Self-contained runtime configurations (v1alpha2)

• Service Templates — Runtime profiles, derivation, and discovery cache

• Runtime Configuration — Storage defaults, routing, and environment resolution

• Caching — Cache hierarchy, ownership, and deletion behavior

• Accelerator Detection — GPU and CPU detection via NFD node labels

• Resource Lifecycle — Ownership, finalizers, and deletion behavior