Skip to main content

Container Svc

The container service maintains containers on a node. It currently only supports Docker. It expects the Docker socket to be mounted.

For simplicity the Container Svc is only concerned with the node it resides on. In other words, the Container Svc is not distributed, it only starts and stops containers locally.

Used By

  • Model Svc to launch containers running AI models.
  • Deploy Svc to launch containers to deploy service instances.

This page provides a high-level overview of Container Svc. For detailed information, refer to the Container Svc API documentation.

Responsibilities

  • Start and stop containers when needed - ensuring the running containers match what is expected.

Dependencies

  • File Svc to download asset files from.