MingaAgent.InferenceRoute.Usage (minga_sdk v0.1.0)

Copy Markdown View Source

Token usage a route reports for one request. Counts default to 0.

This is a compile-time stub.

Summary

Types

t()

@type t() :: %MingaAgent.InferenceRoute.Usage{
  cache_read_tokens: non_neg_integer(),
  cache_write_tokens: non_neg_integer(),
  input_tokens: non_neg_integer(),
  output_tokens: non_neg_integer()
}

Functions

new(attrs)

@spec new(map() | keyword()) :: {:ok, t()} | {:error, {:invalid_usage, atom()}}