REST API

The Maniac API provides openai compatible inference endpoints for interacting with both frontier models and your custom models. This reference details the available endpoints.

Run inference with Maniac

post

OpenAI Chat Completions-compatible endpoint.

Authorizations

BearerAuth

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Body

application/json

modelstringRequired

Required. Examples:

• <provider>:<model>
• <provider>/<model> (e.g. openai/gpt-4o)
• maniac:<container_label>
• maniac:<container_label>:<model_slug>

streambooleanOptional

tool_choiceone ofOptional

string · enumOptionalPossible values:

or

temperaturenumberOptional

top_pnumberOptional

max_tokensintegerOptional

response_formatone ofOptional

or

or

Responses

200

Successful completion (non-streaming or streaming)

application/jsontext/event-stream

400

Invalid request

application/json

401

Authentication error (missing/invalid bearer token)

application/json

4XX

Other client errors in OpenAI error format

application/json

5XX

Server or upstream error

application/json

post

/v1/chat/completions

HTTPcURLJavaScriptPython

POST /v1/chat/completions HTTP/1.1
Host: inference.maniac.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Content-Type: application/json
Accept: */*
Content-Length: 397

{
  "model": "text",
  "messages": [
    {
      "role": "system",
      "content": "text",
      "name": "text",
      "tool_call_id": "text",
      "tool_calls": [
        {
          "id": "text",
          "type": "function",
          "function": {
            "name": "text",
            "arguments": "text"
          }
        }
      ]
    }
  ],
  "stream": true,
  "tools": [
    {
      "type": "function",
      "function": {
        "name": "text",
        "description": "text",
        "parameters": {}
      }
    }
  ],
  "tool_choice": "auto",
  "temperature": 1,
  "top_p": 1,
  "max_tokens": 1,
  "response_format": {
    "type": "text"
  }
}

{
  "id": "text",
  "object": "text",
  "created": 1,
  "model": "text",
  "choices": [
    {
      "index": 1,
      "message": {
        "role": "system",
        "content": "text",
        "name": "text",
        "tool_call_id": "text",
        "tool_calls": [
          {
            "id": "text",
            "type": "function",
            "function": {
              "name": "text",
              "arguments": "text"
            }
          }
        ]
      },
      "finish_reason": null
    }
  ],
  "usage": {
    "prompt_tokens": 1,
    "completion_tokens": 1,
    "total_tokens": 1
  }
}

List containers for a project

get

Returns all available containers for the authenticated project. If "label" is provided, returns a single matching container or a 400 not_found error.

Authorizations

BearerAuth

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Query parameters

labelstringOptional

Optional container label to filter by.

Responses

200

List of containers or a single container (if label is given)

application/json

Responseone of

or

400

Container not found or invalid request

application/json

get

/v1/containers

HTTPcURLJavaScriptPython

GET /v1/containers HTTP/1.1
Host: inference.maniac.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

[
  {
    "id": "text",
    "label": "text",
    "model": "text",
    "initial_system_prompt": null,
    "initial_model": "text",
    "inference_config": {
      "stream": true,
      "tools": [
        {
          "type": "function",
          "function": {
            "name": "text",
            "description": "text",
            "parameters": {}
          }
        }
      ],
      "tool_choice": "auto",
      "temperature": 1,
      "top_p": 1,
      "max_tokens": 1,
      "response_format": {
        "type": "text"
      }
    },
    "best_model": {
      "id": "text",
      "object": "model",
      "created": 1,
      "name": "text",
      "provider": "text"
    },
    "deployed_models": [
      {
        "id": "text",
        "object": "model",
        "created": 1,
        "name": "text",
        "provider": "text"
      }
    ]
  }
]

Create a new container

post

Creates a new container for the authenticated project, or returns the existing container if one with the same label already exists.

Authorizations

BearerAuth

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Body

application/json

labelstringRequired

Human-readable label for the container

initial_modelstringOptional

The initial model to use for the container. e.g. "openai/gpt-4o"

initial_system_promptstringOptional

Responses

200

Container already existed; returned as-is

application/json

201

Container created

application/json

400

Validation error (e.g., missing label or invalid values)

application/json

500

Internal error creating or persisting container

application/json

post

/v1/containers

HTTPcURLJavaScriptPython

POST /v1/containers HTTP/1.1
Host: inference.maniac.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Content-Type: application/json
Accept: */*
Content-Length: 70

{
  "label": "text",
  "initial_model": "text",
  "initial_system_prompt": "text"
}

{
  "id": "text",
  "label": "text",
  "model": "text",
  "initial_system_prompt": null,
  "initial_model": "text",
  "inference_config": {
    "stream": true,
    "tools": [
      {
        "type": "function",
        "function": {
          "name": "text",
          "description": "text",
          "parameters": {}
        }
      }
    ],
    "tool_choice": "auto",
    "temperature": 1,
    "top_p": 1,
    "max_tokens": 1,
    "response_format": {
      "type": "text"
    }
  },
  "best_model": {
    "id": "text",
    "object": "model",
    "created": 1,
    "name": "text",
    "provider": "text"
  },
  "deployed_models": [
    {
      "id": "text",
      "object": "model",
      "created": 1,
      "name": "text",
      "provider": "text"
    }
  ]
}

List available models and containers

get

Returns a model list combining external models with project containers (as "maniac/").

Authorizations

BearerAuth

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Responses

200

List of models and containers (anything you can use in the "model" field of a chat completion request)

application/json

get

/v1/models

HTTPcURLJavaScriptPython

GET /v1/models HTTP/1.1
Host: inference.maniac.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

200

List of models and containers (anything you can use in the "model" field of a chat completion request)

{
  "object": "list",
  "data": [
    {
      "id": "text",
      "object": "model",
      "created": 1,
      "name": "text",
      "provider": "text"
    }
  ]
}

Register existing chat completions data to a container

post

Bulk-register a dataset of (input, output) chat completion pairs against a given container/label. Used for logging and training data ingestion.

Authorizations

BearerAuth

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Body

application/json

containerstringOptional

Container label.

Responses

200

Completions registered successfully.

application/json

400

Invalid container/label or dataset format

application/json

500

Container lookup invalid or catastrophic insert failure

application/json

post

/v1/chat/completions/register

HTTPcURLJavaScriptPython

POST /v1/chat/completions/register HTTP/1.1
Host: inference.maniac.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Content-Type: application/json
Accept: */*
Content-Length: 57

{
  "container": "text",
  "dataset": [
    {
      "input": {},
      "output": {}
    }
  ]
}

{
  "ok": true,
  "container": "text",
  "summary": {
    "inserted": 1,
    "skipped": 1
  },
  "errors": [
    {}
  ]
}