Inference Post

POST 
/inference/v1:path

OpenAI-compatible APIs.

Request

Path Parameters

path Pathrequired

application/json

Body

required

model Model (string)required
messages undefined[]

Default value: ``

timeout

object

anyOf

MOD1

number

MOD2

string

temperature

object

anyOf

MOD1

number

top_p

object

anyOf

MOD1

number

n

object

anyOf

MOD1

integer

stop

object

anyOf

MOD1

string

MOD2

Array [

]

max_completion_tokens

object

anyOf

MOD1

integer

max_tokens

object

anyOf

MOD1

integer

modalities

object

anyOf

MOD1

Array [

]

presence_penalty

object

anyOf

MOD1

number

frequency_penalty

object

anyOf

MOD1

number

stream

object

anyOf

MOD1

boolean

logit_bias object

user

object

anyOf

MOD1

string

response_format object

seed

object

anyOf

MOD1

integer

tools

object

anyOf

MOD1

Array [

]

tool_choice

object

anyOf

MOD1

string

logprobs

object

anyOf

MOD1

boolean

top_logprobs

object

anyOf

MOD1

integer

parallel_tool_calls

object

anyOf

MOD1

boolean

extra_headers object

functions

object

anyOf

MOD1

Array [

]

function_call

object

anyOf

MOD1

string

api_version

object

anyOf

MOD1

string

Responses

200

Successful Response

application/json

Schema

Schema

any

422

Validation Error

application/json

Schema

Schema

detail

object[]

Array [

loc

object[]

required

Array [

anyOf

MOD1

string

MOD2

integer

]

msg Message (string)required

type Error Type (string)required

]

Example (from schema)

{
  "detail": [
    {
      "loc": [
        "string",
        0
      ],
      "msg": "string",
      "type": "string"
    }
  ]
}

Loading...