Batch API

Endpoint

POST /v3/batch

Jalankan beberapa sub-request chat completions secara paralel dengan satu autentikasi. Maks 50 sub-request per batch.

Request

{
  "requests": [
    {
      "custom_id": "req-1",
      "body": {
        "model": "bt/qwen3.8-flash",
        "messages": [{"role": "user", "content": "Halo!"}]
      }
    },
    {
      "custom_id": "req-2",
      "body": {
        "model": "bt/deepseek-chat",
        "messages": [{"role": "user", "content": "Ceritakan tentang Bali"}]
      }
    }
  ]
}

Response

{
  "id": "batch_xxx",
  "object": "batch",
  "status": "completed",
  "responses": [
    {"custom_id": "req-1", "status": 200, "response": { "...": "chat completion object" }, "error": null},
    {"custom_id": "req-2", "status": 200, "response": { "...": "chat completion object" }, "error": null}
  ]
}

Setiap sub-request punya failover provider sendiri, dan hasilnya independen — satu sub-request gagal tidak menggagalkan batch lain di dalamnya (lihat field error per item).

Parameter

Parameter	Type	Default	Description
requests	array	required	Maks 50 item
requests[].custom_id	string	req-{index}	ID untuk mencocokkan hasil
requests[].body	object	required	Payload chat completions biasa