Compatibility
What works through the gateway, from the last full run of our compatibility test (version R1): 15 scenarios x 8 combinations of line, model alias and streaming / non-streaming, 87 of 120 cells passed. Providers differ in what they implement; where a result depends on which provider answered, we say so.
Short answers. "Served" means the answer was delivered; it does not mean the answer was clean. Providers of the Gonka network require a minimum of 64 generated tokens on every request, a known behaviour of the network (gonka-ai/gonka issue 1955), so on very short requests (a one-word answer, a short JSON) they append repeated text. In our test of 2026-10-27, 17% to 23% of a mixed set of 60 requests were affected when the Gonka providers were called directly (15% and 18% through our two lines), up to 70% of one-word requests and up to 50% of short JSON requests. In the R1 24-hour test, 3.8% to 5.4% of the short answers served by the Gonka providers ended at the output limit. The provider outside the Gonka network did not show this (0 of 243 in R1, 0 of 60 on 2026-10-27). The network has published a fix (gonka-ai/gonka pull request 1972); when it will be switched on is not known. Super Deal (economical tariff, depends on the Gonka network, no insurance outside Gonka) has no provider outside the Gonka network, and on Standard that provider is used only when the earlier ones fail. Details: benchmarks.
| Feature | Status | Notes |
|---|---|---|
stream (server-sent events) | supported | usage in the last chunk with stream_options.include_usage |
tools, tool calls | supported | one call and parallel calls pass in every combination |
tool_choice: "required" | depends on the provider | sometimes the model answers in text instead of calling a tool |
tool_choice naming a function | not honored | the model does not follow it (it answers in text or calls another tool); the same in every earlier test and straight on every provider |
| tool loops of several turns | depends on the provider | mostly work; sometimes no final answer within four turns |
response_format json_object and json_schema | supported | pass in every combination |
stop sequences | supported | |
system message, temperature, top_p | supported | |
max_tokens, max_completion_tokens | depends on the provider | accepted and used as an upper bound; on Gonka providers a very small value (below 64 tokens) can still return up to 64 tokens, and a very short answer can come back lengthened or repeated (see the note above) |
seed | depends on the provider | accepted; identical output for the same seed can differ |
n above 1 | not honored | rejected with an explicit 400 |
logprobs, top_logprobs | depends on the provider | returned only when the answer comes from Provider A or C; Provider B and the insurance provider ignore the parameter and return none |
| long context (400,000-token window) | supported | very long requests are slower; on Super Deal (economical tariff) they time out more often (see benchmarks) |
The test is repeatable (bench/c18/compat_matrix.py); individual cells change from run to run with the provider that answered.