Multimodal Responses API

Documentation Index

Fetch the complete documentation index at: https://docs.qingbo.dev/llms.txt

Use this file to discover all available pages before exploring further.

• Fully compatible with the OpenAI Responses API format
• Supports multimodal input (text and images)
• Supports tool extensions: web search, file search, function calling, remote MCP

curl -X POST https://www.qingbo.dev/v1/responses \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-5",
    "input": "解释一下冒泡排序算法。"
  }'

{
  "id": "resp_09e342953eda0be6006905acbcvoik1nhmezpmzzl7lex552vq",
  "object": "response",
  "created_at": 1761979488,
  "model": "gpt-5-2025-08-07",
  "status": "completed",
  "output": [
    {
      "id": "rs_09e342953eda0be6006905ac62b6f48197aefa292b7dcdd477",
      "type": "reasoning",
      "summary": []
    },
    {
      "id": "msg_09e342953eda0be6006905ac649e0081979f9859a09c70d4db",
      "type": "message",
      "role": "assistant",
      "status": "completed",
      "content": [
        {
          "type": "output_text",
          "text": "一幅温暖的插画：一只灰色虎斑猫正抱着一只带红色围巾的水獭，两只动物都闭着眼微笑，呈现亲密友好的场景。",
          "annotations": [],
          "logprobs": []
        }
      ]
  }
],
"usage": {
    "input_tokens": 642,
    "output_tokens": 184,
    "total_tokens": 826,
    "input_tokens_details": {
      "cached_tokens": 0
    },
    "output_tokens_details": {
      "reasoning_tokens": 128
    }
  },
  "reasoning": {
    "effort": "medium",
    "summary": null
  },
  "temperature": 1,
  "top_p": 1,
  "tool_choice": "auto",
  "tools": [],
  "parallel_tool_calls": true,
  "store": true,
  "service_tier": "default",
  "truncation": "disabled",
  "background": false,
  "content_filters": null,
  "error": null,
  "incomplete_details": null,
  "instructions": null,
  "max_output_tokens": null,
  "max_tool_calls": null,
  "metadata": {},
  "previous_response_id": null,
  "prompt_cache_key": null,
  "safety_identifier": null,
  "text": {
    "format": {
      "type": "text"
    },
    "verbosity": "medium"
  },
  "top_logprobs": 0,
  "user": null
}

​

Authorizations

Authorization: Bearer YOUR_API_KEY

​

Body

[
  {"type": "web_search"},
  {
    "type": "function",
    "function": {
      "name": "get_weather",
      "description": "获取天气信息",
      "parameters": {
        "type": "object",
        "properties": {
          "city": {"type": "string"}
        },
        "required": ["city"]
      }
    }
  }
]

​

Response

​

Examples

​

Image analysis

{
  "model": "gpt-5",
  "input": [
    {
      "role": "user",
      "content": [
        {
          "type": "input_text",
          "text": "这张图片里有什么？请详细描述"
        },
        {
          "type": "input_image",
          "image_url": "https://example.com/image.jpg"
        }
      ]
    }
  ]
}

​

Video analysis

{
  "model": "gemini-2.5-pro",
  "input": [
    {
      "role": "user",
      "content": [
        {
          "type": "input_text",
          "text": "分析一下这个视频的内容"
        },
        {
          "type": "input_video",
          "video_url": "https://example.com/video.mp4"
        }
      ]
    }
  ],
  "max_tokens": 5000
}

​

Using the web search tool

{
  "model": "gpt-5",
  "tools": [
    {"type": "web_search"}
  ],
  "input": [
    {
      "role": "user",
      "content": [
        {
          "type": "input_text",
          "text": "2025年最新的AI技术趋势是什么？"
        }
      ]
    }
  ]
}

​

Using function calling

{
  "model": "gpt-5",
  "tools": [
    {
      "type": "function",
      "function": {
        "name": "get_weather",
        "description": "获取城市天气信息",
        "parameters": {
          "type": "object",
          "properties": {
            "city": {
              "type": "string",
              "description": "城市名称，例如：北京"
            }
          },
          "required": ["city"]
        }
      }
    }
  ],
  "input": "北京今天天气怎么样？"
}

​

Content Types

​

input_text

• type: always "input_text"
• text: text content (string)

​

input_image

• type: always "input_image"
• image_url: image URL or base64-encoded data URI

• JPEG
• PNG
• GIF
• WebP

• Max file size: 20MB
• Recommended resolution: up to 2048x2048 pixels

​

input_video

• type: always "input_video"
• video_url: video URL

• MP4
• MOV
• AVI
• WebM

• Max file size: 200MB
• Max duration: 10 minutes
• Recommended resolution: 1080p

​

Tools in Detail

​

Web search

{
  "tools": [{"type": "web_search"}]
}

• Latest news and current events
• Real-time data (stocks, weather, exchange rates, etc.)
• Latest technical docs and references
• Fact verification

​

File search

{
  "tools": [{"type": "file_search"}]
}

• Analyzing internal company documents
• Searching technical specifications and manuals
• Querying contracts and legal documents
• Knowledge-base Q&A systems

​

Function calling

{
  "tools": [
    {
      "type": "function",
      "function": {
        "name": "get_stock_price",
        "description": "获取股票的实时价格",
        "parameters": {
          "type": "object",
          "properties": {
            "symbol": {
              "type": "string",
              "description": "股票代码，例如：AAPL"
            },
            "currency": {
              "type": "string",
              "enum": ["USD", "CNY"],
              "description": "货币单位",
              "default": "USD"
            }
          },
          "required": ["symbol"]
        }
      }
    }
  ]
}

• name: function name (required)
• description: function description (required)
• parameters: parameter definitions in JSON Schema format
  • type: parameter type
  • properties: parameter property definitions
  • required: list of required parameters

• Calling third-party APIs
• Running database queries
• Triggering business workflows
• Integrating with internal systems

​

Remote MCP

{
  "tools": [
    {
      "type": "remote_mcp",
      "remote_mcp": {
        "url": "https://your-mcp-server.com/api",
        "auth_token": "your_auth_token",
        "timeout": 30
      }
    }
  ]
}

• url: MCP server URL (required)
• auth_token: authentication token (optional)
• timeout: timeout in seconds, default 30

• Connecting to enterprise AI services
• Using domain-specific models
• Accessing protected data sources
• Integrating distributed AI systems

​

Tool Response Format

{
  "id": "resp-123456",
  "object": "response",
  "created": 1677652288,
  "model": "gpt-5",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": null,
        "tool_calls": [
          {
            "id": "call_abc123",
            "type": "function",
            "function": {
              "name": "get_weather",
              "arguments": "{\"city\": \"北京\"}"
            }
          }
        ]
      },
      "finish_reason": "tool_calls"
    }
  ]
}

1. The model receives user input
2. Decides whether a tool is needed
3. If yes, returns a tool call request
4. The client executes the tool call
5. The result is returned to the model
6. The model produces the final response

​

Notes

1. Image URL requirements:
   • Must be a publicly accessible URL
   • Or use a base64-encoded data URI
2. Token billing:
   • Images consume tokens based on resolution
   • High-resolution images are auto-resized to optimize cost
   • Tool calls also consume additional tokens
3. Content order:
   • The order of items in the content array affects how the model interprets them
   • We recommend placing the text instruction first, followed by images/videos
4. Multimodal mixing:
   • A single request can mix multiple text and image inputs
   • Multi-turn conversations preserve context
5. Tool usage limits:
   • When multiple tools are available, the model picks the most appropriate one
   • Function calling requires explicit function and parameter definitions
   • Web search results may be subject to regional and time limits
6. API compatibility:
   • Fully compatible with the OpenAI Responses API format
   • Existing OpenAI code can be migrated seamlessly
   • Supports all OpenAI tool extensions