Multimodal Responses

• Fully compatible with the OpenAI Responses API format
• Supports multimodal input with text and images
• Supports tool extensions: web search, file search, function calling, remote MCP

curl -X POST https://qingbo.dev/v1/responses \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-5",
    "input": "解释一下冒泡排序算法。"
  }'

{
  "id": "resp_09e342953eda0be6006905acbcvoik1nhmezpmzzl7lex552vq",
  "object": "response",
  "created_at": 1761979488,
  "model": "gpt-5-2025-08-07",
  "status": "completed",
  "output": [
    {
      "id": "rs_09e342953eda0be6006905ac62b6f48197aefa292b7dcdd477",
      "type": "reasoning",
      "summary": []
    },
    {
      "id": "msg_09e342953eda0be6006905ac649e0081979f9859a09c70d4db",
      "type": "message",
      "role": "assistant",
      "status": "completed",
      "content": [
        {
          "type": "output_text",
          "text": "一幅温暖的插画：一只灰色虎斑猫正抱着一只带红色围巾的水獭，两只动物都闭着眼微笑，呈现亲密友好的场景。",
          "annotations": [],
          "logprobs": []
        }
      ]
  }
],
"usage": {
    "input_tokens": 642,
    "output_tokens": 184,
    "total_tokens": 826,
    "input_tokens_details": {
      "cached_tokens": 0
    },
    "output_tokens_details": {
      "reasoning_tokens": 128
    }
  },
  "reasoning": {
    "effort": "medium",
    "summary": null
  },
  "temperature": 1,
  "top_p": 1,
  "tool_choice": "auto",
  "tools": [],
  "parallel_tool_calls": true,
  "store": true,
  "service_tier": "default",
  "truncation": "disabled",
  "background": false,
  "content_filters": null,
  "error": null,
  "incomplete_details": null,
  "instructions": null,
  "max_output_tokens": null,
  "max_tool_calls": null,
  "metadata": {},
  "previous_response_id": null,
  "prompt_cache_key": null,
  "safety_identifier": null,
  "text": {
    "format": {
      "type": "text"
    },
    "verbosity": "medium"
  },
  "top_logprobs": 0,
  "user": null
}

​

Authorizations

Authorization: Bearer YOUR_API_KEY

​

Body

[
  {"type": "web_search"},
  {
    "type": "function",
    "function": {
      "name": "get_weather",
      "description": "获取天气信息",
      "parameters": {
        "type": "object",
        "properties": {
          "city": {"type": "string"}
        },
        "required": ["city"]
      }
    }
  }
]

​

Response

​

Usage Examples

​

Image Analysis

{
  "model": "gpt-5",
  "input": [
    {
      "role": "user",
      "content": [
        {
          "type": "input_text",
          "text": "这张图片里有什么？请详细描述"
        },
        {
          "type": "input_image",
          "image_url": "https://example.com/image.jpg"
        }
      ]
    }
  ]
}

​

Video Analysis

{
  "model": "gemini-2.5-pro",
  "input": [
    {
      "role": "user",
      "content": [
        {
          "type": "input_text",
          "text": "分析一下这个视频的内容"
        },
        {
          "type": "input_video",
          "video_url": "https://example.com/video.mp4"
        }
      ]
    }
  ],
  "max_tokens": 5000
}

​

Using Web Search Tool

{
  "model": "gpt-5",
  "tools": [
    {"type": "web_search"}
  ],
  "input": [
    {
      "role": "user",
      "content": [
        {
          "type": "input_text",
          "text": "2025年最新的AI技术趋势是什么？"
        }
      ]
    }
  ]
}

​

Using Function Calling

{
  "model": "gpt-5",
  "tools": [
    {
      "type": "function",
      "function": {
        "name": "get_weather",
        "description": "获取城市天气信息",
        "parameters": {
          "type": "object",
          "properties": {
            "city": {
              "type": "string",
              "description": "城市名称，例如：北京"
            }
          },
          "required": ["city"]
        }
      }
    }
  ],
  "input": "北京今天天气怎么样？"
}

​

Content Type Reference

​

input_text

• type: Always "input_text"
• text: Text content (string)

​

input_image

• type: Always "input_image"
• image_url: Image URL or Base64-encoded data URI

• JPEG
• PNG
• GIF
• WebP

• Maximum file size: 20MB
• Recommended resolution: up to 2048x2048 pixels

​

input_video

• type: Always "input_video"
• video_url: Video URL

• MP4
• MOV
• AVI
• WebM

• Maximum file size: 200MB
• Maximum duration: 10 minutes
• Recommended resolution: 1080p

​

Tool Usage Details

​

Web Search

{
  "tools": [{"type": "web_search"}]
}

• Querying latest news and current events
• Retrieving real-time data (stocks, weather, exchange rates, etc.)
• Searching for the latest technical documentation and resources
• Verifying factual information

​

File Search

{
  "tools": [{"type": "file_search"}]
}

• Analyzing internal enterprise documents
• Searching technical specifications and manuals
• Querying contracts and legal documents
• Knowledge base Q&A systems

​

Function Calling

{
  "tools": [
    {
      "type": "function",
      "function": {
        "name": "get_stock_price",
        "description": "获取股票的实时价格",
        "parameters": {
          "type": "object",
          "properties": {
            "symbol": {
              "type": "string",
              "description": "股票代码，例如：AAPL"
            },
            "currency": {
              "type": "string",
              "enum": ["USD", "CNY"],
              "description": "货币单位",
              "default": "USD"
            }
          },
          "required": ["symbol"]
        }
      }
    }
  ]
}

• name: Function name (required)
• description: Function description (required)
• parameters: Parameter definitions in JSON Schema format
  • type: Parameter type
  • properties: Parameter property definitions
  • required: Required parameter list

• Calling third-party APIs
• Executing database queries
• Triggering business workflows
• Integrating with internal systems

​

Remote MCP

{
  "tools": [
    {
      "type": "remote_mcp",
      "remote_mcp": {
        "url": "https://your-mcp-server.com/api",
        "auth_token": "your_auth_token",
        "timeout": 30
      }
    }
  ]
}

• url: MCP server address (required)
• auth_token: Authentication token (optional)
• timeout: Timeout in seconds, default 30

• Connecting to enterprise AI services
• Using specialized domain models
• Accessing protected data sources
• Distributed AI system integration

​

Tool Response Format

{
  "id": "resp-123456",
  "object": "response",
  "created": 1677652288,
  "model": "gpt-5",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": null,
        "tool_calls": [
          {
            "id": "call_abc123",
            "type": "function",
            "function": {
              "name": "get_weather",
              "arguments": "{\"city\": \"北京\"}"
            }
          }
        ]
      },
      "finish_reason": "tool_calls"
    }
  ]
}

1. Model receives user input
2. Analyzes whether tool usage is needed
3. If needed, returns a tool call request
4. Client executes the tool call
5. Tool result is sent back to the model
6. Model generates the final response

​

Important Notes

1. Image URL requirements:
   • Must be publicly accessible URLs
   • Or use Base64-encoded Data URI format
2. Token billing:
   • Images consume tokens based on their resolution
   • High-resolution images are automatically resized to optimize costs
   • Tool calls also consume additional tokens
3. Content ordering:
   • The order of elements in the content array affects model understanding
   • It is recommended to place text instructions before images/videos
4. Multimodal combinations:
   • Multiple text and image inputs can be mixed in a single request
   • Multi-turn conversations are supported, maintaining contextual coherence
5. Tool usage limits:
   • When using multiple tools simultaneously, the model intelligently selects the most appropriate tool
   • Function calls require clear function definitions and parameter descriptions
   • Web search results may be subject to geographic and temporal limitations
6. API compatibility:
   • Fully compatible with the OpenAI Responses API format
   • Seamless migration of existing OpenAI code
   • Supports all OpenAI tool extension features