您可以使用 API_PORT=8000 CUDA_VISIBLE_DEVICES=0 llamafactory-cli api examples/inference/qwen3_lora_sft.yaml 启动 api 服务并运行以下示例程序进行调用:
# api_call_example.pyfromopenaiimportOpenAIclient=OpenAI(api_key="0",base_url="http://0.0.0.0:8000/v1")messages=[{"role":"user","content":"Who are you?"}]result=client.chat.completions.create(messages=messages,model="Qwen/Qwen3-4B-Instruct-2507")print(result.choices[0].message)