Skip to main content
OpenAI is a company focused on generative AI, providing powerful conversational capabilities. Currently, ComfyUI has integrated the OpenAI API, allowing you to directly use the related nodes in ComfyUI to complete conversational functions.

​
What OpenAI Chat is good at

  • Intelligent conversations: engage with OpenAI’s advanced language models directly inside ComfyUI
  • Image understanding: load an image for the AI to interpret and respond to
  • Task control: adjust OpenAI Chat Advanced Options to have the AI execute specific tasks, such as analyzing an image and generating a prompt
  • Model choice: select different OpenAI models from the OpenAI Chat node
  • Multiple image input: batch several images together when more than one image needs AI interpretation
To use the Partner Nodes, you need to ensure that you are logged in properly and using a permitted network environment. Please refer to the Partner Nodes Overview section of the documentation to understand the specific requirements for using the Partner Nodes.
Make sure your ComfyUI is updated.Workflows in this guide can be found in the Workflow Templates. If you can’t find them in the template, your ComfyUI may be outdated.If nodes are missing when loading a workflow, possible reasons:
  1. You are not using the latest ComfyUI version (Nightly version)
  2. Some nodes failed to import at startup

​
OpenAI: ChatGPT

Engage with OpenAI’s advanced language models for intelligent conversations.

Run on Comfy Cloud

Open in Comfy Cloud

Download Workflow

Download JSON or search “OpenAI: ChatGPT” in Template Library
Input materials Upload this file to the matching LoadImage node:

example.png

LoadImage node 5 · example.png

​
Complete the workflow execution step by step

In the corresponding template, we have built a role setting for analyzing prompt generation.
You can refer to the numbers in the image to complete the basic text-to-image workflow execution:
  1. In the Load Image node, load the image you need AI to interpret
  2. (Optional) If needed, you can modify the settings in OpenAI Chat Advanced Options to have AI execute specific tasks
  3. In the OpenAI Chat node, you can modify Prompt to set the conversation prompt, or modify model to select different models
  4. Click the Run button, or use the shortcut Ctrl(cmd) + Enter to execute the conversation.
  5. After waiting for the API to return results, you can view the corresponding AI returned content in the Preview Any node.

​
Additional Notes

  • Currently, the file input node OpenAI Chat Input Files requires files to be uploaded to the ComfyUI/input/ directory first. This node is being improved, and we will modify the template after updates
  • The workflow provides an example using Batch Images for input. If you have multiple images that need AI interpretation, you can refer to the step diagram and use right-click to set the corresponding node mode to Always to enable it