These free scripts put ChatGPT inside CG software
Originally posted on 14 March 2022. Scroll down for news of a new integration for After Effects.
BeloFX lead compositor Jiacheng Xu has released ChatGPTforNuke, a free script that integrates OpenAI’s AI chatbot inside Foundry’s Nuke compositing software, where it can be used to write custom Python scripts.
It’s one of a number of scripts created in the last month to integrate ChatGPT inside DCC applications, alongside tools for After Effects, Blender, Houdini and Unity.
Use ChatGPT to write context-aware Python, Tcl or BlinkScript inside Nuke
As well as plain text like articles and essays, ChatGPT can be used to write and comment code, something that ChatGPTforNuke makes use of.
The script provides access to ChatGPT’s new gpt-3.5-turbo model from within Nuke, where it can be used to write expressions, along with code in Python, Tcl and Nuke’s native BlinkScript language.
Users can type in natural-language prompts and have ChatGPT generate code that can be pasted directly into Nuke’s script editor.
Examples shown in the demo video at the top of the story include generating a Write node with a custom UI and using the Autolabel knob to append the metadata for an imported shot to a Read node.
However, we assume that it could also be used for more complex scripting tasks, particularly since ChatGPT can be prompted to improve or to explain its own code, making it possible to develop scripts iteratively.
ChatGPTforNuke can also scrape data from a studio’s website or wiki to generate pipeline-specific code.
Price and system requirements
ChatGPTforNuke requires Python 3.6+, so it is compatible with Nuke 13+. To use it, you need to link it to an OpenAI API key, which you can get by registering for a free OpenAI account.
Generating code then consumes tokens, which are currently priced at $0.002 per thousand (which equates to approximately 750 words of code) for the gpt-3.5-turbo model.
The installation process is quite complicated, so check out the link below for instructions.
Download ChatGPTforNuke for free from Jiacheng Xu’s GitHub repository
Read the installation instructions for ChatGPTforNuke
Venu Victor’s fxGPT for Houdini
ChatGPT integrations for other DCC applications
ChatGPTForNuke is one of a number of new scripts integrating ChatGPT into DCC applications.
For Blender, add-on developer Joshua Knauber has released BPY Chat GPT, described as a “very simple add-on [for generating] scripts in the Blender text editor”.
For Houdini, MPC Head of Effects Venu Victor has posted a demo of FxGPT, a script that can be used as a kind of AI-powered help function within the 3D software, although it hasn’t yet been publicly released.
Updated 21 March 2023: Unity engineer Keijiro Takahashi has released AICommand: a proof-of-concept integration of ChatGPT into the Unity Editor.
It’s described as “definitely not” practical for production work (it “works nicely in some cases and fails very poorly in others”), but it does – sometimes – let you control Unity using natural language prompts.
Updated 22 March 2023: Tools developer Hyper Brew has released Klutz GPT, a free tool that integrates ChatGPT’s gpt-3.5-turbo AI model inside After Effects.
The product website brilliantly describes it as “the most unreliable way to write expressions and scripts for After Effects”, but as with the other tools, you can feed back error messages to get the AI to improve its code.
If you spot ChatGPT scripts for other CG apps, let us know in the comments, and we’ll add them to the story.