blueprint

GPT-3/Replica API/Google STT Integration for NPC Dialogue

  • Exposure: public
  • UE Version: 4.26

armaanp23

August 22, 2021, 11:57 pm

Custom Events for Replica API authentication, synthesizing speech for Replica API, playing audio from URL, and getting a response from GPT-3

Blueprints for getting player microphone input, using above events for creating NPC dialogue with GPT-3

Comments for nodes to note

Plugins needed: vaREST(https://www.unrealengine.com/marketplace/en-US/product/varest-plugin), Google Speech Kit(https://www.unrealengine.com/marketplace/en-US/product/google-speech-kit), and OpenAI API(https://github.com/KellanM/OpenAI-Api-Unreal)

Copy and paste into NPC Event Graph and Third Person Character Event Graph, might have to recreate variables and custom events (?)

Make sure to Set API Key for Google Speech Services

This video is provided by youtube using cookies.
See their privacy page.

Click the button above, it will automatically copy blueprint in your clipboard. Then in Unreal Engine blueprint editor, paste it with ctrl + v