That's genuinely how most of these things are being built.

Take a look at the OpenAI examples here: https://platform.openai.com/examples/

In particular these ones:

- https://platform.openai.com/examples/default-marv-sarcastic-...

- https://platform.openai.com/examples/default-chat

- https://platform.openai.com/examples/default-js-helper