In the last 24 hours I've seen a bunch of projects doing LLM -> JSON. I think we want to be focusing on markdown instead. An intuition I have developed is that an ideal prompt has a very clear narrative structure and very tight "semantic locality" (the instruction is at the end, the most salient data is close to the instruction, etc).
JSON is admittedly way easier to work with up front, but markdown seems to be a more scaleable choice.
Of course, this is all very much an opinion and highly anecdotal at the moment.
JSON is admittedly way easier to work with up front, but markdown seems to be a more scaleable choice.
Of course, this is all very much an opinion and highly anecdotal at the moment.