>the 'big leap forward' is just another dataset of people repairing chatgpt's lack of reasoning capabilities.
I think there is a really strong reinforcement learning component with the training of this model and how it has learned to perform the chain of thought.
Yes, but I suspect that the goals of the RL (in order to reason, we need to be able to "break down tricky steps into simpler ones", etc) were hand chosen, then a training set demonstrating these reasoning capabilities/components was constructed to match.
I think there is a really strong reinforcement learning component with the training of this model and how it has learned to perform the chain of thought.