The accumulation might be from the integration, but the error is clearly from the accelerometers. Smaller error means smaller accumulated error, which means your magic box is usefully accurate for longer.

I wonder if it theoretically could (or already does) benefit from something like this: https://www.youtube.com/watch?v=nCg3aXn5F3M