You're confusing two different perspectives on entropy without understanding either properly. In physics, which is what's being discussed, entropy is certainly closely related to time.