Fail fast is a search rule that makes sense for a startup business. The all-up cost (including opportunity cost) to exploit an unprofitable niche is so high relative to the cost of exploration that it's sensible to jump out of weak local optima and keep moving.

It is not a universal rule of infinite wisdom. Not all situations are startup businesses.