I value this and I universally disable password auth…on the server :)
E: as listed by others, IdentitiesOnly=yes seems like a better approach?