The company I work at maintains an office, but coming in is optional. Some people come in every day because they prefer not to work from home, some people come in just for special occasions that require in-person meetings. As long as everyone is clear that it really is optional, then there shouldn't be an issue.