There are certain clauses that don't affect the definition of a program as open source, but would prevent it to be included by, let's say, Debian. I'm thinking on the old BSD license or the branding problem of Firefox.
Debian includes the Firefox code, though. You can certainly say "you can redistribute my code, but not call it XYZ if you've modified it", that still lies within the realm of open source.