I can't speak for everyone with this concern, but it doesn't strike me as all-or-nothing. Changing the relay policy potentially has concerning impacts on the bitcoin network regardless of whether it changes what makes it into blocks.