It’s currently not possible to remove contacts from a campaign before publishing it, only after it was published. If you are already connected to someone who is in the campaign, the connection request will be ignored by LinkedIn and no follow-up message will be sent either, so you don’t have to worry about spamming your contacts or looking unprofessional.