Sometimes proving your worth means leaving people who won't appreciate it.