You always have the option of adding or deleting any household member from your traveling companionship. Your companions are those NPCs who travel with you when you move about from one fief to another. Too many traveling companions, a dozen or more, will make the system seem slower as you move, because the game computer has to update the location of all those traveling with you. Some displays in the game Indicate whether or not the character is one of your traveling companions with a "yes" or not "no.".