Upon your overlords request, you must go to his home fief and reaffirm your loyalty. This cannot be requested more than once a year.