Lords Stuck Glitch

[Elon.g]

I keep getting this glitch where the Lords of my Kingdom keep getting stuck in castles and won't move. When I ask 'What are you and your men currently doing' they reply with something like 'there are enemies nearby and we are staying here'. - This is the problem because there are no enemies. Furthermore, even when I raise the army as I am Marshall, they still won't move. Also, when I specifically provide them with a new task to follow/retreat/go to .etc (I've tried them all) they still won't move.

How do I fix this?