This is a vanilla issue with how the castle walls work, its basically a invinsible wall. Could see if I can find a way around it like blocking that part off or something similar.