The Ape-Dog tells you that no one is allowed into the Black Tower after dark
— you will have to look elsewhere for shelter.
You may either resign yourself to a fight.
Or you may pick up a stone and cast a Fool's Gold Spell on it,
offering them a nugget of gold as a bribe to let you in.