They are not interested in your company and bid you on your way.
You may either carry on towards the Tower,
turn to the left to investigate the monument in the centre of the courtyard,
or sit down at the fire anyway.
