Not sure about Norwich but there used to be quite a good one in Kings Lynn, 'The gateway of the East' (apparently). Remember, this is East Anglia you are visiting so Surplus shops are probably going to have lot's of chain mail and sharp stick. Oh yes, when entering East Anglia, don't forget to put your watch back twenty years!