Best is the legendary Probe, in the side of the Bluecoat School Building. Follow the signs for the Bluecoat from Church Street.
Dig in Bold Street is cool, and there's another in a vintage clothe shop basement that has a good selection.
And on your side of the water there's Skeleton records.