How many men lived in Fish?

From the text:

There were twelve men, so it was said, in the village of Fish, twelve somber and inexplicable souls who sucked a lean milk from the almost literally bare rock upon which a mysterious populatory force had begotten them.