What misunderstanding of Scrooge’s does the Spirit correct?

From the text:

"Forgive me if I am wrong. It has been done in your name, or at least in that of your family," said Scrooge.

"There are some upon this earth of yours," returned the Spirit, "who lay claim to know us, and who do their deeds of passion, pride, ill-will, hatred, envy, bigotry, and selfishness in our name, who are as strange to us and all our kith and kin, as if they had never lived. Remember that, and charge their doings on themselves, not us."