What lead to the decline of the banker’s fortune?

From the text:

Gambling on the Stock-Exchange, risky speculation, and the recklessness of which he could not rid himself even in old age, had gradually brought his business to decay; and the fearless, self-confident, proud man of business had become an ordinary banker, trembling at every rise and fall in the market.