Madison knew that faction couldnt be removed without removing liberty from the lives of humans
Madison also knew that the factions could keep eachother 'in check' so to speak, and that would be the best way to keep everyone happy without removing faction, which he figured was essentially impossible