Actually, there are more good arguements for his death, than his continued rule. Here are a few scenes where it becomes evident that he is not fit to rule.
Caesar’s physical limitations (I.ii)
Qualifications (I.ii)
Marullus and Flavius (I.ii)
Brutus’s reasons (II.i)