Brutus thinks that honest men will follow through on their intentions; therefore, they do not need to swear an oath.
In Roman culture, you simply were true to your word. No oaths were needed, and this is the opinion the Brutus holds to thats the answer.