Yes! "Maybes" and "i'll try"s make people question what you mean, especially when they are given that answer many times, enough to lose trust. A specific no, maybe with a reason to help sugarcoat it, will suffice, and not hurt the other person's feelings.