They are limited if they harm the public interest. In other words you have a right to free speech but you can't yell fire in a crowded place because it would be against the public's best interest to cause a panic.
Another example: You have the right to religious freedom as long as you aren't forcing people to believe your religion.
The limits end where another person's limits start.