In Windows you cannot use #,!,@ (There are more, I just don't remember them all) in a name of a folder.
In some websites you cannot use special characters. Some characters are what you "escape" characters.
An escape character can cause an error when trying to insert data or get data from a database. Sometimes it can prevent a syntax error, if used the right way.