This is just one of those things that drive a person nuts. Depending on how your environment is configured in UNIX, when you hit the backspace key you will get a ^H key instead of removing the character you wanted to delete.

A quick fix is to issue the following command:

stty erase ^H