Suppressing bizarre delete key behavior

The delete key, at the end of a line, warps the cursor to the new end of the line. This is bizarre, and unlike any other editor I have ever used. I am constantly tripping over it. Is there an option to turn it off?