Since you say you want something "phone-sized," I'm guessing you don't want an actual phone.
Only thing I can think of that's phone-sized but isn't a phone, though, is the iPod Touch, which is basically an iPhone without the phone capability.
I have an iPhone, so I can tell you that I've done simple writing using the "Notes" app that's part of the basic set of apps that come with the iPhone/iPod Touch. Swiping up and down to move through a document is pretty quick, and documents saved in Notes can be set to sync to a PC via USB along with everything else on the device. (And if Notes isn't good enough, I assume there are some reasonably priced text-editing apps with more features that would be available through the Apple app store.)
You can probably find a good price on a used iPod Touch that's a couple generations back -- having an older model wouldn't be too much of an issue if you're really just wanting to use it for writing.