Simple Software: Is it viable?

I love the idea simple software. Of software without cruft and bloat. When I create an application I want to make it simple, but that is not the way of the world. Most applications end up being complex. I have not entirely given up on the idea of fighting creeping featurism, featuritis and bloat, but it occurred to me that it may be a losing battle, after switching from SimplePHPBlog to Wordpress (not for this site) and Blogger. It seems that most projects to create plain vanilla or simple versions of software with a reduced feature set nearly always fail to gain popularity. If you look at Windows, it's sold on features, when you look at products in the store, they are sold on features. When you think of the natural world, it seems true that:

All significantly interesting things will necessarily become complex and paradoxical given enough time.