I've had the Hong Kong version of the Vita for a while now and I thought I'd make a list of some areas I feel need improving. Overall the device is fantastic but a few things could make it even better.
1. HDMI-out
The PSP had TV-out and naturally the Vita should be expected to have it as well. I've been hearing somethings about DLNA letting you play the PS Vita on a TV wirelessly, but it would still be nice to have a low latency choice.
2. DualShock 3 support
Going off on the TV-out would be DualShock 3 support. This will effectively turn the Vita into a home console. Now you may see why Sony might have been hesistant about these two features, they make the Vita directly compete with the PS3. Personally I think Sony should worry more about making exclusive games on both platforms. I'd also argue that they've ALREADY made enough exclusive games to justify both platforms. Hopefully they realize that and address these issues.
3. Either Flash/HTML5 support or in-game browser
The Vita's browser is better than I expected. The only problems I really have with it are minor tiling issues and the lack of Flash or full HTML 5 support. On the other hand, the browser takes up enough of the Vita's resources that it can't run alongside an open game. I want Sony to either make it a full on, capable browser or make it a watered down browser than can be used in game.
You'll notice up top that I didn't mention internal storage. I would personally prefer that we don't have internal storage on the Vita, as having removable memory makes it easier for people to upgrade and sell their old cards whenever they want. I also didn't list the cameras, because it would drive up the cost for a really quite useless component of the system.