Well. I grew up in Victoria and then lived in Vancouver for 6 years... so it depends where you want to go.
In Victoria, I would suggest Cafe Brio (
http://www.cafe-brio.com) for dinner. Its probably the nicest restaurant in the city. Small, classy and extremely good food.
In Vancouver. Watermark, on Kits beach is a great restaurant with a fantastic view of the sunset over the ocean. The food is spectacular as well. Lumiere is a famous restaurant in kits that always gets rave reviews, but is quite expensive.
As far as hotels in Victoria, there's always the Empress Hotel, but in my opinion, its overrated. I would try for one of the smaller bed and breakfasts in the James Bay area. There's a few on Dallas Rd with views overlooking the ocean. If you're willing to go upisland a bit, then try a bed and breakfast in Brentwood Bay. I've heard really good things about a couple places there, and you can always come into Victoria (30 min drive) to go out for dinner.
Where you stay and eat kind of depends on your price range....