My take:
THe SVX is more of an experience than a car. I know that sounds cheesy but it is true. There is nothing like sitting back in the deep leather seats; stereo booming (they have great stock stereos) cruising 100 on the HWY.
I am still amazed how inexpensive these cars are in the market; remember that this was $35k new. The fact that there were only 15k imported to begin with and a lot of people part them out as they become too expensive to fix.
That being said, I would recommend that a SVX be a second car, not your get to work and and groceries vehicle. Also, be very selective in purchasing one, and don't buy one from a used car lot. These go at auctions fairly cheaply and these guys hae no idea what they are dealing with. I test drove one at a car lot and immediately I could hear the front diff grinding, the salesman tried to convince me it was the common Subaru CV problem and he would deduct $200 for a new one. I looked at least 10 SVX's over a period of 4 years before I bought mine. I had actually given up the search.
I finally got mine from the original owner who had documented every penny that he had put into car. It was worth the wait.