There used to be a restaurant in Evanston IL that had caviar on their Sunday brunch buffet back in the mid 70's. There wasn't a lot of it and it was kind of at the back where it was hard to reach.
One of my college dorm-mates brought some tins of caviar that he had purchased in Switzerland over a break. (His dad was a senior pilot for Pan Am, so he pretty much flew for free.) He also brought in some fresh Brie cheese, a lot different than the aged stuff they allow through customs these days.
So I've had it a few times, but not for a long time.