You certainly should! Carpetblogger and the Beirut Correspondent headed up to the Caucasian village in Georgia two summers ago and had a great time hiking around the Holy Trinity Monastery, listening to polyphonic singing and falling into pits filled with sheep heads.
Hans at Kaukasus alerted us to the helpful, well-written site Kazbegi in the Caucasus that details all the homestays in the villages located around the 5000 meter (16,500 feet) Mt Kazbegi. It includes great details that remind me why Georgia is such a bad-ass place to travel, such as:
"At the time we visited the homestays in Jutta, the village didn’t have any phone coverage. That’s why there are no phone numbers listed, ask the locals! But try to remember the first name of your host—because the surname for all the people from Jutta is the same: Arabuli."
"The friendly family might want to give you their huge Caucasus dog as a present."
A giant Kavkaz shepherd is the perfect souvenir from a trip to Kazbegi!