Getting around Kazbegi
More
The town is small enough to get around on foot. However, it is on a somewhat steep hillside. Many of the streets are unpaved. If you have heavy luggage and your hotel/lodging is up the hill (away from the river), you may want to take a taxi. The Bolt app works in town.
Gergeti Trinity Church is a bit farther away (see below).
Source: Wikivoyage, Kazbegi, written by volunteers (CC BY-SA 4.0), not a government source. Prices and timings may be old; confirm before you travel.