Around the 12th or 13th century, the original German settlers built a chapel on this site. In the mid-15th century, the chapel was converted into the chancel of a Gothic church. From 1529 until 1673, the church and parish were administered by Protestant pastors. During this period, a tower and a two-storey gallery were added, increasing the church’s capacity, as it served worshippers from several surrounding villages. In 1714, the main altar was built in the Rococo style. Its altarpiece, measuring 250 × 135 cm, depicts the young Jesus meeting John the Baptist. On 27 July 1764, the church was visited by King Joseph II, the future emperor, together with his brother Leopold. A legend is associated with the church’s origins. According to the story, people initially began building it elsewhere, but everything the masons constructed during the day was found demolished the following morning. A mysterious voice advised them to build the church in another place. They searched for a more suitable site until they came upon a burning bush, where they found a crying child. They built the new church so that its altar stood exactly where the burning bush had been. Beside the low wall surrounding the church stands a commemorative plaque marking the geographical centre of Europe and recalling the adoption of the Declaration of Sovereignty of the Slovak Republic.
Near Kremnické Bane lies the geographical centre of Europe, marked by a symbolic monument. The location of Europe’s "true" centre has been debated for centuries. Proposed sites range from Germany to Lithuania. This is because different definitions of the centre and methods of calculating it result in several possible locations.