According to tradition, for the first time in the village, a shepherd spoke about Ai-Yannis, who saw the bright figure of the Saint on the hill. He told the villagers and they believed him, because he was a good Christian. So, they built there a very large and beautiful monastery, which covered almost the entire mountain. According to tradition, a part of it was destroyed by a strong earthquake and the rest was destroyed during Turkish rule.

According to the testimonies of local elders, when the Turks conquered the city, they used the ruined monastery as a fortress, to monitor the area and also to send signals to other fortresses at night, with fires lit.

Over the centuries, the monastery was also used by the inhabitants of the area, as a means of protection, from the attacks of barbarian conquerors.

The refugees who settled in Hadriani had a special devotion to Saint John, that is why they decided, after several years, where the great monastery once stood, to build a small church, dedicated to their beloved Saint, Saint John . Digging through the ruins they found two ancient icons, which they took for safety to the Church of Agios Nikolaos in Adriani.