The first nucleus of the church was built in the 15th century, but the extension took place in the early 1500s. Inside there is an organ from 1852. According to popular tradition, the church was founded in the first half of the 15th century by the brigand Francesco Portici after he surrendered after being hunted by the authorities and made public amends in the Cathedral of San Savino in Castro.
He chose the woods of Monte Starnina as a refuge and built a small, simple chapel where he displayed a painting of the Madonna and Child in her arms, which was later named the "Madonna del Cecchino" (after the brigand). By the time of Portici's death, the hermitage already held an important place in popular devotion and an extension was necessary.