The castle was burnt and ruined in 1385 and rebuilt in the 15th century in its current form by Pierre de Montbrun, Bishop of Limoges. Badly damaged again mainly by fire in 1917, it kept its four big towers, one of which is the "Grand Jacques", a superb quadrangular keep which is one of the finest examples of its kind.

A small distance away, the castle mound can be seen, which was the first primitive fortification in this place. Montbrun, reflected in its lake which acts as a moat, is undoubtedly one of the most beautiful and picturesque monuments in Limousin.