Should deteriorating-but-historic buildings be demolished or restored?

Way too much attention is devoted to "preserving" old buildings, some of dubious historical importance. Meanwhile funding for restoration is short, and the building continues to crumble and deteriorate, perpetuating an eyesore and a blight.