The architects Ricardo Scofidio and Liz Diller, left, urged razing the American Folk Art Museum building, which was designed by another architect duo, their longtime friends Billie Tsien and Tod Williams, right. LEFT, JOE FORNABAIO FOR THE NYT; RIGHT, CHESTER HIGGINS JR. / THE NYT