The owner of a mansion previously lived in by Adele has said that the singer’s suggestion that the property was haunted has made it impossible to sell.