It was formerly known as the Royal Victoria Yacht Club. The yacht club was based in the building until 1966, after which it has had a varied history, having initially traded as a restaurant.