In 1919, after the First World War had ended, a committee was formed to decide on a fitting and permanent memorial to the men of Upton who had fallen. A large house, called the Elms, on the corner of Ford Road and Salacre Lane had been empty since the tenant, Mr George Harley, died in 1916 and the owner, Mr Thomas Davies of Bebington, wanted to sell it.

The Elms had originally been built in the 1800s, but had been rebuilt and greatly enlarged by Thomas Green in the 1860s. Behind the house were ornamental gardens, two tennis courts and a large field. In all, the grounds extended to about 6 acres. The garden in front of the house was separated from the village by a high wall.

The committee proposed to buy a portion of the Elms estate, consisting of:

• The modern part of the house
• The ornamental gardens
• The tennis courts
• The greater portion of the field

The house would be used to provide accommodation for meetings, concerts and social gatherings, a library, a billiards room and rooms for a caretaker.

The grounds behind the hall were laid out with tennis courts, bowling greens, croquet lawns and a football pitch. Clubs were formed for each of these sports, the tennis, bowls and croquet clubs are still going strong today.

In 1963 the building was sold and a new Victory Hall was built behind the original the War Memorial was moved to the lawn in front of the Library. The old building was demolished and a block of shops was built on the site.