Presiding over the once bustling quays, it has fallen in and out of favour over the centuries and even flirted once or twice with Hollywood.
Now plans have been revealed to revamp King's Lynn's Custom House amid moves to bring new life to the town's waterfront.
West Norfolk council hopes to use the 17th century landmark for hospitality, exhibitions, and events.
Its ground floor would be opened up with glazed panels giving architect Henry Bell's vision a fresh look.
Regeneration plans also include a vacant piece of land stretching inland from the River Ouse at nearby Devil's Alley.
Designs include a pergola running along the edges of the site, open and covered spaces, soft landscaping, as well as a children’s play area and a hidden garden.
Both would be funded from the £25m in government Town Deal funding Lynn was awarded in 2021.
A consultation over the plans runs from today until Friday, February 16 on the visionkingslynn website.
Alistair Beales, the council's cabinet member for business, said: “We know from previous consultation how much people value the riverfront, and that there is a desire for more things to see and do here. These proposals aim to fulfil that aspiration.
“It has been particularly important to come up with ideas to revitalise the Custom House in these proposals as we fully appreciate and recognise the significance of this building for the town.
“I would encourage people to take a look at the designs and share your views, and help to shape the future of the riverfront.”
A drop-in event is also being held at the Custom House on Thursday, February 1 (11am - 7pm).
'ONE OF THE MOST PERFECT BUILDINGS EVER BUILT'
Built as a merchant's exchange in 1683, it became a custom house in the early 18th century.
It was designed by architect Henry Bell, a native of Lynn who would go on to become its mayor.
Architectural historian Sir Nikolaus Pevsner, who wrote The Buildings of England, called it "one of the most perfect buildings ever built".
King's Lynn Civic Society calls it "a gem of a building", which uses "the grammar of classical architecture perfectly with two orders of pilasters, Doric below and Ionic above and very fine carving of garlands and grotesques".
In 1985, Lynn's waterfront and the Custom House were transformed into a movie set when Revolution, a lavish costume drama set in the American War of Independence was filmed in the town.
But while it starred Al Pacino, Donald Sutherland, Nastassja Kinski, Robbie Coltrane and Annie Lennox, it bombed at the box office.
In the early 'noughties', the building was taken over by the council, which used the ground floor as a tourist information centre, with a museum upstairs.
In 2018, the cameras returned when the waterfront around the Custom House was used as a backdrop for Armando Iannucci's the Personal History of David Copperfield, starring Peter Capaldi, Hugh Laurie, Dev Patel and Tilda Swinton.
The Custom House closed in 2019 after part of its ceiling collapsed.
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules here