A shop bursting with antiques and artefacts has opened in the old Barclays Bank building on a local High Street.