Short answer
Use numbered reusable visitor badges and a paper sign-in log: each visitor gets a numbered badge that is returned at sign-out, so you can see at a glance who is still in the building. Printed 'Visitor' badges in a bright color make it obvious who does not work there.
