The aluminum battery holders worked fine but there was always the problem with the two lugs protruding to catch on things or scratch other items when mounted externally.

A more modern approach is the plastic boxes that have a cover and come with or without a switch. Can be mounted without holes by glue or double-sided tape. Pretty inexpensive when purchased in small quantities. Good appearance and doesn't look like a kludge.