The Pacific Film Archive between Bancroft and Telegraph is a well-known museum that's usually showing something esoteric and culturally enlightening.
The adjacent Berkeley Art Museum is a smaller art museum, but has interesting rotating exhibits. As a bonus, UCB students get in free, and can take a free guest.