You can also make the active tool match what you are trying to select and use the quick select method to make your selection. In this case, make the wall too active and select the wall.
In my work environment, I keep the quick select method off and use the keyboard (shift + space bar) to temporarily turn it on, then click on the desired element.
Erich
AC 19 6006 & AC 20
Mac OS 10.11.5
15" Retina MacBook Pro 2.6
27" iMac Retina 5K