It depends what marker your using. The only markers, that I know of and have used, that allow you to do this are the "Window Marker" or "Door Marker" Select the door or window, choose the "appropriate" marker, go to Dimension Marker > Marker Direction here you can select Standard, Vertical or Horizontal. To turn off the fill go to 2D Representation turn off use marker fill and set background pen to 0.
HTH