Hey Jess,
What size of PDF file do you class as 'big'?
I have noticed lots of complex symbolic fills do increase the PDF file size a bit, but I don't use sheets much larger than A3 (12x17). Maybe it would have a even greater effect on larger sheets?
When you say 'slow' do you mean the PDF files become slow to navigate through, or the main project file? Again, symbolic fills are probably the culprit here.
The solution is to reduced the fills complexity where possible. Also make sure you are not using arcs or circles in the fills; approximate their shape using straight segments. This ArchicadWiki article may be useful for more info -
http://www.archicadwiki.com/PDF%20file%20size%20and%20Fill%20choice