> 
> What happens if _one_ library my program needs is so bit that it needs -fPIC...
> do I need to build all libraries.

No, you can mix both.

The restriction in this regard is that all object files from which you
build the shared library must be compiled with the same "memory model".

-pk