Don't use -fpic if library is too specialized?

[Boris]

I'm reading as much about PIC as I can find in order to understand if I 
should compile a library here with or without -fpic. After all I tend to 
believe that in my case it's better not to use -fpic as 1) for this library 
performance is critical and as 2) the library is too specialized that it 
will be used by all kind of different applications. If I assume that at any 
time there is probably only one program running which makes use of this 
library PIC doesn't make much sense as far as I understand as you pay for a 
feature you actually don't need. Is this correct?

Boris