Double sided Collision boxes?

Recently realized that nowadays blender sets everything to "double sided" by default so I've had to go trough just about everything I've done lately and uncheck it so that the poly count isn't doubled on everything. Now I just realized that this must also apply to the Collision and LosCollision meshes as well. Before I dive head in and start fixing them all I guess I'll just ask if this is worth doing. Anyone have any grip on any affect the double sided option has on a Collision and LosCollision mesh?