Partial geometric designs and difference families