This is a remnant of a security fix to ensure that the page always had a content type. (you can read all about it here http://drupal.org/node/451304
A clean fix is to add the following to your template.php file (create one if you don't have one and add to the pre-process page if you do
Supplied by : davidwhthomas
It is a better solution than hacking the core.
Note also that if you add a value to the $head in your template.php page preprocess function, you will remove one of the entries in any case.
$vars['head'] = "<!-- some comment -->\n" ;
info [at] blue-bag.com
Telephone: 0843 2894522
Blue-Bag HQ: The Garage, Manor Farm Chilcompton, Radstock Somerset, BA3 4HP, United Kingdom
Telephone: (+44) 01761 411542
Blue-Bag Brighton: Unit 35 Level 6 North, New England House New England Street, Brighton BN1 4GH United Kingdom