Since the introduction of themes this has become far easier - in the default theme just go to the header.php file and edit what you don't want - Thus leaving the gallery.php file alone for further upgrading.
Nice work to all the plogger theme for making this app so worthwhile.