There shouldn't be a problem leaving it on your server if Plogger is already installed, as Plogger will display a "Plogger already installed!" message. Just to be safe from malicious users though, you can delete the files prefixed with an underscore from your server (_install.php, _upgrade.php)