I think I have found the answer to this one. The start of the rubbish shown is GIF89a but the extension of the file is jpg.
I had to delete the file from the site and it all seems to be working now.
When I removed all the reference from the directory structure and went back into the admin page the file still shows, (probably still in the db.) I then ran delete from the admin page and everything seems to be ok now