You might accidentally have dropped a Launcher icon (the icons next to the Application and Places drop down menu) in Ubuntu with Gnome-Fallback-Session installed.

Removing it can’t be done by right clicking, and the choosing remove.

But: I can be done, if you press <Super+Alt> whilst right clicking. The option to “Remove From Panel” then appears.