You can remove shortcuts from your desktop without deleting the important files they point to. Here's how to do it on a Mac ...
You can easily delete a notebook in OneNote when you no longer need it by accessing File Explorer and removing it there.