You can easily remove program shortcuts which may have pinned to the start menu by right clicking them and selecting Unpin from start Menu. But …

… but if you have pinned some system folders like Computer, Recycle Bin, Control Panel, etc, you may not get the option to Unpin the program from the Start Menu.

To unpin such un-removable programs and folder shortcuts, open regedit and navigate to the following key:
HKEY_CURRENT_USER\Software\Microsoft\Windows\CurrentVersion\Explorer\StartPage

In the RHS pane, delete Favorites.
Restart. The Start Menu will be reset to default.
If you have liked this post, you might want to check out some more, on topics like Hacks, Registry, Start Menu, Tips.