1. click on windows explorer button in taskbar.
2. under libraries (in navigation pane), right click on the music library and click properties.
3. you will see list of folders included in that library. click on the folder you want to remove and click remove button.
If that does not work - right click on Libraries and select "restore default libraries".