Comment 35 for bug 1009156

It also appears you can't update the virtualbox packages after having used Virtualbox in the current boot session for the same reasons.

Most vbox* modules can still be unloaded with rmmod -f, but vboxnetadp even withstands rmmod -v -w -f vboxnetadp .