Comment 2 for bug 79332

The kernel-image should run update-grub in its post removal script. Which package did you uninstall?

The sorting uses the opposite ordering. The latest one is the first one that will be loaded. If not this would be a bug. So please attach your /boot/grub/menu.list.

There are some cases in which you are happy to still have the "obsolete" kernels on your disk. There was a spec last year for a tool to free up hard disk space, that could also include cleaning up old kernels.