On the rare occasions when closing an app causes my phone to reboot (usually a dodgy game), it does seem to take about a minute to boot up again.
I can only imagine it's performing various filesystem checks while booting to tidy up anything that went wrong, much like Windows ScanDisk or fsck on Linux.
But you say there's no pattern, so presumably in your case it's not following an 'unclean' reboot ?