When I used to have it active, it would stay on indefinitely. Now that I've gone in to play with it, it looks like it's turning off when refreshing or reentering the setting screen.
That said, it's an odd battery savings feature which supposedly kicks in at lower percentages. It's not the most helpful, IMO, so I leave it off these days.