Sometimes it closes after you click the close button a few times.
Sometimes it closes, but the app tile on the apps launcher screen is still hilighted.
Perhaps this has to do with having many subapps open.

If you close all the subapps by hand, and then close the app it appears to close correctly.