We do flush the complete cache on activation. We should provide better strategies for that. A simple strategy could be:

• mark cache as outdated
• on request start recaching of the page/resource
• until the page/resource is fully cached serve the old cached content

This would make sense for pages which need heavy computation or in installations in which you activate every now and then