If the user has finished a study or survey, it should stay in their "finished" panel - it should not disappear just because it's been deleted from index.json. Right now they're disappearing from the interface even though the code is still cached, because the instantiation of tasks is determined by the filenames listed in index.json. TestPilotSetup should instantiate the UNION of the set of cached tasks and the set of tasks in index.json.
Make sure we don't try to instantiate any libraries as tasks, though.
Requesting a litmus test: Should verify that Test Pilot displays studies in the finished window even when those studies are no longer being deployed from the server. (This requires testing on a profile that has old studies... is that a problem for litmus?)
Hmmm, can this be simulated from the debug page? If so, what would the steps be?