This phrasing carries the work. You’re requesting a particular failure, a particular lesson, and a particular structural change. In conversations with allocators and managers throughout institutional contexts, the responses cluster into three classes.
A robust reply: The supervisor identifies a sure drawdown episode and describes what structural assumption proved incorrect. They distinguish clearly between adjustments to mannequin settings, comparable to a lookback window or position-sizing parameter, and adjustments to the mannequin’s underlying assumptions, comparable to reformulating how alerts work together, restructuring how conflicting data is weighted, or changing a element whose implicit prior the workforce may now not defend. They clarify why the identical failure mode is much less more likely to recur, they usually join the lesson to a broader view about what their mannequin assumes the world to be.
A typical reply: The supervisor describes a troublesome interval and focuses on the adjustments made to lookback home windows, danger targets, or sign weights. That is the business baseline. A helpful follow-up surfaces whether or not something deeper occurred: “Was the underlying logic of the mannequin modified, or solely its settings?” Sincere managers will let you know. Unprepared managers will attain for the language of structural change with out the substance, at which level the hole turns into audible.
A regarding reply takes one in every of three types. The primary is an incapacity to recall a significant failure, which suggests both a brief observe report or a analysis course of with out the self-discipline of structural autopsy. The second is attribution of each troublesome interval to exterior regime change, with no reflection on the mannequin’s contribution to the loss. The third is a protection of the mannequin’s continued correctness regardless of the failure. A supervisor who has by no means recognized a structural assumption they acquired incorrect has both constructed a mannequin with out structural assumptions, which is not possible, or has chosen to not look at them.
