The text for order “cautious” says “retreat at damage (followed by slider)”. I set this to 25% and the ships didn’t try to get away until 75% damaged. Setting it to 75% made ships retreat after taking 25% damage. Either there’s a bug in the AI logic, or the text description is wrong.
Aha. well spotted. Fixing now…