Fine-Tuning LLMs For ‘Good’ Behavior Makes Them More Likely To Say No

Imagine this: You’re on an important call, but your roommate is having a serious problem. Do you leave the meeting to go and help? Now, imagine this: You’re on an important call, but your roommate is ...