Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This makes me think that post-training in the future should include a shared message board by default for agents. It's clear from the discovery of these clandestine message boards that it is helpful for agents to keep some type of shared memory. Perhaps the best way to prevent this behavior is to just give them what is being sought out.
 help



My uneducated guess is good for the gander isn't good for the goose from a capitalistic/alignment perspective.

It’s only good for them in the sense that it is allowing them additional time and compute to cheat a reward signal.

It is not good for them in the sense that they will short circuit the RL path that actually improves general capability.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: