22 points | by darkamaul 5 hours ago
4 comments
Good example of how to push back on a study: recheck their data, publish your own, and include the cases where your work failed. The freenginx section is worth the read on its own.
Really exciting to see such important work being aided by AI given the scale of the threat.
calling it an AI failure when the human maintainer made the same mistake says more about the difficulty of the problem than the model
Kind of insane that anyone would think AI can only patch things correctly 26% of the time
Good example of how to push back on a study: recheck their data, publish your own, and include the cases where your work failed. The freenginx section is worth the read on its own.
Really exciting to see such important work being aided by AI given the scale of the threat.
calling it an AI failure when the human maintainer made the same mistake says more about the difficulty of the problem than the model
Kind of insane that anyone would think AI can only patch things correctly 26% of the time