I have used the new template below to show how it looks. We can add more details to the linked CONTRIBUTING.md in the pop repo.
I have not included any LLM (also known as AI) generated content in...
Have to think about this in an open source context. You have an open ended population ready to submit to your project if they think they can be useful
Now, thanks to GenAI, a bunch of people who aren’t good at various things now thinks they are good at various things. Whether it’s coding, making comics, making videos, what have you. Try to do nuance even if it strictly makes sense, and you are stuck with the slop problem if your project is sufficiently popular.
In terms of more directly on your points, if someone does GenAI to do a security analysis, ok, but I’d want them to do the tedium of trying to identify the false positives and then re-report it in their words of actual understanding. It can catch things, but along the way makes a haystack of sillyness to go through. Same for code review, legitimate issues, but lots of missing (I spent a non trivial amount of time yesterday because a GenAI code review insisted a variable would be unitialized when referenced, when I see an uncoditional assignment just a few lines above, trying to think if there was some catch I wasn’t seeing). So indirectly using it and only subjecting the developer/maintainer to that which you know makes sense.
Problem being is that people have used Claude and have forwarded to me saying “I don’t understand this well enough to judge, but forwarding to you just in case”. I have the same tools doing the same things as you, I don’t need meat proxies that just pass through the stuff without understanding.
Have to think about this in an open source context. You have an open ended population ready to submit to your project if they think they can be useful
Now, thanks to GenAI, a bunch of people who aren’t good at various things now thinks they are good at various things. Whether it’s coding, making comics, making videos, what have you. Try to do nuance even if it strictly makes sense, and you are stuck with the slop problem if your project is sufficiently popular.
In terms of more directly on your points, if someone does GenAI to do a security analysis, ok, but I’d want them to do the tedium of trying to identify the false positives and then re-report it in their words of actual understanding. It can catch things, but along the way makes a haystack of sillyness to go through. Same for code review, legitimate issues, but lots of missing (I spent a non trivial amount of time yesterday because a GenAI code review insisted a variable would be unitialized when referenced, when I see an uncoditional assignment just a few lines above, trying to think if there was some catch I wasn’t seeing). So indirectly using it and only subjecting the developer/maintainer to that which you know makes sense.
Problem being is that people have used Claude and have forwarded to me saying “I don’t understand this well enough to judge, but forwarding to you just in case”. I have the same tools doing the same things as you, I don’t need meat proxies that just pass through the stuff without understanding.