I really dislike how, after 5 minutes of reading the post, I'm struggling to tell whether:
The post is from METR (pretty sure it's not, but it uses the METR tag, brands itself as a METR thing, and METR has a similarly named internal project)
This post is satire
Whether a human was actually substantively involved in writing this post
Being able to filter out AI-generated content from the front page would be great, but I don't love that people like @Thomas Kwa🔹 will be somewhat obligated to respond to random slop about METR.
I could see that being good. I think I'd still prefer the filter-out-under-n karma option because I understand what's actually going on under the hood. I expect I'd prefer it to the current front page.
It doesn't appeal to me because I want higher info density, and this reduces it - I could see others liking it .
It's not obvious to me that you can't just hide low karma posts as an option - some options: 1. All first-time posts are reviewed by the forum team, who can upvote things and put them above the threshold 2. Make the low karma/low user karma post hiding disabled by default 3. Try out an option for a bit and remove it if it's not working well
When I posted, the front page felt "spammy", with lots of generic, low-quality posts, presumably from first-time posters. I now rarely click on anything below 15 karma, but that was >50% of my frontpage.
Nitpick but I think it’s unlikely that biological humans will completely disappear and I’m an AI safety person. The sota literature is ofc Pantheon season 2 where a few humans choose not to be uploaded.
My impression is that Pangram has very low false positive rates and unclear-to-me false negative rates - so I'd suggest using it to rule things in as AI-generated, but not strongly rule them out.
A little related discussion here https://x.com/caleb_parikh/status/2035434186417262863
Oh lol, I haven't written a post in a while :'). I think it would have been much more obvious if I had seen it for the first time in a blank editor, which is presumably how much people see it for the first time.
Also, minor, but I'm not sure that the first sentence in the flag is grammatically correct, which led me to think I might need to add a disclosure to be compliant with your policy, as it was flagged, even if I haven't used any LLMs for editing/writing this post.
I made a small edit and saw that my post was flagged for LM usage. The post (to me) doesn't sound very LM-generated - but I do find it more difficult to assess my own writing than other people's, so I ran it through pangram which seems to think it's 100% human generated.
From quickly skimming your LLM usage policy, it looks like you're also using Pangram, which is a bit confusing. Maybe you have a bug, or are using a different version to me? Or am I using Pangram incorrectly or suboptimally?
[This comment is no longer endorsed by its author]
I really dislike how, after 5 minutes of reading the post, I'm struggling to tell whether:
Being able to filter out AI-generated content from the front page would be great, but I don't love that people like @Thomas Kwa🔹 will be somewhat obligated to respond to random slop about METR.
I could see that being good. I think I'd still prefer the filter-out-under-n karma option because I understand what's actually going on under the hood. I expect I'd prefer it to the current front page.
It doesn't appeal to me because I want higher info density, and this reduces it - I could see others liking it .
It's not obvious to me that you can't just hide low karma posts as an option - some options:
1. All first-time posts are reviewed by the forum team, who can upvote things and put them above the threshold
2. Make the low karma/low user karma post hiding disabled by default
3. Try out an option for a bit and remove it if it's not working well
When I posted, the front page felt "spammy", with lots of generic, low-quality posts, presumably from first-time posters. I now rarely click on anything below 15 karma, but that was >50% of my frontpage.
Is there a way for me to filter posts below say 15 karma from my frontage? I couldn’t easily find it on mobile.
Nitpick but I think it’s unlikely that biological humans will completely disappear and I’m an AI safety person. The sota literature is ofc Pantheon season 2 where a few humans choose not to be uploaded.
My impression is that Pangram has very low false positive rates and unclear-to-me false negative rates - so I'd suggest using it to rule things in as AI-generated, but not strongly rule them out.
A little related discussion here https://x.com/caleb_parikh/status/2035434186417262863
Oh lol, I haven't written a post in a while :'). I think it would have been much more obvious if I had seen it for the first time in a blank editor, which is presumably how much people see it for the first time.
Also, minor, but I'm not sure that the first sentence in the flag is grammatically correct, which led me to think I might need to add a disclosure to be compliant with your policy, as it was flagged, even if I haven't used any LLMs for editing/writing this post.
@EA Forum Team
I made a small edit and saw that my post was flagged for LM usage. The post (to me) doesn't sound very LM-generated - but I do find it more difficult to assess my own writing than other people's, so I ran it through pangram which seems to think it's 100% human generated.
From quickly skimming your LLM usage policy, it looks like you're also using Pangram, which is a bit confusing. Maybe you have a bug, or are using a different version to me? Or am I using Pangram incorrectly or suboptimally?