Can we stop with the ChatGPT responses?

[James Carlson]

Anyone else notice an increase in BP users responding in forums with what appear to be ChatGPT-generated answers?

The latest one I noticed was here. (No intention to single this dude out, but it's the most recent one I've seen.) I have a couple problems with this trend:

1. It's false advertising.
A lot of real estate professionals (including myself) give thoughtful responses at least in part to drum up business. (Along the way, we hopefully educate the community as well.) When you pop into a forum you know nothing about and post an AI-generated post without disclosing that, you're implying that you know the subject matter. Unsuspecting users may want to then use your services based on a false premise.

2. The info's flat wrong.
At least a lot of the time. The above linked post talks about Breckenridge, Colorado and Keystone as great options for a first-time short-term rental investor because they're "STR friendly." In fact, you can't get a new vacation rental license in either city, nor in the unincorporated Summit County that surrounds those towns.

Don't mean to be a boomer (or more accurately a Gen Xer) crapping all over the new tech, but the unvetted use of ChatGPT to answer nuanced, grey-area questions can lead newer investors into dangerous territory. 

Alright, I'm off my soapbox.

[James Carlson]

Quote from @James Carlson:

...2. The info's flat wrong.
At least a lot of the time. The above linked post talks about Breckenridge, Colorado and Keystone as great options for a first-time short-term rental investor because they're "STR friendly." I...

Not to mention the absurdity of offering Breckenridge as a good option for a first-time Colorado investor (which the original poster was). I've been working with STRs and Airbnb investors for seven years. Not many thought a $3 million property was the best first investment. 

[Aaron Breckenridge]

They're already prohibited. @Moderators will remove them quickly if you report them (use the "..." below the post to report).

[Scott Trench]

I think that there's a component of vote/post ratio (especially for folks working on their first 100 posts here as well) that has to do with adding value. We need to find a way to reward high quality, human generated content, and deprioritize low value posts to discourage workarounds. 

That will solve the root cause. But, until then, please just report the AI posts and we will moderate them.

[Nathan Gesner]

Quote from @James Carlson:

Thanks for tagging us, @Aaron Breckenridge.

If you see someone using AI, type "@moderators" and one of us will check it out. In this case, the post was removed by the time I looked at it.

[Nathan Gesner]

Quote from @Scott Trench:

We need to find a way to reward high quality, human generated content, and deprioritize low value posts to discourage workarounds. 

I agree. Something like a $1,000 bonus for every 5,000 posts? 

Two tickets to Cancun for every 20,000 posts?

Partial ownership in BP?

[Rene Hosman]

Thank you for this @James Carlson , as has been mentioned it is not allowed to post AI generated content in the forums, it falls under section E of our rules "no impersonations" If you or anyone suspects AI generated content please tag @moderators and we will work to resolve the issue as quick as possible. These days it can be hard to tell but sometimes it's just so painfully obvious, and that's not the kind of content we want to reward because as you mentioned AI will sometimes at best embellish and worst fabricate or hallucinate fake information. 

[Ned Carey]

     Something like a $1,000 bonus for every 5,000 posts? 

     Two tickets to Cancun for every 20,000 posts?

I agree 100% with @Nathan Gesner but only for members who joined before 2010

[Will Barnard]

Quote from @Ned Carey:

     Something like a $1,000 bonus for every 5,000 posts? 

     Two tickets to Cancun for every 20,000 posts?

I agree 100% with @Nathan Gesner but only for members who joined before 2010

I second this statement!! Agree 1000%

[Alan F.]

Quote from @James Carlson:

Quote from @James Carlson:

...2. The info's flat wrong.
At least a lot of the time. The above linked post talks about Breckenridge, Colorado and Keystone as great options for a first-time short-term rental investor because they're "STR friendly." I...

Not to mention the absurdity of offering Breckenridge as a good option for a first-time Colorado investor (which the original poster was). I've been working with STRs and Airbnb investors for seven years. Not many thought a $3 million property was the best first investment. 

 Lol, how ironic! I was thinking the very same, thanks for saying it. A few bots n trolls too nowadays 🙄

[James Carlson]

Quote from @Nathan Gesner:

Quote from @Scott Trench:

We need to find a way to reward high quality, human generated content, and deprioritize low value posts to discourage workarounds. 

I agree. Something like a $1,000 bonus for every 5,000 posts? 

Two tickets to Cancun for every 20,000 posts?

Partial ownership in BP? 

Angling for equity, I love it.

[Chris Seveney]

@James Carlson

Very obvious - paragraphs with headings and then a “in conclusion” statement at the end

[Scott Trench]

Quote from @Nathan Gesner:

Quote from @Scott Trench:

We need to find a way to reward high quality, human generated content, and deprioritize low value posts to discourage workarounds. 

I agree. Something like a $1,000 bonus for every 5,000 posts? 

Two tickets to Cancun for every 20,000 posts?

Partial ownership in BP?

 @Nathan Gesner - while I cannot give you an ownership stake in BiggerPockets (let's talk at 100,000 posts...), I would be very grateful if you choose to attend BPCON, and your 26,550 posts have certainly contributed so much value to this platform and not just the tens of thousands of people who you responded to, but the hundreds of thousands or millions more who have read your comments, that I'd be delighted to give you (and a guest) a completely free ticket to BPCON Cancun, including food, beverage, access to all events, and a room at the 5 star moon palace resort.

@Alexandra Hughes Pailet - Can you please help Nathan get set up to Attend BPCON? 

I also, for the record made the same offer to @Jay Hinrichs, but he can't make it this year.

You guys are the top two forum posters of all time here on BiggerPockets, and we are grateful for you all you do! 

[Steve K.]

If anyone has any doubt about whether or not a post is AI-generated, just run it through one of the free AI detectors available online like the one Grammarly offers. Cut and paste the text into the AI-detector and see how it scores. Robots catching robots. And yes if anyone is wondering, the post James called out scored "67% of this text appears to be AI generated". 

[Michael Quarles]

I think what we get for posting is better than a vacation. I never posted for the money.   ROFLMAO

That said if Google knows when I use ChatBGT for SEO biggerpockets can for posts. 

The issue is advertising revenue and face time. it’s not in an advertising model benefit  to limit in mass posts.  

X didn’t solve for it until Musk took over.  

[Steve K.]

Turns out there were other posts in that thread which also tested positive for AI...

[Andrew Syrios]

I don't know what you're talking about with AI being "flat wrong." I mean just take a look at all of these brilliant AI responses: https://www.icloud.com/photos/#/icloudlinks/0c9JHfXSW0EgLm-W...

Our robot overlords might need a bit more fine tuning before they begin to rule over us...

[Dan H.]

There is a user that every post reads like it was AI generated but I do not want to be the judge.  Maybe he happens to write in a similar manner to the AI responses.  

67% AI generate implies 33% not AI generated.   Is that an AI generated post or a post that leverages AI in the response?  Note I am not stating that a post should ever be 100% AI generated.

I reference different sources for the data I reference in my posts.  Is there a large difference in referencing core logic, neighborhoodscout, Zillow, Rentometer, etc and referencing AI generated response?

[Scott Trench]

@Dan H. I think AI generated posts are like [insert euphemism]. You know it when you see it.

Let us know when someone is using AI to create generic, useless posts, and we will remove it. If someone uses AI to supplement original thought in an extremely valuable way… don’t report it and let’s thank them and learn from them. 

[Nathan Gesner]

Quote from @Scott Trench:

Very generous, but I can't attend, either. I'll send you a DM.

[Steve K.]

Quote from @Dan H.:

There is a user that every post reads like it was AI generated but I do not want to be the judge.  Maybe he happens to write in a similar manner to the AI responses.  

67% AI generate implies 33% not AI generated.   Is that an AI generated post or a post that leverages AI in the response?  Note I am not stating that a post should ever be 100% AI generated.

I reference different sources for the data I reference in my posts.  Is there a large difference in referencing core logic, neighborhoodscout, Zillow, Rentometer, etc and referencing AI generated response?

If we’re thinking of the same user, I ran a bunch of his posts through the AI detector just now and they mostly scored in the 30-40% AI-generated range. I was surprised by that because they read like they are 100% AI. @Scott Trench What is the acceptable threshold for AI generated text? Greater than 50%? Seems like a slippery slope and if any AI is allowed, then the human element gets degraded IMO. Strange times… 

[Jay Hinrichs]

Quote from @Scott Trench:

Quote from @Nathan Gesner:

Quote from @Scott Trench:

We need to find a way to reward high quality, human generated content, and deprioritize low value posts to discourage workarounds. 

I agree. Something like a $1,000 bonus for every 5,000 posts? 

Two tickets to Cancun for every 20,000 posts?

Partial ownership in BP?

 @Nathan Gesner - while I cannot give you an ownership stake in BiggerPockets (let's talk at 100,000 posts...), I would be very grateful if you choose to attend BPCON, and your 26,550 posts have certainly contributed so much value to this platform and not just the tens of thousands of people who you responded to, but the hundreds of thousands or millions more who have read your comments, that I'd be delighted to give you (and a guest) a completely free ticket to BPCON Cancun, including food, beverage, access to all events, and a room at the 5 star moon palace resort.

@Alexandra Hughes Pailet - Can you please help Nathan get set up to Attend BPCON? 

I also, for the record made the same offer to @Jay Hinrichs, but he can't make it this year.

You guys are the top two forum posters of all time here on BiggerPockets, and we are grateful for you all you do! 

Scott Lori and I really appreciated the offer as we have a conflict we could not make it.. However I hear next year is Vegas and since we have a home there we would only need a ticket to get in can we take a rain check for that one :)

[Katie Miller]

Quote from @Chris Seveney:

@James Carlson Very obvious - paragraphs with headings and then a “in conclusion” statement at the end

 Or they capitalize the word "Real Estate" in every mention!

[Victor S.]

Jackson is one busy GPT bot, i tell ya: https://www.biggerpockets.com/posts/user/jacksone19

i do like how friendly he is with almost every one of his posts starting with a personalized greeting lol

apparently, he's posing as either a private lender or working for one and advertising those services in quite a few of his posts. i'd be on a lookout...