New rule and new mods

The r/JapanFinance mod team has been thinking for a while about how to deal with posts and comments that rely on LLM-generated content (ChatGPT, etc.). Where the reliance is excessive or the post contains large slabs of LLM-generated text, we have tended to remove the content under Rule 2 (content inconsistent with the purpose of the subreddit). But that was never going to be a sustainable approach, since Rule 2 does not explicitly mention LLM-generated content and users could be forgiven for believing that we allow such content.

To resolve this ambiguity, we have decided to create a new rule specifically dealing with LLM-generated content. The new rule will be Rule 7, and its full text is as follows:

While LLMs (ChatGPT, etc.) can be powerful tools in the right hands, they are not reliable sources of information when it comes to the types of issues typically discussed in this subreddit. Users come to r/JapanFinance to discuss personal finance topics with other humans, not to waste their time replying to LLM-generated content.

We understand that users may still choose to use LLMs as part of their research. Such use is not prohibited by Rule 7, of course. However, Rule 7 prohibits posts and comments that defer to LLM-generated content or cite LLM-generated content.

This prohibition also covers posts and comments that do not explicitly rely on LLM output, if it appears to moderators that the author is implicitly relying on LLM-generated content or that the post/comment itself includes LLM-generated content.

We appreciate that there is a grey area when it comes to detecting reliance on LLM-generated content. But we have reached the conclusion that it will be better for the sub if moderators attempt to navigate their way through the grey area (removing posts/comments that appear to rely on LLM-generated content), instead of abandoning the field and allowing LLM-generated content to flourish.

Rule 7 does not go so far as to prohibit any reference to the existence of LLMs. For example, we will not remove posts or comments that recommend using an LLM for a specific purpose, as long as the recommendation is sufficiently specific and does not sound like an advertisement. Blanket recommendations (e.g., "ChatGPT can answer all your questions") will be removed under Rule 7.

The short version of the rule, which appears in the sidebar, is as follows:

This sub values sources that are reliable and authoritative. Users should not waste other people's time by citing LLMs or posting LLM-generated content.

Comments and suggestions with respect to Rule 7 are welcome. But please be aware that the rule is the result of long deliberations and it is unlikely to be significantly amended at this time.

On a largely unrelated note, I would also like to announce that we have added two users to the moderation team. Many thanks to u/serados and u/ixampl, who have agreed to come on board. Both users have a history of high-quality contributions to the sub, and they will no doubt be familiar to regular users. I am confident that they will carry out their moderation duties diligently and fairly.

by starkimpossibility

4 comments
  1. Stark’s transparency, careful planning, and effective implementation of policies continue to make this one of the most valuable and professionally moderated resources on Reddit.

  2. Hi u/serados and u/ixampl . Hope you enjoy your newfound god-like powers 😉 (And congrats :D)

  3. Comments: Rule 7 is ok but as LLM get better and better and given they are only just starting they will unfortunately become an accurate source of information over time (even for Japan specific knowledge)……thus a lot of the questions on this forum unless technical in nature can/will be easily be answered using those tools going forward and can save posters valuable time ….”LLM prompts” should encouraged to guide the OP to an appropriate solution.

Comments are closed.