@@ -55,12 +55,20 @@ This question was a catalyst for a lot of discussion on [Discord].
55
55
56
56
If we interpret the answers as a scale of 1-5, where 1 is "not okay at all" and 5 is "I love it", the mean answer was 2.25, the median 2.
57
57
Notably, the mode is tied at 1 and 2. The 95% confidence interval is [ 1.89, 2.61] using a standard error of 0.18 (sd = 1.30, n = 52).
58
- People are generally against using an LLM to generate summaries.
58
+ People are generally against using an LLM to generate summaries. 79.2% of readers would prefer not to use AI.
59
59
60
- While a majority of readers (65%) are at least okay with AI-generated summaries, a significant minority (35%) are not okay at all with this proposal.
60
+ Viewed from another angle: while a majority of readers (65%) are at least okay with AI-generated summaries,
61
+ a significant minority (35%) are not okay at all with this proposal.
61
62
These include very active members of the community and
62
63
contributors who have announced that they would no longer want their content to be included in the newsletter if AI was used.
63
64
65
+ The reasons people gave for not wanting AI-generated summaries were varied.
66
+ Among these were:
67
+ - Solidarity with the large number of creatives who recently lost their jobs due to AI-generated content,
68
+ inside and outside the game development industry.
69
+ - Concerns about the quality of AI-generated summaries.
70
+ - Skepticism about AI-generated summaries saving time if they still need to be edited by hand.
71
+
64
72
Of note is that the verbal feedback we got indicated that a lot of readers did not fully understand what exactly was being proposed.
65
73
People worried that we would start generating a majority of the newsletter or entire sections with AI, which is not something any of us wants.
66
74
Some readers also thought we already started using LLMs.
@@ -69,11 +77,8 @@ The summaries would then be edited and verified by the editors. The extent to wh
69
77
Any confusion in this regard is our fault.
70
78
We will try to be more clear on such questions in the future.
71
79
72
- Although this misunderstanding might have skewed the results, we have reason to believe that the effect is not too large.
73
- Anecdotally, when we properly explained the proposal to readers who were against it,
74
- most did not change their mind and cited more principled reasons for their stance.
75
- Chief among these was solidarity with the large number of creatives who recently lost their jobs due to AI-generated content,
76
- inside and outside the game development industry.
80
+ Although this misunderstanding might have skewed the results, we have reason to believe that the effect is not too large,
81
+ since properly explained the proposal to readers usually did not change their opinion on the matter.
77
82
78
83
## Tone
79
84
0 commit comments