Topic: Using AI to do reviews

A new member expressed concern because one of the reviews they received was largely or totally generated by ChatGPT. Since we want members to read and review each other's work (i.e., a good old-fashioned reciprocal relationship), it defeats the purpose of the site if one person reads and does real reviews while the other simply copies and pastes the other writer's story into an AI to generate a review. The AI-generated ones are pretty obvious.

If you find yourself reviewing something that you think could benefit from a pass through an AI, feel free to suggest that to the person whose work you're reviewing. If you want to show them examples of AI prompts they could use to generate such a review, that's perfectly reasonable, and potentially helpful if the writer hasn't previously used an AI for that purpose. Copying and pasting samples of AI output (based on inputting a sample of your own writing) to show them what it can do is also perfectly reasonable.

But ... if you're going to run someone else's work through an AI and simply paste it into a review as if it were your own, that's not in keeping with the spirit or purpose of the site, and allows the reviewer to collect points without having done the work. Also, there's no guarantee that the AI you just used didn't keep/integrate a copy of that work to give to others as responses to future questions. And voila, you would have just violated the author's copyright.

Google's Gemini claims it doesn't keep copies, but we all know Google will take whatever data it can from anyone it can without adequately informing people when they start doing so. Or it's buried somewhere in forty pages of legalese when they update their terms of service (usually only after they get caught). And Google certainly does keep copies of your inputs, ostensibly only to help Google employees see inputs/outputs they need to improve the AI.

Also, trial members are trying to figure out if the site provides enough added value for them to pay the subscription fee and become a permanent member. If they wanted just the output of an AI, they could run that themselves for free.

Please feel free to add to this, especially if you disagree with me, although we know that never happens. :-)

2 (edited by dagny 2025-08-02 00:54:45)

Re: Using AI to do reviews

Dirk--
I was the reviewer who used Chat GPT for Steven's 11th chapter of his book. The reason I used AI is because I ran into an offensive joke in his text. I knew the moment I read that joke I would not like the rest of the chapter no matter how good it was. I owed him a review and did the only fair thing I could think of: impartial third-party review.
dags smile

Re: Using AI to do reviews

Hi Dagny.

Thanks for clarifying. You're not the only one who has used AI to help with reviews. If it wasn't for the potential copyright issue associated with the AIs keeping and reusing copies of our inputs, I think it would be a great way to augment our reviews (eg, do the inline stuff ourselves, then run it through an AI to see if it has anything useful to add to the closing comments). Our long-term members have the experience to know if the advice is useful before including it in a review.

I believe Sol has an AI capability for members of the other site, although I have yet to try it.

Re: Using AI to do reviews

One thing we can definitely do is put together a template based on AI-style reviews and pin it to the Premium group's forum for people to reference if they're stuck for things to consider/include in a critique. I could have used one of those when I first started doing reviews. Even now, I sometimes struggle to find anything comprehensive to say for some of the more experienced authors here.

I'd volunteer to put a draft template together, but I've been struggling with exhaustion since my bout with COVID. Blood tests suggest my pancreas took a hit, although I'm not diabetic (yet).

5 (edited by njc 2025-08-02 06:45:48)

Re: Using AI to do reviews

What is a reviewer supposed to contribute?

To what extent is the reviewer commenting on the story?

To what extent is the reviewer commenting on the storytelling?

To what extent is the reviewer describing the effect the story had on that reviewer, or the reviewer's personal reactions to the story or to the storytelling?

Re: Using AI to do reviews

Yup. All great questions. Care to take a crack at the answers too? :-)
It would be interesting to feed Gemini one of my scenes and ask it how the scene made Gemini "feel". tongue

Re: Using AI to do reviews

"I teach by the Socratic Method."

8 (edited by vern 2025-08-03 23:47:19)

Re: Using AI to do reviews

If you do a review and claim it as your own whether implied or directly, then use AI to do that review, you are lying through your teeth plain and simple. It is no different than giving credit to any source material used in a school paper, etc. If caught, you would probably get an F as well as a scolding, no excuses. Look up plagiarism. Take care. Vern

Re: Using AI to do reviews

Call me old-fashioned, but I think using AI to do reviews (or even write stories) will be the eventual downfall of writing.

10

Re: Using AI to do reviews

It will certainly change things.

There have been "writers", some apparently well-known formula writers, who have had uncredited employees or subcontrators write chapters, aping their style, to write their novels.  You could substitute AI here.

Re: Using AI to do reviews

And you can probably use AI eventually (if not imminantly) to automate much of the creation and self-publishing of AI-generated books. Imagine how much more crap will be dumped into the Amazon Kindle store.

Re: Using AI to do reviews

And legitimate publishers will no doubt use AI analysis to help them decide whether to publish legitimate works or not. Makes me wonder how many classics would have received a thumbs down. Assuming a publisher does decide to publish someone's book, they can use the same analysis to help specify what changes the publisher wants from the author.

13

Re: Using AI to do reviews

All hail Indie Pub!  Make Samizdat Great Again!

Re: Using AI to do reviews

All this talk about AI makes me wonder if it's worth it to keep writing.

15 (edited by George FLC 2025-08-05 19:20:35)

Re: Using AI to do reviews

A few decades ago, I worked in AI. I considered a career change into doing AI. But I didn't which I'm just as glad. I'm behind the current state of the art but I'm not convinced that creating a computer program that can create is possible. It's one thing to know what an apple and the earth are but it's another to get hit on one's head and come up with gravity and calculus like Newton. A computer can know about space and time but to come up with the space/time continuum like Einstein is another.

AI will be another tool like computers, phones, fire, wheels, etc.

So, keep on writing everyone!

George FLC

Re: Using AI to do reviews

I keep seeing articles in my newsfeed about ways scientists and researchers are using AI, and that it can do in minutes what would take humans months or years to do, assuming we can even do it.

Re: Using AI to do reviews

About AI reviews:

Will AI read one chapter of a book and advise me helpfully about arc, plot or character development? I don’t see how that’s possible, so it’ll be a very limited, narrow review. Can it tell me if my story is “good”?

About AI writing books:

Can AI be creative and unique? Can it describe epiphanies, revelations, sympathy, empathy and emotions? Does AI have talent or creativity? Can it rant?

Frankly, the idea of using AI to write a book sickens me. It removes the unique artist and replaces it with a conglomeration of stored talent, grammatical rules and traditional structure.

I’m with you on this, Vern. AI generated stories may eventually overwhelm human talent. And I’m definitely with you, Dirk. How many ground-breaking, unique classics would have made it by the AI reviews? Ulysses, Gulliver’s Travels, Tropic of Cancer, etc, etc, etc…

However, I can see it making a manuscript easier to read. It’s a cheat, for sure, replacing human talent, but helpful in that regard. I guess it could replace human editors, which is a depressing notion if you’re a pro editor.

We don’t have much choice but to live with this “progress.”

Re: Using AI to do reviews

>>Will AI read one chapter of a book and advise me helpfully about arc, plot or character development?
Based on my experience using Gemini for a variety of detailed conversations, I think it might surprise you. :-)

Re: Using AI to do reviews

Dirk B wrote:

>>Will AI read one chapter of a book and advise me helpfully about arc, plot or character development?
Based on my experience using Gemini for a variety of detailed conversations, I think it might surprise you. :-)

You have surprises and then you have surprises. Take care. Vern

Re: Using AI to do reviews

So, I think we have two separate questions.

1. Can AI reviews be helpful? I think the answer is yes. As I've seen on Booksie, AI is good at spotting grammatical problems and can also provide feedback on plot, character development, setting, etc. It has "read" all of the best-selling work out there so knows the formula of what works and what doesn't.

2. Should reviewers use AI to leave reviews on TNBW? I believe the answer is no. When you leave a review, you are representing that you have read the work and are providing "your" opinion, not the opinion and feedback of someone else or a machine.

I've also thought about whether AI will replace human writers. I believe the answer is yes for technical work and potentially some non-fiction. For fiction, I think it might become its own genre - AI Written. I like to use clothing as an analogy. Much of the clothing we wear is made by machines in modern times. But the really valuable clothing is still hand made. Why? Because there is something human in the creation, the stitching, the fabrication and people who wear it find appealing. It's original and unique in a way machine created clothing is not.

This all leads me to two thoughts.

1. Perhaps we need to add some AI feedback to TNBW like what we have with Booksie. I think authors might find it helpful.
2. Reviewers should [not] be substituting AI for their own feedback. I believe a site where everyone simply pasts AI feedback is a diminished one that one that has no more reason to exist.

Happy to hear all of your thoughts.

Sol

EDIT by Dirk: Added the missing word not to Sol's second numbered sentence.

Re: Using AI to do reviews

SolN wrote:

So, I think we have two separate questions.

1. Can AI reviews be helpful? I think the answer is yes. As I've seen on Booksie, AI is good at spotting grammatical problems and can also provide feedback on plot, character development, setting, etc. It has "read" all of the best-selling work out there so knows the formula of what works and what doesn't.

2. Should reviewers use AI to leave reviews on TNBW? I believe the answer is no. When you leave a review, you are representing that you have read the work and are providing "your" opinion, not the opinion and feedback of someone else or a machine.

I've also thought about whether AI will replace human writers. I believe the answer is yes for technical work and potentially some non-fiction. For fiction, I think it might become its own genre - AI Written. I like to use clothing as an analogy. Much of the clothing we wear is made by machines in modern times. But the really valuable clothing is still hand made. Why? Because there is something human in the creation, the stitching, the fabrication and people who wear it find appealing. It's original and unique in a way machine created clothing is not.

This all leads me to two thoughts.

1. Perhaps we need to add some AI feedback to TNBW like what we have with Booksie. I think authors might find it helpful.
2. Reviewers should be be substituting AI for their own feedback. I believe a site where everyone simply pasts AI feedback is a diminished one that one that has no more reason to exist.

Happy to hear all of your thoughts.

Sol

I see nothing wrong or right about AI checking grammar/punctuation since it is simply based on preestablished "rules" and if you use Word, it pretty much does that automatically as you type, but as far as getting into plot, etc., it may have "read" all the bestselling works but I doubt it knows what will be a best seller and simply mimicking best sellers of the past is only giving the reader a regurgitation of what someone else has produced. Creativity, at least for now, is in the realm of humans, not machines. Any use of AI for reviews on this site should be banned in my humble opinion along with the person who submitted it as their own. My opinion outside the machine looking for a wrench to toss in the gears. Take care. Vern

Re: Using AI to do reviews

Hi Sol.

Having access to an AI directly from the site would be great as long as people can find it easily. In addition to wherever you place the button or menu item to make it generally available, I'd suggest also making it accessible from within the Post/Edit wizard with a label or tooltip suggesting people run their writing through the AI to eliminate the trivial stuff so they don't waste their reviewers' time. As reviewers, I think we should make it a default expectation. If the AI is good and clearly hasn't been used, I'd tell them to run it, fix their mistakes, then post again.

Re: Using AI to do reviews

AI might find a suitable place, but NOTHING replaces the human mind.  We write for people, not machines.  Fake flowers don't compare with the beauty of real ones.  And if we let AI sabotage human efforts, what's left?

Re: Using AI to do reviews

I experimented with ChatGPT and found it did a very good job summarizing a 340,000 word trilogy into 500 words—which I used for a query letter.

Re: Using AI to do reviews

whatta wrote:

I experimented with ChatGPT and found it did a very good job summarizing a 340,000 word trilogy into 500 words—which I used for a query letter.

Did you query the trilogy as an entity or three separate works? Sounds like an interesting concept if the former. Take care. Vern