Topic: Suggestion for inline review points

. . that the number of points be proportional to the number of comments left. 

As it is now, it is all or nothing at five comments whether the piece is 50 words or 5000. The proportionality can remain, say, at 5 comments per 2000 words  (typical) but could be 1 comment per 400 words for 1/5 the points. 

I think there is somewhat of an external and unnecessary force to keep a chapter at around 2000 words just because more reviewers will review more of it to get to those five comments by the end. A longer chapter gets much of it at the end ignored, and a very short chapter will not get reviewed at all (what?! five comments for 400 words to get a measly half point?!)

Re: Suggestion for inline review points

I agree, I sometimes think some reviewers choose small chapters.

Re: Suggestion for inline review points

I'm not convinced that is strictly true. But I do find myself sometimes coming up with less than 5 comments on a short chapter. Then I'm faced with either trying to put them into a standard review or finding other things to highlight that aren't necessary to make the 5. That isn't really fair to the author.

What I would like to see is something like a ratio of necessary comments to length of the post. If it is under, say, 500 words, then only 2 comments, but if over 2500, then perhaps 6 or 7 comments to make the points. That way, you could still get a fixed amount of points for a post, but only have to come up with 2 to N comments.

~Tom

4 (edited by vern 2015-11-15 23:49:40)

Re: Suggestion for inline review points

Charles_F_Bell wrote:

. . that the number of points be proportional to the number of comments left. 

As it is now, it is all or nothing at five comments whether the piece is 50 words or 5000. The proportionality can remain, say, at 5 comments per 2000 words  (typical) but could be 1 comment per 400 words for 1/5 the points. 

I think there is somewhat of an external and unnecessary force to keep a chapter at around 2000 words just because more reviewers will review more of it to get to those five comments by the end. A longer chapter gets much of it at the end ignored, and a very short chapter will not get reviewed at all (what?! five comments for 400 words to get a measly half point?!)

From one who typically leaves comments numbered well over the minimum and often into the teens and beyond, I fail to see how basing the points on the number of comments would increase the number of reviewers getting to the end of a story. If the reviewer is simply going for points, then they would go with the longer chapter since they would automatically get more points regardless of the number of comments once reaching the minimum. And any reviewer simply going for points with more or less a drive-by isn't going to spend much time on any portion of the story - whether it be the beginning, middle, or end -  regardless of the length of the story.

A decent reviewer (the only ones that count) looking for more points can review a longer work and leave the same number of comments they would on a shorter piece and receive more points in the process which invalidates the assumption they don't/won't review longer works because of the point structure. I speak from experience; I don't care or look to see how long a story is when deciding to review and I most always leave a great number of comments well over the minimum. I also read the entire story before starting my review and then read again as I'm doing it regardless of story length. Take care. Vern

PS: Edited for clarification of number comments.

Re: Suggestion for inline review points

Another possibility is to count the length of the final comments.  Just 50 words are needed in an out-line review.  Maybe counting 30 words in the final comment as one inline will allow reviewers to meet the minimum with global analysis.

Re: Suggestion for inline review points

vern wrote:
Charles_F_Bell wrote:

. . that the number of points be proportional to the number of comments left. 

As it is now, it is all or nothing at five comments whether the piece is 50 words or 5000. The proportionality can remain, say, at 5 comments per 2000 words  (typical) but could be 1 comment per 400 words for 1/5 the points. 

I think there is somewhat of an external and unnecessary force to keep a chapter at around 2000 words just because more reviewers will review more of it to get to those five comments by the end. A longer chapter gets much of it at the end ignored, and a very short chapter will not get reviewed at all (what?! five comments for 400 words to get a measly half point?!)

From one who typically leaves comments numbered well over the minimum and often into the teens and beyond,

And from the POV of reviewers who do not leave well over the minimum and not often into the teens and beyond?  Ever heard about those?

vern wrote:

I fail to see how basing the points on the number of comments would increase the number of reviewers getting to the end of a story.

It just may increase the overall numbers who would want to participate for points if they could review shorter for fewer or longer for more. As it is, I think there is a balance at 5 comments per 2K, but it can be tedious for some after that, and what incentive is there to go on?  And if the author offers up only 400 words because that is the artistic demand, well, lucky the reviewer is that he does less work for the same amount of points.

vern wrote:

If the reviewer is simply going for points, then they would go with the longer chapter since they would automatically get more points regardless of the number of comments once reaching the minimum

Have you ever noticed longer chapters half or more toward the end suddenly become immaculately written so as to need no comment?  This wouldn't apply to online friends reviewing online friends, or those morally upright and perfectly decent people, but more likely from a stranger to stranger.

Re: Suggestion for inline review points

Charles F Bell wrote:

and what incentive is there to go on?

Oh, I don't know, what about providing a decent review in hopes you might receive one in return or merely to be helpful to the author. As stated earlier, if they only want points there is no incentive to go on period and they will do the very minimum. The shorter work offers less points, the longer work offers more points so they can decide whether they prefer to put their best foot forward or give short shift merely for the points.

Charles F Bell wrote:

And if the author offers up only 400 words because that is the artistic demand, well, lucky the reviewer is that he does less work for the same amount of points.

That is simply not so. How many times do you need to be told that a longer work provides more points; you review 400 words you get less points than if you review 1000 words and you get even more points as you move up the ladder length.


Charles F Bell wrote:

Have you ever noticed longer chapters half or more toward the end suddenly become immaculately written so as to need no comment?

As a matter of fact I have, but that just points to "half" of reviewers who are merely in it for the points, not to give the best review they can. If the reviewer is serious about giving a good review, then they will review to the end; if not, they will probably get the same in return or none at all. You develop relationships by giving your best, not a mere minimum.

Charles F Bell wrote:

Have you ever noticed longer chapters half or more toward the end suddenly become immaculately written so as to need no comment?

Yes, I have, but that merely points to the half which is in it more for the points than rendering a complete helpful review. And that is not the way to create a reviewing relationship and will more than likely be repaid in kind. If the reviewer wants to do a half-ass job, they are going to do it whether it is a long piece or a short piece. They will do the minimum required and the points received will be reflected in the length of the piece reviewed with the longer receiving more points than the shorter. They can simply decide if they want to review more works or longer works to accumulate points - shorter=less points, longer=more points.

Changing the system to accrue points is not going to change their behavior in giving the minimum to get by. And it won't alter the fact that most authors will recognize the minimum effort and take that into account in any reciprocal relationship; they may follow suit or they may stick to their principles and give their best effort regardless. Take care. Vern

Re: Suggestion for inline review points

Basically what Vern said - such reviews will come at a cost of not building solid recip relationships which in my opinion, is a very expensive way of trying to accumulate points. Recip relationships is what differentiate TNBW from other sites like these and it's very hard to get value from TNBW without.

Also, do not forget the new member who is still learning to review and building their confidence to be critical as well. If the 'experienced' writer returned a sub-standard review, the new members will never get the opportunity to improve and become part of the family so to speak. I do not think it's difficult or impossible for those that had been around a bit to differentiate between those that do the minimum and those that are still learning.

And as I said, those doing the minimum do so at the cost of establishing recip relationships. They will soon have to change their ways or go somewhere else.

Just my 2 cents.

Re: Suggestion for inline review points

As far as the number of comments trailing off as you get to the middle of a chapter:  There are several reasons.  One is that the reviewer is simply getting tired.  Another is that the reviewer has played the same tune in many places, and it is of little benefit to the author to keep pounding.  When I cut off for this reason, I say so and offer to come back if the author wants me to continue.

Another reason is that the chapter is really, really good and the reviewer has stopped reading as a reviewer and is reading as a reader.  In rare cases, this happens.  The author should be pleased when it does, although it does mean that nits get missed.

And, finally, there is the reviewer doing a cheap review for points.  I can only suggest that authors bank some points so they don't have to rush to get points to post their chapters.

Re: Suggestion for inline review points

vern wrote:
Charles F Bell wrote:

and what incentive is there to go on?

Oh, I don't know, what about providing a decent review in hopes you might receive one in return or merely to be helpful to the author. As stated earlier, if they only want points there is no incentive to go on period and they will do the very minimum. The shorter work offers less points, the longer work offers more points so they can decide whether they prefer to put their best foot forward or give short shift merely for the points.

So, are you really criticizing the point system? If people wanted to provide decent reviews, per se, then the points system is irrelevant. My suggestion is to provide for both, and I am especially thinking of the author who posts a chapter or story that has very few words (and very few points, therefore) who will never get a "decent review" in a points-gathering system if five comments in an inline or 50 words in a regular review constitute more words, effort, and time than the piece itself. This is similar to allowing a different points system for poetry. In fact, I have in mind a chapter that will contain a single word, and the points for that is 0.00!  Okay, why should a computer algorithm dictate art? And why not allow a reviewer to say "Good idea!" or "Bad idea!" and get 0.01 points?

vern wrote:
Charles F Bell wrote:

And if the author offers up only 400 words because that is the artistic demand, well, lucky the reviewer is that he does less work for the same amount of points.

That is simply not so. How many times do you need to be told that a longer work provides more points; you review 400 words you get less points than if you review 1000 words and you get even more points as you move up the ladder length.

How many times do you need to be told that in reality longer works (3000+) need more than 5 comments? And a very short piece does not need 5 comments. Flash fiction,  I have one story that is three paragraphs, one line each, at 31 words, because you say "That is simply not so" is saying it is not worth even posting in Premium and not getting so much a comment as "The concept behind works" or some such short and pithy remark.  If you say someone should leave a comment regardless of points then you deny the value of the point system.

vern wrote:

Changing the system to accrue points is not going to change their behavior in giving the minimum to get by. And it won't alter the fact that most authors will recognize the minimum effort and take that into account in any reciprocal relationship; they may follow suit or they may stick to their principles and give their best effort regardless. Take care. Vern

No. I see that in arranged reciprocal reviewing, and that is fine, but not as a rule in common, effectively anonymous reviewing. Is TNBW effectively operated for a dozen reviewing pairs or might it be better to accommodate other relationships?

Re: Suggestion for inline review points

janet reid wrote:

Basically what Vern said - such reviews will come at a cost of not building solid recip relationships which in my opinion, is a very expensive way of trying to accumulate points. Recip relationships is what differentiate TNBW from other sites like these and it's very hard to get value from TNBW without.

Also, do not forget the new member who is still learning to review and building their confidence to be critical as well. If the 'experienced' writer returned a sub-standard review, the new members will never get the opportunity to improve and become part of the family so to speak. I do not think it's difficult or impossible for those that had been around a bit to differentiate between those that do the minimum and those that are still learning.

And as I said, those doing the minimum do so at the cost of establishing recip relationships. They will soon have to change their ways or go somewhere else.

Just my 2 cents.

Yes, I understand that. But a "society" which is exclusionary as you suggest is deadly, and I might add not profitable in a business venture unless the price of admission is deliberately set high, for increased revenue and snob appeal.

There is value to bringing in opinion from people who are not online friends, for those friendly reviews can end up as if having your mother read your stuff. There is a negative flipside to established recip. reviews in perhaps not getting frank, blunt honest reviews, and, let me add, those who are so used to friendly, smooth-over-the-bluntness reviews react irrationally to blunt and to-the-point comments that are not intended to be "mean."  It's like the kids who are so used to getting their participation awards for just showing up.

Be that as it may, I brought up the suggestion for everyone's benefit even if it may apply differently from person to person.

Re: Suggestion for inline review points

njc wrote:

As far as the number of comments trailing off as you get to the middle of a chapter:  There are several reasons.  One is that the reviewer is simply getting tired.  Another is that the reviewer has played the same tune in many places, and it is of little benefit to the author to keep pounding.  When I cut off for this reason, I say so and offer to come back if the author wants me to continue.

Another reason is that the chapter is really, really good and the reviewer has stopped reading as a reviewer and is reading as a reader.  In rare cases, this happens.  The author should be pleased when it does, although it does mean that nits get missed.

And, finally, there is the reviewer doing a cheap review for points.  I can only suggest that authors bank some points so they don't have to rush to get points to post their chapters.

All this is true, of course, but I am addressing a different side to the issue of the "reviewer getting tired."  It has something to do with the idea that inline reviews are mostly there for proofreading purposes.  If the reviewer has already reached 5 proofreads, it is true he should say: okay I'm tired, there's probably more but . . . " This does not happen except in some severe cases of poorly punctuated pieces.

Fundamentally, if TNBW is to be driven by a point system, then have it be driven by the point system, and not "friendly" reviewing which does not need a point system. What I am suggesting is a tweak to that point system that to my mind is a more fair representation of what is written to what is reviewed.

13

Re: Suggestion for inline review points

I agree that a tweak would be good, but it's nice when the point system is there to remind us of our obligations, not to have us scurrying desperately for points.  It's nice when your have communities of people who enjoy the task of reviewing each  others' work--and care enough about the other to do it conscientiously.

Re: Suggestion for inline review points

Personally, I think we could do away with regular reviews since we have to leave a closing comment on inline reviews anyway. Then, we could eliminate the required 5 comments so long as you have a closing comment. I've had a few chapters I've started an inline on and couldn't find enough to nit, but that's okay. That's when you can make positive comments about something that really works well. Inline comments don't have to be negative!!!!

15 (edited by vern 2015-11-16 16:55:09)

Re: Suggestion for inline review points

Charles F Bell wrote:

So, are you really criticizing the point system? If people wanted to provide decent reviews, per se, then the points system is irrelevant.

I'm not criticizing it at all; I recognize that no system is perfect, yours included. We could all probably come up with some new idea for a points system (many suggestions have been made over the years on this and the old site) but to accommodate all the variations would be costly and cumbersome to say the least and still someone would come up with another novel idea.

Your assumption that the point system would be irrelevant if people wanted to provide decent reviews doesn't hold up. Since folks must accrue points in order to post, that requires people to review and thus the incentive to give a good review to attract them in kind. Otherwise, with no points required, most authors would simply publish their work with little or no reviewing for others.  No, a strict reciprocal relationship is not required in this situation to gain reviews or points, but it certainly helps the cause. I personally - and I've stated this many times over the years - do not practice a strict reciprocal relationship. I have received reviews for an entire novel with little or no reciprocation and have reviewed several entire novels with little or no reciprocation. That being said, it is advantageous, especially for new authors, to build those reciprocal relationships.

Charles F Bell wrote:

I am especially thinking of the author who posts a chapter or story that has very few words (and very few points, therefore) who will never get a "decent review" in a points-gathering system if five comments in an inline or 50 words in a regular review constitute more words, effort, and time than the piece itself. This is similar to allowing a different points system for poetry. In fact, I have in mind a chapter that will contain a single word, and the points for that is 0.00!  Okay, why should a computer algorithm dictate art? And why not allow a reviewer to say "Good idea!" or "Bad idea!" and get 0.01 points?

A short story with virtually no point value can still draw reviews under this system if it is enticing. I published a three word short story with zero points - http://www.thenextbigwriter.com/posting … story-9764 - on the old site and it received "many" well thought out reviews. Yes, it would be impractical for an in-line review, but then that's what the regular review is for. Anyone who is motivated can come up with fifty words to respond to even your proposed one word story/chapter/page/whatever. BTW, the one word on a page was used in A Million Little Pieces and became a bestseller after being reviewed on Oprah - not her best moment.

The points are not always the deciding factor; it has more to do with what is written and how it is presented. If you simply want a "Good idea" or "Bad idea" you can ask for it in the forums and probably get quite a few responses. It's been done many times by different people.

Charles F Bell wrote:

How many times do you need to be told that in reality longer works (3000+) need more than 5 comments? And a very short piece does not need 5 comments.

See last comment. If a piece is that short, you use a little common sense and the regular review; surely anyone motivated can come up with fifty words as previously stated. If you simply want a yes or no, then tell your reviewers to fill in with gibberish to reach the minimum - a quick copy and paste should do without having to change the whole system.

Charles F Bell wrote:

No. I see that in arranged reciprocal reviewing, and that is fine, but not as a rule in common, effectively anonymous reviewing. Is TNBW effectively operated for a dozen reviewing pairs or might it be better to accommodate other relationships

Everyone is a newbie when they start. The vast majority of us managed to receive reviews from the beginning because of the system. New members are a good way to build further relationships if they are desired/needed. The bonus points received for the first three reviews also encourages reviewing newer members since they are the most likely not to have three or more reviews in the short term, or long. You also have members who review without ever publishing. A request in the forums might also point them to an author's work and if successful and you are short on reviewing time, you don't have to reciprocate since they have nothing to review. Additionally, some reviewers post in the forums looking for works to review; you simply have to ask.

So, obviously you don't need a network of reciprocation to be successful on this site, but it makes it a whole lot easier if you go to the trouble of building one. For long timers (myself included), most have accumulated more points than they'll probably use and yet continue to review because it is a valuable tool in it's own right and they enjoy it, getting to read a lot of original stories and possibly having a hand in their success. That's not a bad deal at all.  Take care. Vern

PS: Edited to add link to three word short story.

16 (edited by Charles_F_Bell 2015-11-16 22:58:58)

Re: Suggestion for inline review points

Janet Taylor-Perry wrote:

Personally, I think we could do away with regular reviews since we have to leave a closing comment on inline reviews anyway. Then, we could eliminate the required 5 comments so long as you have a closing comment. I've had a few chapters I've started an inline on and couldn't find enough to nit, but that's okay. That's when you can make positive comments about something that really works well. Inline comments don't have to be negative!!!!

There is a disjunction between the regular review and inline that cannot be fixed, but (1) I believe the inline is the carrot to Premium from Basic and (2) the regular review is nice to turn to when an overall impression, good and bad, rather than nits is the purpose.  50 words versus 5 comments and a closing for the same points does not seem equitable to me.  Your solution has merit but does not solve the problem of the longer chapter being rather skimmed over toward the end and the nits (or even positive comments) not found, and the author is left to wonder if there are no problems or the reviewer is lazy or point-greedy or just tired.  The longer chapter takes and gives more points but the reviewer can do as little work as shorter chapters require to get more points.

Re: Suggestion for inline review points

vern wrote:

blah, blah, blah.

I was suggesting an improvement to the point system for those who generally rely on that rather than virtual friends. You can say Yes; or No; or Can't be done; or I don't care. You answer with the last one.

18 (edited by vern 2015-11-17 03:06:58)

Re: Suggestion for inline review points

Charles_F_Bell wrote:
vern wrote:

blah, blah, blah.

I was suggesting an improvement to the point system for those who generally rely on that rather than virtual friends. You can say Yes; or No; or Can't be done; or I don't care. You answer with the last one.

And I was pointing out that the point system already does everything you claim isn't there if you use it properly. However, if you wish to attribute such a quote to Vern, then you should accept that:

Charles F Bell wrote:

Whine, whine, whine ... Nobody listens to poor ole me...

merely adds to your glorious reputation for nonsense. Exactly who do you think relies on "virtual friends"? If you say nearly everyone who receives a review, then you are probably correct as most accept those who care to spend the time and effort to review as virtual friends. Are you so paranoid you think every review someone gets is just a pat on the back from a friend? But hey, if you wish me to take one of your suggested responses, I'll take "I don't care" if your suggestion is implemented or not, but I have serious doubts it will be because of the reasons I've presented here which you simply ignore as blah, blah, blah. I bid you farewell for now. Good luck with any future endeavors. Take care. Vern

Edited to clarify your attitude with your words.

Re: Suggestion for inline review points

vern wrote:

even more irrelevant invective and personal attack

Without proportionality of inline comments to the number of words, even if the longer chapter takes and gives more points,  the reviewer can do as little work as on shorter chapters to get more points. 5 is 5 regardless whether the chapter is 1000 words or 4000 words.

Re: Suggestion for inline review points

Charles_F_Bell wrote:
vern wrote:

even more irrelevant invective and personal attack

Without proportionality of inline comments to the number of words, even if the longer chapter takes and gives more points,  the reviewer can do as little work as on shorter chapters to get more points. 5 is 5 regardless whether the chapter is 1000 words or 4000 words.

Well, thank you Charles, for another direct quote from your imagination. As before, you close your mind to what is said so what you hear/read and reproduce is blah, blah, blah and other such nonsense such as your current quote. Of course what I hear in your response is whine, whine, whine, so I quote that in return as tit for tat or quid pro quo as you might prefer.

I've said more than once - must've been talking to your bad ear - that if a reviewer is going to give a less than thorough review merely for the points, then there is nothing you can do about it and there is no system they can't take advantage of if that is the way they operate. You get 5 or 10 or a gazillion comments, what good are they if the reviewer is merely after the points and not giving any helpful input? They're called drive-bys for good reason. My suggestion is to try to find better reviewers for your work and ignore the others. Take care. Vern

Re: Suggestion for inline review points

vern wrote:
Charles_F_Bell wrote:
vern wrote:

even more irrelevant invective and personal attack

Without proportionality of inline comments to the number of words, even if the longer chapter takes and gives more points,  the reviewer can do as little work as on shorter chapters to get more points. 5 is 5 regardless whether the chapter is 1000 words or 4000 words.


I've said more than once - that if a reviewer is going to give a less than thorough review merely for the points, then there is nothing you can do about it and there is no system they can't take advantage of if that is the way they operate.


Why do you insist on criticism of the points system?  As I said before, you can always hate the point system and shut up - "don't care", but you have not taken my suggestion and insist on this bashing of the point system. Should I complain  to Sol?. This is annoying.

On the other hand, I can see an advantage to increasing incentive for appreciating the point system in that even more points are awarded for more input. If you'd like to step down out of the point system you may, of course, if you think it adds nothing to the reviewing process, the system failing you and all, and you wanting to complain, complain, complain about a system people "take advantage of" in your words.

22

Re: Suggestion for inline review points

On a purely practical level, a discussion which converges on a few possible solutions is more likely to convince Sol & Co to change things that a discussion in which analysis of proposed solutions leads to criticism of each other's motives, approaches, attitudes and alma maters.

(Ducks.)

Re: Suggestion for inline review points

njc wrote:

On a purely practical level, a discussion which converges on a few possible solutions is more likely to convince Sol & Co to change things that a discussion in which analysis of proposed solutions leads to criticism of each other's motives, approaches, attitudes and alma maters.

(Ducks.)

Sure, on a practical level, anything I have to say will have no effect on Sol & Co. I am, however, interested in others' motives and approaches and attitudes. That is the grist to chew on for fiction, or rather the sort of absurdist fiction I imagine. Perhaps not as the real absurdity of the Keystone Cops in Syria, so perhaps  good will come of it. I miss Empress Wu since she returned to her palace.

Re: Suggestion for inline review points

Charles F Bell wrote:

Why do you insist on criticism of the points system?

Do you even understand plain English? I'm the one defending the point system as it stands, not trying to make a fix that won't accomplish anything more than the present one. Exactly, how is telling you repeatedly because it doesn't seem to sink in that the point system works as it is and that all the reviewers you're complaining about dropping off before the end of a story is the fault of the reviewer, not the point system, amount to criticizing the point system? It is your so-called fix that I've pointed out over and over is not a fix at all and I've listed the reasons over and over and you are determined to ignore them and try to deflect a different opinion than yours by accusing me of criticizing the current point system. You don't offer counterpoints to mine to defend your position, you merely try to change what I say to meet some imaginary thought process you're going through.

If you want me to "shut up" then quit trying to put words in my mouth either because you don't understand or you're too lazy to read them. You might note I offered to withdraw but you seem intent on continuing, so make up your mind and then you might consider taking your own advice. Take care. Vern

Re: Suggestion for inline review points

vern wrote:
Charles F Bell wrote:

Why do you insist on criticism of the points system?

Do you even understand plain English? I'm the one defending the point system as it stands,

No. You said it sucks, and that it is and will always be taken advantage of.