• After 15+ years, we've made a big change: Android Forums is now Early Bird Club. Learn more here.

Root ROM Rating System - Yes or No?

Do you want the RRS to stay?

  • Yes

    Votes: 33 78.6%

  • No

    Votes: 5 11.9%

  • I couldn't care less

    Votes: 4 9.5%
  • Total voters
    42
Unfortunately, I simply do not have the time to review ROMs right now - hell, I barely make it to the site once every 2-3 days, whereas before I was coming 4-5 times a day. C'est la vie when you're doing both a Master's and a second Bachelor's.

I really wish I could, b/c 1) I'm like Yankee - thick skinned, and 2) I tell it like it is. If it sucks, even if it is just on my phone, I say so. Don't like it? Put your rose colored glasses back on and plug in your iPod and go be happy somewhere else in lala land.

As Joe mentioned, most of us folks who have had the DROID for a while know where to look for quality ROMs and such, and also know how to play with a ROM pretty quickly and efficiently to get a feel for it. The biggest problem is when fanboys come along - whether they be Apple fanboys, BB fanboys, etc. - doesn't matter - if you're a fanboy, you're a fanboy. Kratos is quite possibly spot on in thinking that some reviewers have stopped b/c of the fanboyism, and I would like to think that more mods would take care of these issues quickly, bu just like all DROIDs are not 100% alike, neither are we, as reviewers, alike - not all of us will have thick skin like Yankee and myself, and that needs to be taken into account just as much as the fact that, while older users know where to go, New users obviously do not - otherwise we would not have continual threads like http://androidforums.com/droid-all-things-root/200304-help-me-choose-my-first-rom-droid-1-a.html every couple of weeks.

In fact, I believe that that thread and others like it are the single biggest reason to keep the RRS alive and kicking.
 
I'm more or less just bumping this to keep this near the top. The more feedback we can get on this, the better. We know if we're to keep this, improvements will have to be made, and as this is for the community, we need all the input we can get.
 
I like hearing from Revs because they give me finer grain information from a "known" good source. I can't tell from the user poll who does and doesn't know what he/she is doing. So -- my point #1 is that I think there is a continuing role for Revs if enough can be recruited.

Point #2 is that I really like the idea of refining the existing user polls to include more questions. I think there is a vBulletin add-on that might allow this(?):
vB Survey: Add a full-featured survey tool to your forum - vBulletin.org Forum

If there are multiple questions that allow users to rate different aspects of ROMS it would give everyone more information to use in tailoring the results to individual preferences. For example, if I want a balanced ROM I might add up all scores across aspects (questions). If I am more interested in speed and stability, but don't care as much about bells and whistles, I can either ignore the score for that question or give it less weight (e.g. divide it by x -- or could do the inverse and multiply the scores for the aspects I care about by some factor). The idea is that each user has more information to use in interpreting the scores in a way that suits his/her preferences.

This still doesn't get around the problem of telling how much of each total score is from experienced versus non-experienced users -- but if the Revs continue, the two together (Revs and User Polls) would be reasonably strong. Not as in research rigor strong, but "good enough" to be useful.

If this revised poll idea is adopted, I suggest a pilot testing period to work out the bugs before finalizing it into something that will remain stable for a while.

My 2 cents! :)
 
i love seeing a review by somebody by somebody trusted, OMJ/UB/JG/M13...

seeing a familiar face reviewing makes comforting and trustworthy.

we NEED A MASTER LIST. this process is useless if its done per thread. too many reviews get lost.

i am sure i have missed some ROMs.... .02
 
i like having it, but i do feel that it could be better executed. best case scenario, IMO, a group of 3-5 people test multiple ROMs on their phones and report back on the differences between them and which they like best. ROMs vary so much from device to device that it would be nice to have some sort of control within the test. when the rating system is based on independent reviews by people who have not tried other ROMs on their phone, it becomes extremely subjective. i know that is a tall order and will probably never happen, lol. all in all, i prefer the system in place now over not having one at all though.
 
Bramsy said:
i love seeing a review by somebody by somebody trusted, OMJ/UB/JG/M13...

seeing a familiar face reviewing makes comforting and trustworthy.

we NEED A MASTER LIST. this process is useless if its done per thread. too many reviews get lost.

i am sure i have missed some ROMs.... .02
Click to expand...

There is a master list of ROMs and the written reviews all get moved to the bottom of the first post for each release as the reviews are completed (a copy of the review is left in the actual forum as well). Are we on the same page or were you referencing something else?

http://androidforums.com/droid-roms...omplete-rom-rating-index-rri.html#post1235483


Also, I've been reading the posts here and while I think the written reviews are helpful, I think they are ignored more than the public polls. In an effort to not waste anyone's time, I am thinking the public poll should stay, written reviews (as we know them) would not.

People in the know will be posting their thoughts throughout the threads anyway. I just don't want to make "busy work" for anyone especially if it is not widely used.

Also, if just the public polls stay, I think the RRI should be updated with current scores. Once a week maybe?
 
I think this helped more when this was first implemented. There were so many diff ROMs to choose from and new builds were coming out like wildfire. Basically, the ROM Revs did a lot of the legwork for the average user as they could just read a review instead of a large feature and change log that they may or may not understand. And being that there were so many to choose from, it was easy to read the provided reviews and see if this sounds like it might be for you.

Now, things have slowed down tremendously. Some Devs are tied up with college (and I love when they throw out that their g/fs take up so much of their time..lol) others have moved on to new devices, and I dunno what the rest are up to. Matter of fact, this forum as a whole has slowed down a lot.

The poll here says 22 out of 30 (atm) want this to stay. While that's a pretty good percentage, the fact that only 30 people have voted says a lot.
 
You must log in or register to reply here.
Back
Top Bottom