maemo.org - Talk

maemo.org - Talk (https://talk.maemo.org/index.php)
-   Community (https://talk.maemo.org/forumdisplay.php?f=16)
-   -   Sprint task: Refine the karma system (community input requested) (https://talk.maemo.org/showthread.php?t=40329)

GeneralAntilles 2010-01-14 04:28

Re: Sprint task: Refine the karma system (community input requested)
 
Quote:

Originally Posted by qole (Post 469309)
This is why I think t.m.o should become the primary location for "community" topics, and the mailing lists can focus on the development side of things.

Either location you pick loses valuable input from community members, neither is perfect. In my own personal opinion, however, picking Talk as the only point of community discussion loses the input from more people I respect than picking the mailing list.

YoDude 2010-01-14 04:30

Re: Sprint task: Refine the karma system (community input requested)
 
Quote:

Originally Posted by GeneralAntilles (Post 469588)
Strongly disagreed, mailing list posts trend pretty consistently towards a smaller amount of much higher-quality input. Talk trends towards multi-thousand post shipping threads. . . .



An edit is an edit. End of story. How do you determine whether a 3-page article is all your own work or a copy-paste job?

You can't...
Eyeballs equals the community. Post value could be tied to eyeballs but that would end up with your high quality mailing list posts receiving less value than a post in a thousand post forum thread.
BTW, I will have to take your word on the quality of mailing list posts. I haven't followed a mailing list since the Denizens of Doom (DoD #73). :)

Perhaps a separation of application developer activities and community activities should be made. Karma for community + Bija for application development.
The value of a contribution can be determined by the particular group that affects it.

The relationship between Karma to Bija can be determined by Nokia for any benefits it wishes to offer at any time it wishes to offer them. In this way Nokia can have the mix that they want at the time time that they want it.

Each groups ego's will be served, heavy contributors to one groups activities and not the other will reap rewards, and those who are closer to Nirvana by having numbers in both categories will receive distinction among their peers in either group.

Just a thought. :)

GeneralAntilles 2010-01-14 04:37

Re: Sprint task: Refine the karma system (community input requested)
 
Quote:

Originally Posted by YoDude (Post 469638)
You can't...
Eyeballs equals the community. Post value could be tied to eyeballs but that would end up with your high quality mailing list posts receiving less value than a post in a thousand post forum thread.

Is a discussion which has lots of quality input and leads to a useful conclusion but involves only a few people and not a large number of lurkers more important than one which serves only to share information?

Seems to me like there are two different types of posts in question here, and neither is necessarily more or less useful than the other. One of them, perhaps, just provides more immediate advantages for the people reading it.

YoDude 2010-01-14 05:22

Re: Sprint task: Refine the karma system (community input requested)
 
Quote:

Originally Posted by GeneralAntilles (Post 469643)
Is a discussion which has lots of quality input and leads to a useful conclusion but involves only a few people and not a large number of lurkers more important than one which serves only to share information?

Seems to me like there are two different types of posts in question here, and neither is necessarily more or less useful than the other. One of them, perhaps, just provides more immediate advantages for the people reading it.

What is your argument?

And BTW, I think we all would like to have harnessed the enthusiasm that was generated in some of those thousand+ post threads. However, you can't focus it. You just need to provide opportunity.
Karma has done that somewhat but as I and others have said in another thread, we haven't been very good at providing other opportunities. I would love to comment in a thread when I see that someone has an interest in another area that might contribute to the general good of maemo.org. Something like:
"Sure, just click on the tab of the top of the page and you will be taken to Bugzilla, or the software comments page, or a WiKI."
I don't very often because that person may come back to that thread with off topic questions like "How come I need to register again?" or "It took me to a page where there are no images showing up, Is this right?" or (add your own here).
It would be very cool if they could come back to the thread before too many posts have accrued and report "done and done".

That can't happen now and it couldn't happen in 2007 when you first saw me post about it. Until it can happen, these are not opportunities but barriers that should be torn down. Until they are, it's inevitable that some from one group or the other will feel incorrectly that they were either denied or their opportunity to contribute in those other ways was somehow restricted by these barriers.

So my argument (if any :) ) would be. Go with the flow and have two sets of numbers, one for each group. A Yin and Yang if you will. The well rounded members like yourself will have high marks in each.
Yin's will take pride in their contribution to the community and Yang's will take pride in theirs. We will all know that contributions from both are needed and required for a strong community.
Hoo Ra!

GeneralAntilles 2010-01-14 05:49

Re: Sprint task: Refine the karma system (community input requested)
 
Quote:

Originally Posted by YoDude (Post 469669)
What is your argument?

Only that the number of times something is viewed isn't necessarily an effective metric for measuring "usefulness".

benny1967 2010-01-14 10:51

Re: Sprint task: Refine the karma system (community input requested)
 
Quote:

Originally Posted by attila77 (Post 469427)
Quote:

Originally Posted by benny1967 (Post 469372)
A final word:
A rule of thumb for the question of "how many posts on t.m.o. equal one bug report?" could be the amount of time it takes. Not as a direct 1:1 relation like "things you need 1 minute for earn you 1 point, tasks that typically take an hour earn you 60 points". Keep it flatter than that, but use it to determine what's more and what's less within the system.

I agree with most of your post except for this little quibble. Let me cross post my thoughts on the exact same issue from the list for those who are not following there:

I don't take karma as a measure of invested effort, but as measure of a result/usefulness of those efforts. Saying otherwise is, to me, like saying qwerty12 should not get any karma for hacking as it's
just too easy for him to do that :)

*LOL* This remark about hacking being too easy for qwerty made me laugh. You really have a point here. I propose to cut qwerty's karma by half right now for this very reason, no matter if and how the karma sytsem will be changed. :D

But seriously, I'm not sure about the "invested effort" vs. "usefulness" stuff. Coming from the "karma is a measure for community involvement" camp, I am in principle against the idea that only useful things earn you karma.

OTOH, I agree it would be cool to have some measure of "how useful are my efforts to the community". That's why I think that it makes sense to count posts as one thing, but thanked posts as another (with a higher ranking). And it makes sense to qualify blog posts and applications via their rating (or maybe download numbers).

Still, I would be very unhappy if in the end the karma value would only reflect quality instead of quantity. As long as the (estimated) quality criteria we can somehow get hold of are part of the calculation and can be viewed as such in the user's profile, it should make both camps happy.

Maybe - this is just a quick idea while typing - it would work if the "posts vs. thanked posts"-system is applied to other parts of the calculation.
My profile shows
Quote:

ITT thanks: ************** (some value)
ITT posts: ** (some value, a lot less btw)
This could work for blog posts (count all of them, but show "thumbs up" for the posts according to "thanks" on a new line), applications (numer of apps vs. rating for apps) and so on. As it shows two distinct parts of your activity: One thing is what you do (write a blog entry), the other thing how it's received in the community (number of thumbs up).

Once these things are separate, you can check how useful your contributions are - which is part of your karma, but not all of it.

RevdKathy 2010-01-14 12:28

Re: Sprint task: Refine the karma system (community input requested)
 
^Doesn't it already do that? I have an entry for posts, and a different one for 'thanks' - both of which I assume are a factor of the total. The thanks karma is significantly higher than the posts karma.

Equally, I'm pretty sure that a blog post with no thumbs up will get less karma than a blog with a lot of thumbs up. It's hard to be exact as karma appears only to update occasioanlly ((whereas I post almost constantly :p )

So that's basically what we have now, and the aim would be to tinker with the equations (and fade point) to reflect what the community deems most valuable. For practical example, I think karma for t.m.o. posts should fade faster than karma for apps - since apps last longer.

Which brings us back around to what we deem most valuable, and why. And the element that it matters because there are real-terms valuables riding on it. Do we (or Nokia) want to target where those valuables go? (Discounts for devs and t-shirts for active posters?)

See, I already consider myself amply rewarded by what I get back from the community (and you should see the look on people's faces when I say Nokia sent me to Barcelona!) When I showed a colleague the sheep game she fell over at the idea that the community was building something I'd dreamt up. I get far more than I put in already. And in terms of 'real life karma', that means I should be in negative. ;)

Jaffa 2010-01-14 12:58

Re: Sprint task: Refine the karma system (community input requested)
 
Quote:

Originally Posted by Texrat (Post 469239)
Forget ego... I think most of us in this discussion are looking at karma for practical use, aren't we? That gets to the point about sponsorships and other rewards. THAT is the purpose I'm talking about.

However, the point that measuring a person's activity (for no other purpose than just measuring it) increases the productivity against that measure. (For those of you at Nokia World, remember Dan Pink's presentation; if not, look it up on TED/YouTube).

Karma in and of itself has value in motivating people to get more of it (in general). So, in terms of picking a balance to decide who we want to reward we should ensure that it also highlights the areas we want people to contribute in.

dneary 2010-01-14 17:16

Re: Sprint task: Refine the karma system (community input requested)
 
Quote:

Originally Posted by qole (Post 469309)
I just read through the mailing list discussion.

What a pain, two completely separate discussions, both saying similar things.

This is why I think t.m.o should become the primary location for "community" topics, and the mailing lists can focus on the development side of things.

By the way, if you want more karma for your posts, comment on the mailing list discussion, not this one ;)

Hi,

I agree, it is a pain.

It's ironic, though, that you posted to the mailing list (where the discussion started) to ask everyone there to come here (where penguinbait moved the discussion) and to repeat their points here for the benefit of everyone who doesn't read the list.

You would likely lose a lot of input from me if maemo-community were done away with in favour of tmo. I simply don't have the time to spend tracking every discussion in even one forum here.

Cheers,
Dave.

Texrat 2010-01-14 17:22

Re: Sprint task: Refine the karma system (community input requested)
 
I'm not sure the "where do I participate in the dialog" dilemma is easily solved. Oh sure something could be coded to up to automagically cross-pollinate between forum posts and mailing lists but that wouldn't really be a solution, because the point made many times by many people remains valid: different environments suit different conversational needs (and different people). I happen to think tmo is best for this sort of discussion, mail lists for shorter types and IRC for shorter ones still-- but that's just me. I won't suggest to anyone that their preferences are "wrong". Sometimes it also boils down to a person's particular degree of engagement, too.

so... back to topic...?


All times are GMT. The time now is 09:01.

vBulletin® Version 3.8.8