Comments on: How to identify the elite contributors? http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/ shaping the future together Sat, 11 Oct 2008 13:20:21 +0000 http://wordpress.org/?v=2.3.1 By: Nitrio Mobile Blog » Blog Archive » Looking for a job? http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-15774 Nitrio Mobile Blog » Blog Archive » Looking for a job? Thu, 15 May 2008 16:31:55 +0000 http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-15774 [...] group of people for targeted recruiting campaigns. I wish we would have already a formal Beta Labs reputation system in [...] […] group of people for targeted recruiting campaigns. I wish we would have already a formal Beta Labs reputation system in […]

]]> By: Nokia Beta Labs blog » Looking for a job? http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-15732 Nokia Beta Labs blog » Looking for a job? Thu, 15 May 2008 13:23:15 +0000 http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-15732 [...] group of people for targeted recruiting campaigns. I wish we would have already a formal Beta Labs reputation system in [...] […] group of people for targeted recruiting campaigns. I wish we would have already a formal Beta Labs reputation system in […]

]]> By: Tommi Vilkamo http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-2001 Tommi Vilkamo Mon, 28 Jan 2008 08:20:12 +0000 http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-2001 Geoff, you have a good point. If you send insightful feedback, and hear nothing back, it's very discouraging - and you are likely not to send feedback again. I don't want this to happen. The current situation, however, is that your feedback goes directly to the development teams (product managers and such), and while they read everything, they rarely have time to respond. Of course, we could add a middle-man to read your feedback, reply politely to everybody, and to filter the messages that reach the development team. Would you prefer that? Somehow, I feel that's not the optimal situation either. This requires further thought. Geoff, you have a good point. If you send insightful feedback, and hear nothing back, it’s very discouraging - and you are likely not to send feedback again.

I don’t want this to happen.

The current situation, however, is that your feedback goes directly to the development teams (product managers and such), and while they read everything, they rarely have time to respond.

Of course, we could add a middle-man to read your feedback, reply politely to everybody, and to filter the messages that reach the development team. Would you prefer that?

Somehow, I feel that’s not the optimal situation either.

This requires further thought.

]]> By: Geoff http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1984 Geoff Sun, 27 Jan 2008 14:33:23 +0000 http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1984 Tommi, Can I draw your attention to my post of December 31st? You will see that one of the things that I said was: "It’s a big turn off to have feedback ignored, and I think you need to make sure that inconvenient but valid feedback is valued, acted on and acknowledged. In my case this has not happened and that’s disappointing and discourages further participation." Yet These comments themselves have aslo not been responded to, so it would appear that these too have not been valued, acted on or even acknowledged. Would you care to put this right, and provide a response? Tommi,

Can I draw your attention to my post of December 31st? You will see that one of the things that I said was:
“It’s a big turn off to have feedback ignored, and I think you need to make sure that inconvenient but valid feedback is valued, acted on and acknowledged. In my case this has not happened and that’s disappointing and discourages further participation.”
Yet These comments themselves have aslo not been responded to, so it would appear that these too have not been valued, acted on or even acknowledged.
Would you care to put this right, and provide a response?

]]> By: Geoff http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1540 Geoff Mon, 31 Dec 2007 01:47:38 +0000 http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1540 What about feedback that is inconvenient to developers? For example I fed back re Sports Tracker that the zoom keys should be consistent across Nokia apps, using Nokia Maps as the de facto standard. So far this seems to have been ignored, but from a usability point of view to users of multiple apps, this is v important. Can the developer's assessment be relied on in such circumstances? My experience indicates perhaps not. It's a big turn off to have feedback ignored, and I think you need to make sure that inconvenient but valid feedback is valued, acted on and acknowledged. In my case this has not happened and that's disappointing and discourages further participation. Karma is 2 way! A system that works one way only shows only half the picture. What about feedback that is inconvenient to developers? For example I fed back re Sports Tracker that the zoom keys should be consistent across Nokia apps, using Nokia Maps as the de facto standard.
So far this seems to have been ignored, but from a usability point of view to users of multiple apps, this is v important.
Can the developer’s assessment be relied on in such circumstances? My experience indicates perhaps not.
It’s a big turn off to have feedback ignored, and I think you need to make sure that inconvenient but valid feedback is valued, acted on and acknowledged. In my case this has not happened and that’s disappointing and discourages further participation.
Karma is 2 way! A system that works one way only shows only half the picture.

]]> By: awalinda bestari http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1461 awalinda bestari Tue, 25 Dec 2007 09:11:24 +0000 http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1461 how I can get a ulead photo express again in my cell phone?, because this application is had been deleted before n i'm too like this application. thank's for your replay Linda@indonesia how I can get a ulead photo express again in my cell phone?, because this application is had been deleted before n i’m too like this application. thank’s for your replay

Linda@indonesia

]]> By: KHALIDM http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1445 KHALIDM Mon, 24 Dec 2007 12:34:35 +0000 http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1445 WHAT CAN YOU DAONLOD TO THES WEB WHAT CAN YOU DAONLOD TO THES WEB

]]> By: Angus http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1438 Angus Mon, 24 Dec 2007 05:09:47 +0000 http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1438 After reading the comments left, I think most are focusing on the ratings and not on the benefits to your team. I hope your karma system works and gives your team more time to continue their fantastic work in creating the future. After reading the comments left, I think most are focusing on the ratings and not on the benefits to your team. I hope your karma system works and gives your team more time to continue their fantastic work in creating the future.

]]> By: Reda http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1306 Reda Sun, 16 Dec 2007 23:04:53 +0000 http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1306 Hi Tommi, sorry but I only agree on the “express our gratitude for them” and do not agree with the remaining 3 points. I agree that you need to optimise the way you work as in every workplace (I’m guessing that was the aim of your boss request) but I disagree with this new "hierarchy of people". The reason is that I feel that "promoting" people into this hierarchy instead of promoting ideas is fundamentally wrong in an Internet age; it's the old way. The more layers you add, the less influential is the "mass" to the initial stages where the most important choices are made, which defeats the point of open beta stages. I feel the focus and efforts should be on Internet tools that 1) increase your audience by lowering the entry threshold. * Things like an online emulator to test the application will help you collect feedback from even more people (people that cannot be bothered to install the app, but still have an opinion :-) ). * Anonymous forums (http://en.wikipedia.org/wiki/2ch). Etc… Ideally the bigger your audience, the more chances people's ideas will reflect the majority of people needs. 2) Optimise the flow of communication to promote the best ideas. I agree with the voting system, but it should be done, in a controlled way, by the mass not Nokia and hidden as someone said. I think you need to profile the voter before voting (by gender, age, etc to process the final results so that they match the consumer niche). In general, We should vote the need, Nokia should vote the solution. 3) Optimise the collection of feedback. You started this process with feedback forms. Just my cents. -Reda Hi Tommi,
sorry but I only agree on the “express our gratitude for them” and do not agree with the remaining 3 points.
I agree that you need to optimise the way you work as in every workplace (I’m guessing that was the aim of your boss request) but I disagree with this new “hierarchy of people”. The reason is that I feel that “promoting” people into this hierarchy instead of promoting ideas is fundamentally wrong in an Internet age; it’s the old way. The more layers you add, the less influential is the “mass” to the initial stages where the most important choices are made, which defeats the point of open beta stages. I feel the focus and efforts should be on Internet tools that
1) increase your audience by lowering the entry threshold.
* Things like an online emulator to test the application will help you collect feedback from even more people (people that cannot be bothered to install the app, but still have an opinion :-) ).
* Anonymous forums (http://en.wikipedia.org/wiki/2ch). Etc…
Ideally the bigger your audience, the more chances people’s ideas will reflect the majority of people needs.
2) Optimise the flow of communication to promote the best ideas. I agree with the voting system, but it should be done, in a controlled way, by the mass not Nokia and hidden as someone said. I think you need to profile the voter before voting (by gender, age, etc to process the final results so that they match the consumer niche). In general, We should vote the need, Nokia should vote the solution.
3) Optimise the collection of feedback. You started this process with feedback forms.

Just my cents.
-Reda

]]> By: Rafe http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1296 Rafe Sat, 15 Dec 2007 13:37:59 +0000 http://betalabs.nokia.com/blog/2007/12/14/how-to-identify-the-elite-contributors/#comment-1296 This seems like a sensible idea to me as it would cut down on the signal to noise ratio. Some caution is needed as such a system might mean that some of the best users might not necessarily fit in with the grading system (e.g. a user who only makes one comment every now and then, but each one is golden). That said you could also use this system to identify such golden comments and users (i.e. versus someone who comments a lot, most of which are good and therefore end up with lots of positive karma). In other words its probably worth recognising that some +1 comments are more valuable than others. I also think you might need to be careful about identifying elite users as a continuous group across all beta labs participants. Some people are going to be more interested in some areas that others. While I imagine there would be some overlap between the elite users for products a and b it would not be total. A universal elite system might miss some of the best elite users for a particular product. Perhaps you could include an application (generic area) id when giving karma. That way you break down your elite users into more than one group. Overall though I would have thought something like this can only be a good thing. This seems like a sensible idea to me as it would cut down on the signal to noise ratio. Some caution is needed as such a system might mean that some of the best users might not necessarily fit in with the grading system (e.g. a user who only makes one comment every now and then, but each one is golden). That said you could also use this system to identify such golden comments and users (i.e. versus someone who comments a lot, most of which are good and therefore end up with lots of positive karma). In other words its probably worth recognising that some +1 comments are more valuable than others.

I also think you might need to be careful about identifying elite users as a continuous group across all beta labs participants. Some people are going to be more interested in some areas that others. While I imagine there would be some overlap between the elite users for products a and b it would not be total. A universal elite system might miss some of the best elite users for a particular product. Perhaps you could include an application (generic area) id when giving karma. That way you break down your elite users into more than one group.

Overall though I would have thought something like this can only be a good thing.

]]>