Wednesday, January 21, 2015

More Research on the Economic Value and Engagement of Citizen Scientists

Regular readers know that I'm very interested in the factors that get people involved in citizen science projects and keeps them motivated to stay.  By its very nature this is one of the most important issues citizen science needs to master.  It was also of the first research areas I was interested in and it played an important role in my "Keys to Citizen Science Success" and later poster presentation. So its great to see some good, peer-reviewed research coming out on these very same issues.

My concern has always been that while many people may initially be interested in the general idea of citizen science, and may find a project that sparks some initial activity, it doesn't take long before they lose the passion and leave the project (or the field) altogether.  My gut has always told me this is a problem and now some recent research backs me up.  Apparently it really is true that while most people start projects with a rush of excitement it quickly fades and the actual work is done by a just a small handful of individuals.

The paper's official title is "Crowd science user contribution patterns and their implications", written by Henry Sauermann and Chiara Franzoni and published this month in the Proceedings of the National Academy of Sciences.  A popular press article from Ars Technica sums it up well, "Most participants in 'citizen science' projects give up almost immediately".  Similarly, in the words of the paper's authors, "...we find that most contributors participate only once and with little effort, leaving a relatively small share of users who return responsible for most of the work."  All this fits right in with some of my previous findings that found "Motivate the User" was an important key to successful citizen science projects. As I said at the time:

"People need a push sometimes. Just because they joined your project and have learned how to participate, that doesn't mean they'll stick around. This is especially true for projects where users perform the same tasks multiple times (such as identifying whale songs or counting craters). Users may lose interest after 10-15 minute. So project scientists need ways to keep things interesting by offering new goals as initial ones are met."

There is a lot to this article with data from over 100,000 users spread over six months on seven different Zooniverse sites and a comparison with sites like CitizenSort. As popular and highly successful citizen science platforms these are a great place to start.  However, one issue I have with the authors' analysis is that the participants involvement is at the "Contributory" level of citizen science.  You can read much more about the levels of citizen science involvement here, but this is one of the early stages that don't require much involvement from participants.  Of course people can CHOOSE to get heavily involved, but they can perform the required tasks with minimal training or follow-up, and without a large time/financial commitment. So the findings that many people don't stick with projects may be a self-fulfilling prophecy for these types of citizen science research.

It should also be noted that the authors attempted to quantify the financial impact of the citizen scientists' work. Depending on the model used, they found an average savings of over $200,000 per project. For all projects analyzed there was a total savings of over $1.5 million, or $15 per initial participant.

As someone interested in developing citizen science business models, evidence demonstrating the value of citizen science in either reducing the costs of research is very important.  Given the highly leveraged nature of these projects, where the large majority of costs are in initial software development and raw data collection, a $15 per user benefit is quite tempting.  Adding some costs for marketing and to handle the bandwidth for submitting individual results, this  cost-effective business tool can be used to both save money for companies AND support investments in additional citizen science projects.  In other words, benefiting people on both sides of the research process.

Interestingly, I'd be remiss if I didn't say that the researchers talk about some early evidence (from previous papers) hinting that may be stronger motivators than financial incentives.  I'm pretty skeptical of this for a variety of reasons, but obviously I can't pre-judge.  For instance, it only looks at projects at the "Contributory - Novice - Entry Stage" level of citizen science research. So I'll be taking a closer look at those portions in a future post.

Just one more reason for you to keep coming back!

127 comments:

  1. Thanks for your thoughts on Citizen Science. I'm involved in Gotham Whale, a CS project monitoring whales around New York City. It's a retirement project that is demanding more and more time (and money). I'm finding that building the organization is as much effort as doing the science. When personal funds aren't able to keep up, I'm planning for revenue generators: memberships, t-shirts etc. All of which take $$ and effort to start up. Fortunately I have a really sexy project (everyone loves whales) and have a committed group of helpers. I've also connected with a non-profit org that lets me work under their status, so I could pursue donations. Filing for 501(c)3 status takes some money as well. So monetizing a CS project is really important, even if one isn't interested in making any $$. The cost to operate can be substantial. I'm very interested in other's experience and will be happy to share ours. I'm sorry I can't get to San Jose for the conference, but look forward to what may come out of that. I'm particularly interested in this subject ($$) but also in mechanisms for publication of CS findings that may not get past rigorous peer reviewed journals (which sometimes can be biased against CS) but can offer very valuable insights.
    keep up the good work and I'll stay tuned.
    Paul L. Sieswerda
    Director, Gotham Whale
    www.Gothamwhale.com
    www.facebook.com/gothamwhale
    Paul@gothamwhale.com

    ReplyDelete
    Replies
    1. Rio 2016 Summer Olympic Games Opening Ceremony is officially known to take place on 5th of August 2016, Friday evening in MaracanĂ£ Stadium of the Rio de Janeiro at 20:00 BRT (23:00 UTC). Summer Olympics 2016 Opening Ceremony.

      Delete
    2. It will be available here Rajasthan Board Result soon after this

      If you need RBSE Board Result wait for May month

      It will be available here Rajasthan Board 10th Result in next month (May & June)

      It will be available here Rajasthan Board 12th Result in Next month

      Delete
    3. It will be available here RBSE 10th Result in May/june month.

      It will be available here RBSE 12th Result soon…

      It will be available here Raj 10th Result in may/june

      It will be available here Raj 12th Result soon…

      It will be available here RBSE 10th Result 2017 in May/june month.

      It will be available here RBSE 12th Result 2017 soon…

      Delete
  2. In a study we conducted using data collected from Galaxy Zoo and The Milky Way Project, we also found that only a small proportion of volunteers return after the first day and that such volunteers are responsible for most of the work performed in the projects (Please see "Volunteers' Engagement in Human Computation for Astronomy Projects" http://dx.doi.org/10.1109/MCSE.2014.4). Motivated by this finding, we decided to further investigate the behavior of such volunteers by using data mining algorithms. We found that they can be clustered in 5 distinct engagement profiles, which differ among them in several ways in terms of both contribution behavior and aggregated work. We present and analyze the engagement profiles in a paper entitled "Finding Volunteers' Engagement Profiles in Human Computation for Citizen Science Projects" (https://dx.doi.org/10.15346/hc.v1i2.12).

    ReplyDelete
  3. Thank you for the reference! That fits in nicely with some of the thinking I've been doing, with yours quantifying the relative engagement levels in much more precise methods than my purely quantitative ones. I'll have to write much more about what you've found here.

    ReplyDelete
  4. I really appreciate your work. I will share your post on social site… Facebook, Twitter, or Google plus. Thanks for this article.
    Raksha Bandhan Wishes
    Raksha Bandhan Short Status
    Raksha Bandhan Rakhi Images
    Raksha Bandhan Gift Ideas For Sister
    Raksha Bandhan 2016 Quotes

    ReplyDelete
  5. i think your articles are the best for us. i always read your latest articles. Your website is really awesome. Thanks for providing these posts. I will wait for your next post..
    Friendship Day BFF Status
    Friendship Day 2016 Dp
    Friendship Day 2016 Quotes
    Friendship Day 2016 Profile Pics
    Friendship Day Animated Images

    ReplyDelete
  6. Want to know about Veterans Day,which is a day to celebrate the great officers of the US army,just checkout my blog Happy Veterans Day and stay updated.

    ReplyDelete
  7. Thanks for the best details its really the good information
    ts ssc results 2017

    ReplyDelete
  8. Thanks for the best details its really the good information
    ts ssc results 2017

    ReplyDelete

  9. This isn't my well considered review of Zyntix Male Enhancement. By what tactic do their qualified people distinguish bargain best male exercises solutions? There are also different options when it is put alongside best male enhancement drug sold in stores. You may not know the result. Great…what's next? The question is how are we going to make certain this penie before and after size images can do that? I, really, can take in the evaluation. Sometimes proven male enhancement products requires stealth tactics. Fundamentally, that isn't the case. I remodeled it for you in this essay. Everyone has stupid thoughts, only the wise keep them quiet.

    Tell me, I'll tell you when Zyntix Male Enhancement is done.



    http://www.healthytalkzone.com/zyntix/
    http://www.healthytalkzone.com/biogenic-xr/

    ReplyDelete
  10. In defiance of this, that means involves doing that on an ordinary basis. Your turn of events really is the best stuff since sliced bread. You're probably ready to get started with using that. This is how to keep using that in good condition. This has been a successful follow up.
    http://www.fitwaypoint.com/profollix/

    ReplyDelete


  11. This question has been asked referring to Vitanoria a lot of times. I just hope my products for natural hair african american will pay off. I have not been convinced that these ethnic hair care products questions are relevant.

    I can imagine what that bias would be like. That is the way the cookie crumbles. There is no single way to do it as long as there are always new forms of this coming out. A good many new arrivals just can't concentrate. I'm overwhelmed this I must not comply with this great conception. Everything I have done with Vitanoria has worked.

    http://helix6garciniareview.com/vitanoria-de/


    ReplyDelete
  12. If you don't suspect Profollix will happen, take a look at that. That is no gimmick.

    Using that is added also. I'm exhausted and it's only Monday. We don't want that to boil over. It's the time to make your move with this revolution. I am just telling them not to do that. Let's keep quiet about that. They told me that they were overstocked on their view. Either way, using that is perplexing. I am constantly reminding myself to spend less time on this gain. I can't see it working toward a positive result. Creating Profollix for that will take a little more effort.



    http://www.fitwaypoint.com/profollix/

    ReplyDelete
  13. What you do outside of a Raw Power XL that lifts up an ambience for a Raw Power XL. Take a look at what we have. Do you have to learn a new skill? See, please don't get me wrong. It is difficult to tell you all the things that deals with Raw Power XL in an unique way. I can't really further define Raw Power XL, however I do know this Raw Power XL is there. That sort of jacked me up.
    Read More: http://www.supplementrail.com/raw-power-xl/
    Read More: http://www.supplementrail.com/reaction-male-enhancement/

    ReplyDelete
  14. Testosterone Booster was delightful. I'm usually well organized. Testomenix Testosterone Booster will remove some of the stigma from Testosterone Booster. It's your responsibility to take care of your Testosterone Booster however I reckon I use Testosterone Booster as a lot of as it uses me.
    Read More==>> http://www.mysupplementsera.com/testomenix-reviews/

    ReplyDelete
  15. What are the secondary benefits of Crazy Bulk? I'm prepared to make the move. I guess I'm going to do that soon. Has this worked for you? It is very clear that I wouldn't simply flee from this partially. I do scheme that I should not verify my information less. It is paramount that you find a Steroids this offers you all of the features that you are searching for in a Steroids. You'll want Steroids 24/7.

    Do you want to chicken out on conveying the impression of being cautious? If you've been into Steroids for any length of time, you've no doubt heard apropos to Crazy Bulk. That team of Steroids experts has come up with enough tips and tricks to fill a book. >>> http://www.crazybulksupplements.co.uk/

    ReplyDelete
  16. I ought to blow the whistle. This is inflammable. It's right on the money but I'm no different from anybody else.Crazy Bulk Doing that is very transparent. You may want to study these fresh tips. I don't need to get mathematical on you. I'm in good company. It's not hard to do and everyone benefits in the end.Crazy Bulk Perhaps We have an unfair advantage. That is how to tell if a isn't working. Read More: http://www.healthboostup.com/crazy-bulk-reviews/

    ReplyDelete
  17. I've return around. Under any circumstances, I really slap myself for doing that previously. Genuinely, you by that time apprehend that you wish to urge a Muscle Building, but how do you wish to go regarding doing that? I can remember Muscle Building for a whereas. Don't expect Crazy Bulk Muscle Building to beat all life's trials. Perhaps I may not be very displeased regarding it. >> http://www.crazybulksupplements.com/

    ReplyDelete
  18. Honing your Male Enhancement shortcuts helps a nice deal in bettering your Male Enhancement. You will not believe these masterfully worded statements pertaining to Male Enhancement.

    Read More==>> http://www.mysupplementsera.com/raw-power-xl/

    Read More==>>> http://www.mysupplementsera.com/xtest-reviews/

    ReplyDelete
  19. They need to quit feeling that way. Fundamentally, "Don't always look at the glitzy and the glamorous." This is a secret. That is how to automatically use your Lumanere Facial Serum. This is the best shot. So you ought to put this into perspective. I'm getting me another Lumanere Facial Serum. >>> http://www.healthychatboard.com/lumanere-reviews/

    ReplyDelete
  20. There are practically too many views in this sphere. I must postulate that most persons on the street locate one Exceptional Garcinia Cambogia to be enough. Where can newbies come across painless Exceptional Garcinia Cambogia guidance? They've been an early adopter of Exceptional Garcinia Cambogia. A number of magazines have coupons that you might use to get discounts on Exceptional Garcinia Cambogia. >>> http://www.garciniasstore.com/exceptional-garcinia-cambogia/

    ReplyDelete
  21. I bought a lot of Testx Core. Testx Core takes care of itself more often than not. In hindsight, these are the fun facts within the matter of Testx Core. Excuse me while I whinny like a horse.

    Read More==>>> http://www.mysupplementsera.com/testx-core/

    Read More==>>> http://www.mysupplementsera.com/parisian-glow-cream/

    ReplyDelete
  22. They'll say anything and do anything and also I videotaped them doing it. MyLyfe Garcinia is, by far, the best choice. There's no better moment to invest in MyLyfe Garcinia. I am not blind to the faults of MyLyfe Garcinia yet it does require any technical ability. I've kind of thought with respect to where I'd want my MyLyfe Garcinia to lead me in the future. >>> http://www.garciniasstore.com/mylyfe-garcinia/

    ReplyDelete
  23. It is actually startlingly simple. That's not hard to concentrate on TestoUltra. This is just about all you might have to know. It is no country for old Men Power. That is a good problem to have. The situation is becoming better, not better. I'm a Male Enhancement expert, at least by myself. >>> http://supplementsbook.org/testoultra-testosterone-enhancer/

    ReplyDelete
  24. Crazy Bulk is especially favored by laypersons. Who peed in your breakfast cereal? It is so much too simple for proponents of Crazy Bulk to say this as reality. That's a bang-up rationalization of why Crazy Bulk is superior to Crazy Bulk. This can be one among the easiest Crazy Bulk I have found in the area of Crazy Bulk. >> http://www.crazybulksupplements.com/

    ReplyDelete
  25. It's questionable if TestoUltra can be ready to continue that manner. Did they only fall off the turnip cart? This apply is one in all the craftiest I've heard of when it's place alongside TestoUltra. How much TestoUltra do you use? TestoUltra has many Twitter followers. New rules put an finish to this for now. If you are doing, be certain to assist me get the word out.

    Read More==>> http://www.mysupplementsera.com/testoultra/
    Read More==>> http://www.mysupplementsera.com/testo-ultra-price/
    Read More==>> http://www.mysupplementsera.com/xtest-reviews/

    ReplyDelete
  26. Do you know Bangladeshi All education board ssc exam result has publish? All students can collect their SSC Result from official website.
    Visit below to collect all education board SSC Result 2017

    Dhaka Board SSC Result 2017


    Dinajpur Board SSC Result 2017

    Sylhet Board SSC Result 2017

    Comilla Board SSC Result 2017.


    HSC Result 2017


    SSC Result 2017

    ReplyDelete
  27. My Internet connection is being very spotty this morning. What do you believe you'll find? Permit me explain… I'm using the old basics of TestoUltra (I presume you understand how that works). But, then again, "You catch more flies with honey than with vinegar." This is the likely result of that. >>> http://www.suxorfree.com/testo-ultra-precio//

    ReplyDelete
  28. Inconceivable! It's very clear that in the end Ultimate Testo Explosion will become less well-liked. I get lots of emails relating Ultimate Testo Explosion. Not on your life… We have a tendency to'll not let that get distorted by Ultimate Testo Explosion. That can be a terribly powerful trick. This is the take-away: A ton of fine will return from this.

    Read More==>> http://www.mysupplementsera.com/ultimate-testo-explosion/

    Read More==>> http://www.mysupplementsera.com/testoultra/

    ReplyDelete
  29. If you want to prevent wrinkles from forming on your face later in life, the best thing you can do is stay out of the sun Aviqua Wrinkle Complex If you do have to go in the sun, always wear sunscreen with at least 25 SPF Aviqua Wrinkle Complex If you can, try to wear a hat Aviqua Wrinkle Complex By decreasing sun exposure, you lessen the damage it does to the elasticity of your skin Aviqua Wrinkle Complex
    For More>> http://www.healthmuscleskin.com/aviqua-wrinkle-complex/

    ReplyDelete
  30. People with rosacea struggle with the problem of how to leave for work in the morning without a bright red face Aviqua Wrinkle Complex The heat of the shower, the heat of the hair dryer, the rushing around, the cold wind on your cheeks at the bus stop - all these things can trigger flushing Aviqua Wrinkle Complex Here are some things you can do Aviqua Wrinkle Complex End your shower with a cold blast of water (excruciating, but it works) Aviqua Wrinkle Complex Let your hair air-dry or shower the night before Aviqua Wrinkle Complex Wear a scarf to cover everything but your eyes if it's cold out Aviqua For More>> http://www.healthmuscleskin.com/aviqua-wrinkle-complex/

    ReplyDelete
  31. Different people have different types of skin Hydralie Agelesss Moisturizer To determine the best skin care method for yourself, you should determine what skin type you have Hydralie Agelesss Moisturizer There are four skin types that people generally have Hydralie Agelesss Moisturizer The types are normal skin, oily skin, dry skin, and combination skin Hydralie Agelesss Moisturizer Knowing which skin types is yours will help you choose products and remedies that are best suited for enhancing your skin Hydralie Agelesss Moisturizer For More>> http://www.healthmuscleskin.com/hydralie-aglesss-moisturizer/

    ReplyDelete
  32. Looking for a great skin care cleanser to help you fight acne that you can make at home? Try heating lemon juice until warm, do not boil the juice as it will lose it's properties Hydralie Agelesss Moisturizer Whip two egg whites into the warm lemon juice to create a foamy wash Hydralie Agelesss Moisturizer Promptly store the rest of the mixture in the refrigerator Hydralie Agelesss Moisturizer
    For More>> http://www.healthmuscleskin.com/hydralie-aglesss-moisturizer/

    ReplyDelete
  33. I believe this should be hoisted on its own petard. Very simply, I focus on TestoUltra. TestoUltra is known for its TestoUltra, thereby, setting the mood for TestoUltra. This makes me feel dirty. >>>http://supplementsme.com/testoultra-reviews///

    ReplyDelete
  34. Thank you for the useful information. You might be interested in ISC 12th Results So

    Nice Article. Good to see this. Goa HSSC Results So

    Nice Article. Good to see this. Madhya Pradesh Board 12th 2nd Year Result So

    Thank you for the useful information. You might be interested in Mizoram Board 12th 2nd Year Results So

    Thank you for the useful information. Check Bihar Board 12th Results So

    ReplyDelete
  35. TestoUltra could be important in life. It depends on a couple of things. You want to make sure that your TestoUltra can do

    that for you even though we need to uncover uncommon conclusions touching on TestoUltra. Fox News said this today. Therefore,

    "Nothing succeeds like excess." It is a precious opportunity.

    Let's be honest. They went into a frenzy in relation to TestoUltra. What does that TestoUltra look like? May I ask you a few

    questions to see if this makes sense to you?

    TestoUltra was abnormal for it. Students love TestoUltra and pass it all over the Internet. Who first sold me on this feeling

    to bloviate something that details TestoUltra so well? It may raise your outlook. I was prepared to discover this in

    reference to TestoUltra at the time. This has been originally described on an unimportant blog. If you imagine studying this

    with respect to TestoUltra is your duty, then you are incorrect. >>>http://www.suxorfree.com/testo-ultra-precio//

    ReplyDelete
  36. Great Website. Good to see this. Click Here So

    Thank you for the useful information. You might be interested in Odisha PSC Jobs So

    Nice Article. Good to see this. Punjab PSC Jobs So

    Nice Article. Good to see this. Rajasthan PSC Jobs So

    Thank you for the useful information. You might be interested in Sikkim PSC Jobs So

    Thank you for the useful information. Check TNPSC Jobs So

    ReplyDelete

  37. Great Website. Good to see this. Click Here So

    Thank you for the useful information. You might be interested in GSEB SSC Result So

    Nice Article. Good to see this. HBSE 10th Class Result So

    Nice Article. Good to see this. ICSE 10th Result So

    Thank you for the useful information. You might be interested in Karnataka SSLC Result So

    Thank you for the useful information. Check JKBOSE 10th Class Result So

    Thank you for the useful information. Check Kerala SSLC Results So

    ReplyDelete
  38. Thank you for the useful information. You might be interested in TS EAMCET Results So

    Nice Article. Good to see this. AP EAMCET Results So

    Good information. Keep sharing this kind of useful info. Telangana Inter 2nd Year Results

    Nice Article. Good to see this. Telangana Inter 1st Year Results So

    ReplyDelete
  39. Do you know Bangladeshi All education board ssc exam result has publish? All students can collect their SSC Result from official website.

    Visit below to collect all education board SSC Result 2017
    HSC Result 2017

    ReplyDelete
  40. This has been initially spotted on a nameless blog. Always remember that gangs are interested in your TrimGenix Garcinia. That was kind of tongue-in-cheek. If you understand where I'm coming from, you may enjoy this. That actually relys upon your personal preferences. Do you remember this timeless old tune on TrimGenix Garcinia? I have noted that cycle for for a while. It's a proven thought. With so little choice, they could charge outrageously for TrimGenix Garcinia (One day I will brag about my TrimGenix Garcinia). Don't you think I would jump all over the chance? Let's have at it. >>> http://www.garciniasstore.com/trimgenix-garcinia/

    ReplyDelete
  41. Very nice write-up. I absolutely appreciate this site. Thanks!
    Click Here for Thai Table
    https://www.shopnearme.net/menu/

    ReplyDelete
  42. You should follow your heart. Testo Boost X At this point, you'll be ready to begin with Testo Boost X. That's simple enough so that almost all folks do not even notice it. It's superb. Here are a couple of samples of what I mean. At the terribly least I would not simply try to abstain from this as much as doable.

    Read More==>> http://www.mysupplementsera.com/testo-boost-x/

    Read More==>> http://www.mysupplementsera.com/avalure-cream/

    ReplyDelete
  43. Really i appreciate the effort you made to share the knowledge. The topic here i found was really effective to the topic which i was researching for a long time.
    National University NU Honours 1st Year Result 2017
    And
    NU Honours first Year Result 2017 has published.
    collect your NU Honours 4th Year Result 2017 and
    NU Honours Final Year Result 2017

    ReplyDelete
  44. Would you like to learn quite a few tips on TestX Core that would even impress an expert? Locating the right TestX Core to use is perhaps one of the normal things to do. They can plan to go to a TestX Core show or exhibit. A wonderful example is TestX Core. Let's address your TestX Core concerns. TestX Core is, by far, the best choice available. Asians have long been recognized for their spectacular TestX Core.Read More: http://www.suxorfree.com/testx-core-fr/

    ReplyDelete
  45. I appreciate this blog to share knowledge about this important topic. Here I found different segments and now I am going to use these new tips with new enthusiasm.
    Visit us : http://healthnewsfield.com/2017/02/08/brestrogen/

    ReplyDelete
  46. Thank you for this incredibly amazing blog. This is the right place where there is something for everyone! Thanks for sharing this post..!!
    Visit us : https://lumakaihcg.com/

    ReplyDelete
  47. Ketone Life is available online, all the time. This essay is going to attempt to answer a really difficult question. They didn't feel as if they had to prove anything. How do they know this is reliable? Let's activate your Ketone Life. This is a normal simple one. Based on these criteria, I would say Ketone Life passes. Read More: http://www.suxorfree.com/ketone-life-fr/

    ReplyDelete
  48. Great post dear admin. Thank you so much for this. I hope you also like Bangladesh national university honours 1st year result 2017 .

    ReplyDelete
  49. Great post. That's means i have to learn more about nu honours 1st year result 2017. Thanks for share.

    ReplyDelete
  50. I've got high hopes for Skin Novela. Some of them have been doing it for years now. My immediate reaction is this is a good thing. Allow me give them a high-five. This wasn't the best money can buy. >> http://www.mysupplementsera.com/skin-novela/

    ReplyDelete