Methodological Challenges of Research on Crowdsourcing

• Autorzy: Regina Lenart-Gansiniec
• Języki publikacji: EN

Abstrakty

EN

Crowdsourcing is a relatively new concept and, despite the interest of researchers, still little is known about it. At the same time, one observes difficulties of a cognitive and practical nature. This has become a premise for a reflection on the methodology of research on this subject. The subject of the article is the identification of the existing procedures of studying crowdsourcing, with particular inclusion of the methodological challenges that researchers of this concept may face. The article was written based on a systematic literature review. Its results enabled the formulation of some methodological guidelines for further research. Research should be conducted taking into account three levels of crowdsourcing: organization, technology, and participant. In addition, a quantitative and qualitative approach will enable the expansion of knowledge about crowdsourcing. (original abstract)

Crowdsourcing jest pojęciem stosunkowo nowym i pomimo zainteresowania badaczy nadal niewiele o nim wiadomo. Obserwuje się jednocześnie trudności natury poznawczej i praktycznej. Stało się to przesłanką do podjęcia refleksji na temat metodologii badań nad tym pojęciem. Przedmiotem artykułu jest identyfikacja dotychczasowych procedur badania crowdsourcingu, ze szczególnym uwzględnieniem wyzwań metodologicznych, jakie mogą pojawić się przed badaczami tego pojęcia. Artykuł powstał w oparciu o systematyczny przegląd literatury. Jego wyniki pozwoliły sformułować pewne wskazówki metodologiczne dla dalszych badań. Badania powinny być prowadzone z uwzględnieniem trzech poziomów crowdsourcingu: organizacja, technologia, and uczestnictwo. Dodatkowo podejście ilościowo-jakościowe pozwoli na poszerzenie wiedzy o crowdsourcingu. (abstrakt oryginalny)

Słowa kluczowe

EN

Crowdsourcing; Research methodology; Research methods; Systematic literature review

PL

Crowdsourcing; Metodologia badań; Metody badawcze; Systematyczny przegląd literatury

• Czasopismo: Journal of Entrepreneurship, Management and Innovation (JEMI)
• Rocznik: 2018
• Tom: 14
• Numer: nr 4 Exploring Management Through Qualitative Research
• Strony: 107--125

Twórcy

autor

Regina Lenart-Gansiniec

• Jagiellonian University

Bibliografia

• Afuah, A., & Tucci, C. L. (2013). Value capture and crowdsourcing. Academy of Management Review, 38(3), 457- 460.
• Aitamurto, T., Leiponen, A., & Tee, R. (2011). The promise of idea crowdsourcing: Benefits, contexts, limitations. (White paper June 2011). Retrieved from https://www.researchgate.net/profile/Tanja_Aitamurto/publication/257926136_The_Promise_of_Idea_Crowdsourcing- Benefits_Contexts_Limitations/links/5698979208ae34f3cf1f5c58.pdf
• Archak, N., & Sundararajan, A. (2009). Optimal design of crowdsourcing contests. Proceedings of the Thirtieth International Conference on Information Systems, Phoenix. Retrieved from https://pdfs.semanticscholar.org/7d3f/aa010f20beccee99a043ebc60595e8a48bc9.pdf
• Blohm, I., Leimeister, J., & Krcmar, M. H. (2013). Crowdsourcing: How to benefit from (too) many great ideas. MIS Quarterly Executive, 12(4), 199-211.
• Brabham, D. C. (2008). Crowdsourcing as a model for problem solving: An introduction and cases, convergence. The International Journal of Research into New Media Technologies, 14(1), 75-90.
• Burger-Helmchen, T., & Pénin, J. (2010). The limits of crowdsourcing inventive activities: What do transaction cost theory and the evolutionary theories of the firm teach us? Workshop on Open Source Innovation. France: Strasbourg. Retrieved from http://www.academia.edu/download/5874711/tbh_jp_crowdsouring_2010_eng.pdf
• Chanal, V., & Caron-Fasan, M. L. (2008). How to invent a new business model based on crowdsourcing: The Crowdspirit ® case. Conférence de l'Association Internationale de Management Stratégique, May 2008, Sophia-Antipolis. Retrieved from https://hal.archives-ouvertes.fr/halshs- 00486794/
• Charreire-Petit, S., & Huault, I. (2008). From practice-based knowledge to the practice of research: Revisiting constructivist research works on Knowledge. Management Learning, 39(1), 73-91.
• Colombo, G., Buganza, T., Klanner, I. M., & Roiser, S. (2013). Crowdsourcing intermediaries and problem typologies: An explorative study. International Journal of Innovation Management, 17(2), 1-24.
• Cullina, E., Conboy, K., & Morgan, L. (2015). Measuring the crowd - A preliminary taxonomy of crowdsourcing metrics. Proceedings of the 11th International Symposium on Open Collaboration, OpenSym, ACM. Retrieved from http://www.opensym.org/os2015/proceedings-files/p200-cullina.pdf
• Czakon, W. (2006). Łabędzie Poppera - case studies w badaniach nauk o zarządzaniu. Przegląd Organizacji, 9, 9-13.
• Czakon, W. (2011). Podstawy Metodologii Badań w Naukach o Zarządzaniu. Warszawa: Wolters Kluwer.
• DiPalantino, D., & Vojnovic, M. (2009). Crowdsourcing and all-pay auctions. Proceedings of the 10th ACM International Conference on Electronic Commerce. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.483.9230&rep=rep1&type=pdf
• Dul, J., & Hak, T. (2008). Case Study Research Methodology in Business Research. Oxford: Butterworth-Heinemann.
• Eisenhardt, K. M., & Graebner, M. E. (2007). Theory building from case studies: Opportunities and challenge. Academy of Management Journal, 50(1), 25-32.
• Flyvbjerg, B. (2004). Five misunderstandings about case-study research, In C. Seale, G. Gobo, J. F. Gubrium, & D. Silverman (Eds.), Qualitative Research Practice. CA: Sage Thousand Oaks.
• Franke, N., Lettl, C., Roiser, S., & Tuertscher, P. (2014). Does God play dice? Randomness vs. deterministic explanations of idea originality in crowdsourcing. Proceedings of the 35th DRUID Celebration Conference. Retrieved from https://journals.aom.org/doi/abs/10.5465/ambpp.2014.235
• Frey, K., Lüthje, C., & Haag, S. (2011). Whom should firms attract to open innovation platforms? The role of knowledge diversity and motivation. Long Range Planning, 44(5), 397-420.
• Gloor, P. A., & Cooper, M. S. (2007). The new principles of a swarm business. MIT Sloan Management Review, 48(3), 81-84.
• Halder, B. (2014). Evolution of crowdsourcing: Potential data protection, privacy and security concerns under the new Media Age. Revista Democracia Digital e Governo Eletronico, 1(10), 377-393.
• Heer, J., & Bostock, M. (2010). Crowdsourcing graphical perception: Using mechanical turk to assess visualization design. Proceedings of ACM Conference on Human Factors in Computing Systems. Retrieved from http://www.cs.kent.edu/~javed/class-P2P12F/papers- 2012/PAPER2012-2010-MTurk-CHI.pdf
• Hetmank, L. (2013). Components and functions of crowdsourcing systems - A systematic literature review. Proceeding of the 11th International Conference on Wirtschaftsinformatik. Retrieved from https://pdfs.semanticscholar.org/3ba7/609d5d6e2794f648228515f4739e9d1a3622.pdf
• Hong, Y., & Pavlou, P. A. (2014). Product fit uncertainty in online markets: Nature, effects, and antecedents. Information Systems Research, 25(2), 328-344.
• Horton, J., & Chilton, L. (2010). The labor economics of paid crowdsourcing. Proceedings of the 11th ACM conference on Electronic commerce (pp. 209-218). Retrieved from https://arxiv.org/pdf/1001.0627
• Horton, J.J. (2011). The condition of the Turking class: Are online employers fair and honest?. Economics Letters, 111(1), 10-12.
• Howe, J. (2006).The rise of crowdsourcing. Wired Magazine, 14(6), 1-4
• Howe, J. (2008). Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business. New York: Three Rivers Press.
• Huang, J., White, R. W., & Dumais, S. (2011). No clicks, no problem: Using cursor movements to understand and improve search. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1225- 1234). Retrieved from https://dl.acm.org/citation.cfm?id=1979125
• Hutter, K., Hautz, J., Füller, J., Mueller, J., & Matzler, K. (2011). Communication: The tension between competition and collaboration in community-based design contests. Creativity and Innovation Management, 20(1), 3-21.
• Jain, R. (2010). Investigation of governance mechanisms for crowdsourcing initiatives. AMCIS 2010 Proceedings, Paper 557. Retrieved from http://www.virtual- communities.net/mediawiki/images/f/fd/Jain.pdf
• Kazai, G., Kamps, J., & Milic-Frayling, N. (2011). Worker types and personality traits in crowdsourcing relevance labels.Proceedings of the 20th ACM International Conference on Information and Knowledge Management (pp. 1941-1944). Retrieved from https://dl.acm.org/citation.cfm?id=2063860
• Kleemann, F., Voß, G. G., & Rieder, K. (2008). Un(der)paid innovators: The commercial utilization of consumer work through crowdsourcing. Science, Technology & Innovation Studies, 4(1), 5-26.
• Lai, H.-M., & Chen, T. T. (2014). Knowledge sharing in interest online communities: A comparison of posters and lurkers. Computers in Human Behavior, 35, 295-306.
• Leicht, N., Durward, D., Blohm, I., & Leimeister, J. M. (2015). Crowdsourcing in software development: A state-of-the-art analysis. Proceedings of 8th Bled eConference. Retrieved from https://domino.fov.uni-mb.si/proceedings.nsf/Proceedings/B31112FAB95D7A1FC1257E5B004BDC42/ $File/2_Leicht.pdf
• Leimeister, J. M., & Zogaj, S. (2013). Neue Arbeitsorganization durch Crowdsourcing. Eine Literaturstudie. Düsseldorf: Hans-Böckler-Stiftung.
• Leimeister, J. M., Huber M., Bretschneider U., & Krcmar H. (2009). Leveraging crowdsourcing: Activation-supporting components for IT-based ideas competition. Journal of Management Information Systems, 26(1), 197-224.
• Mason, W., & Suri, S. (2012). Conducting behavioral research on Amazon's mechanical turk. Behavior Research Methods, 44(1), 1-23.
• Morris, R. R., Dontcheva, M., & Gerber, E. M. (2012), Priming for better performance in microtask crowdsourcing environments. Internet Computing, 16(5), 13-19.
• Mortara, L., Ford, S. J., & Jaeger, M. (2013). Idea competitions under scrutiny: Acquisition, intelligence or public relations mechanism? Technological Forecasting and Social Change, 80(8), 1563-1578.
• Munro, R. (2012). Crowdsourcing and the crisis-affected community: Lessons learned and looking forward from mission. Journal of Information Retrieval, 16(2), 210-266.
• Pizło, W. (2009). Studium przypadku jako metoda badawcza w naukach ekonomicznych. Roczniki Naukowe Stowarzyszenia Ekonomistów Rolnictwa i Agrobiznesu, 11(5), 246- 251.
• Quinn, A. J., & Bederson, B. B. (2011). Human computation: A survey and taxonomy of a growing field. Proceeding CHI '11 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1403-1412). Retrieved from http://crowdsourcing-class.org/readings/downloads/intro/QuinnAndBederson.pdf
• Rotman, D., Preece, J., Hammock, J., Procita, K., Hansen, D., Parr, C., & Jacobs, D. (2012). Dynamic changes in motivation in collaborative citizen-science projects. Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, 217. Retrieved from http://www.cs.umd.edu/hcil/trs/2011-28/2011-28.pdf
• Ryu, H., Lease, M. (2011). Crowdworker filtering with support vector machine.Proceedings of the American Society for Information Science and Technology, 48(1), 1-4
• Sarker, S., Xiao, X., & Beaulieu, T. (2013). Qualitative studies in information systems: A critical review and some guiding principles. MIS Quarterly, 37(4), 3-18.
• Satzger, B., Psaier, H., Schall, D., & Dustdar, S. (2013). Auction-based crowdsourcing supporting skill management. Information Systems, 38(4), 547-560.
• Schall, D. (2012). Service-Oriented Crowdsourcing - Architecture, Protocols and Algorithms. Springer Briefs in Computer Science. New York: Springer.
• Schenk, E., & Guittard, C. (2009). Crowdsourcing: What can be outsourced to the crowd, and why? Journal of Innovation Economics, 1(7), 93-107.
• Schlagwein, D., & Bjorn-Andersen, N. (2014). Organizational learning with crowdsourcing: The revelatory case of LEGO. Journal of the Association for Information Systems, 15(11), 754-778.
• Shao, B., Shi, L., Xu, B., & Liu, L. (2012). Factors affecting participation of solvers in crowdsourcing: An empirical study from China. Electronic Markets, 22(2), 73-82.
• Sims, J., & Crossland, C. (2010). Partners or Pariahs? Firm engagement with open innovation communities. Academy of Management Annual Meeting (AOMM'10). Canada: Montreal.
• Skopik, F., Schall, D., & Dustdar, S. (2010). Modeling and mining of dynamic trust in complex service-oriented systems. Information Systems, 35(7), 735-757.
• Sloane, P. (2011). A Guide to Open Innovation and Crowdsourcing: Advice from Leading Experts, UK: Kogan Page Publishers.
• Stake, R. (1995). The Art of Case Study Research. CA: Sage, Thousand Oaks.
• Steiger, E., Albuquerque, J. P., & Zipf, A. (2015). Twitter as a location-based social network - An advanced systematic literature review on spatiotemporal analyses of Twitter data. Transactions in GIS, 19(6), 809- 834.
• Stol, K., & Fitzgerald, B. (2014). Two's company, three's a crowd: A case study of crowdsourcing software development. Proceedings of the 36th International Conference on Software Engineering (pp. 187-198). Retrieved from https://ulir.ul.ie/bitstream/handle/10344/3982/fitzgerald_2014_company.pdf?sequence=2
• Sun Y., Wang N., Yin C. X., & Che T. (2012). Investigating the non-linear relationships in the expectancy theory: The case of crowdsourcing marketplace. Proceedings of the AMCIS Proceedings. Paper 6. Retrieved from https://pdfs.semanticscholar.org/655c/493805a2bfe83b63657780f18ed91f4397e9.pdf
• Surowiecki, J. (2004). The Wisdom of Crowds: Why the Many are Smarter than the Few and How Collective Wisdom Shapes Business, Economies, Societies, and Nations. New York: Doubleday.
• Tapscott, D., & William, A. D. (2007). Wikinomics: How Mass Collaboration Changes Everything. New York: Portfolio, Penguin.
• Tokarchuk, O., Cuel, R., & Zamarian, M. (2012). Analyzing crowd labor and designing incentives for humans in the loop. Internet Computing, IEEE, 16, 45-51.
• Vukovic, M., Mariana, L., & Laredo, J. (2009). People cloud for the globally integrated enterprise. In: D. Asit, F. Gittler, & F. Tourmani (Eds.), Service-Oriented Computing. Berlin: Springer.
• West, J., Salter, A., Vanhaverbeke, W., & Chesbrough, H. (2014). Open innovation: The next decade. Research Policy, 43(5), 805-811.
• Wexler, M. N., (2011). Reconfiguring the sociology of the crowd: Exploring crowdsourcing. International Journal of Sociology and Social Policy, 31(1/2), 6-20.
• Whitla, P. (2009). Crowdsourcing and its application in marketing activities. Contemporary Management Research, 5(1), 15-28.
• Wilcox, R.T. (2000). Experts and amateurs: The role of experience in Internet auctions. Marketing Letters, 11(4), 363-374.
• Xu, Y., Ribeiro-Soriano, E. D., & Gonzalez-Garcia, J. (2015). Crowdsourcing, innovation and firm performance. Management Decision, 53(6), 1158-1169.
• Yang, J., Ackerman, M. S., & Adamic, L. A. (2011). Virtual gifts and guanxi: Supporting social exchange in a Chinese online community. Proceeding of the ACM Conference on Computer Supported Cooperative Work (pp. 45-54). Retrieved from https://socialworldsresearch.org/sites/default/files/Yang-VirtualPoints-CSCW11.final_.pdf
• Yang, J., Adamic, L.A., & Ackerman, M.S. (2008). Crowdsourcing and knowledge sharing: Strategic user behavior on taskcn. Proceedings of ACM Electronic Commerce (pp. 246-255). Retrieved from http://web.eecs.umich.edu/~ackerm/pub/08b49/yang-witkey-ec.final.pdf
• Yin, R. K. (2014). Case Study Research: Design and Methods(5th Ed.). Thousand Oaks, CA, USA: Sage Publications.
• Zhao, Y., & Zhu, Q. (2014). Evaluation on crowdsourcing research: Current status and future direction. Information Systems Frontiers, 16(3), 417-434.
• Zheng, H. L., & Dahui, H. W. (2011). Task design, motivation, and participation in crowdsourcing contests. International Journal of Electronic Commerce, I15(4), 57-88.
• Zogaj, S., Bretschneider, U., & Leimeister, J. M. (2014). Managing crowdsourced software testing: A case study based insight on the challenges of a crowdsourcing intermediary. Journal of Business Economics, 84(3), 375-405.

Identyfikatory

DOI

https://doi.org/10.7341/20181445