Crowd Work

Crowds are being deployed to address complex and unstructured problems that were once the domain of organizational teams. Unlike organizational teams, crowds often lack formal roles, structures or boundaries. Our knowledge of what leads to effective crowd work has not kept pace with the deployment of crowds. Needless to say, we currently know much less about what facilitates better crowdwork than we know about what facilitates better teamwork. My research on this topic attempts to close the gap and better comprehend the conditions that facilitate more effective crowdwork.


Back to Online Collaboration



Journal Articles


Lykourentzou, I., Robert, L.P., Barlatier, J-P. (2021). Unleashing the Crowd Work’s Potential: The need for a Post-Taylorism Crowdsourcing Model, M@n@gement, (pdf), 24(4), 64-69. https://doi.org/10.37725/mgmt.v24.8373.


Zhang, A. F., Livneh, D., Budak, C., Robert, L. P. and Romero, D. (2017). Crowd Development: The Interplay between Crowd Evaluation and Collaborative Dynamics in Wikipedia, Proceedings of the ACM on Human-Computer Interaction (PACM-HCI), 1, Issue: CSCW, Article 119, December (pdf), link to the article on the publisher's site https://doi.org/10.1145/3134754 and link to the author's copy http://hdl.handle.net/2027.42/138122.


Robert, L. P. and Romero, D. (2017). The Influence of Diversity and Experience on the Effects of Crowd Size, Journal of the Association for Information Science and Technology (JAIST), 68(2), pp. 321-332 (pdf), link to JAIST http://onlinelibrary.wiley.com/doi/10.1002/asi.23653/full and the link to the preprint version http://hdl.handle.net/2027.42/136213.




Conference Proceedings


Maldeniya, D., Budak, C., Robert, L. P. and Romero, D. (2020). Herding a Deluge of Good Samaritans: How GitHub Projects Respond to Increased Attention, Proceedings of The Web Conference (WWW 2020), (Acceptance rate: 19%), (pdf), April 20-24, 2020, Taipei, Taiwan. https://doi.org/10.1145/3366423.3380272 or http://hdl.handle.net/2027.42/153786.


Leung, W., Zhang, Z., Jibuti, D., Zhao, J., Klein, M., Pierce, C, Robert, L. P., Zhu, H., (2020). Race, Gender and Beauty: The Effect of Information Provision Affects Online Hiring Biases, Proceedings of the 38rd ACM Conference on Human Factors in Computing Systems (CHI 2020), (Acceptance rate: 24.3%), (pdf), April 25-30, 2020, Honolulu, Hawaii, USA. https://doi.org/10.1145/3313831.3376874 copy provided by the author: http://hdl.handle.net/2027.42/153289.


Zhang, A. F., Wang, R., Blohm, E., Budak, C., Robert, L. P. and Romero, D. (2019). Participation of New Editors After Times of Shock on Wikipedia, Proceedings of the 13th International AAAI Conference on Web and Social Media (ICWSM 2019), 13(1), pp. 560-571 (Acceptance rate: 21.4%), (pdf), June 11–14, 2019, Munich, Germany. https://aaai.org/ojs/index.php/ICWSM/article/view/3253 copy provided by the author: http://hdl.handle.net/2027.42/148429.


Ye, T., You, S., Robert, L. P. (2017). When Does More Money Work? Examining the Role of Perceived Fairness in Pay on the Performance Quality of Crowdworkers, in the Proceedings of the 11th International AAAI Conference on Web and Social Media (ICWSM 2017). Link to the copy provided by the author: https://hdl.handle.net/2027.42/136162.


Zhang, A. F., Livneh, D., Budak, C., Robert, L. P. Romero, D. (2017). Shocking the Crowd: The Effect of Censorship Shocks on Chinese Wikipedia, in the International AAAI Conference on Web and Social Media (ICWSM 2017). Link to the copy provided by the author: http://hdl.handle.net/2027.42/136163.


Robert, L. P. and Romero, D. (2015). Crowd Size, Diversity and Performance in the 33rd ACM Conference on Human Factors in Computing Systems (CHI 2015) (pdf), April 18-23, 2015, Seoul, South Korea. The link to the ACM Digital Library http://dx.doi.org/10.1145/2702123.2702469.




Short Papers and Late Breaking Reports Proceedings


Maldeniya, D., Budak, C., Robert, L. P. and Romero, D. (2020). How GitHub Projects Respond to Increased Attention, 6th International Conference on Computational Social Science (IC2S2 2020), July 17-20, Cambridge, MA US.


Maldeniya, D., Budak, C., Romero, D. and Robert, L., (2019). Herding a Deluge of Good Samaritans: How GitHub Projects in the Limelight Handle Rapid Growth, 2019 MIDAS Data Science Symposium, Nov. 13-15, Ann Arbor, MI.


Kim, S.,Marquis, E., Alahmad, R., Pierce, C., Robert, L. P. 2018. The Impacts of Platform Quality on Gig Workers’ Autonomy and Satisfaction, Proceedings of the 21th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion (CSCW 2018), (pdf), Jersey City, NJ, USA. http://hdl.handle.net/2027.42/145612 and https://doi.org/10.1145/3272973.3274050.


Marquis, E., Kim, S., Alahmad, R., Pierce, C., Robert, L. P. 2018. Behavioral Control and Emotional Labor among Gig Economy Workers, Proceedings of the 21th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion (CSCW 2018), (pdf), Jersey City, NJ, USA. http://hdl.handle.net/2027.42/145617 and http://10.1145/3272973.3274065.


Rhue, L. and Robert, L. P. (2018). Emotional Delivery in Pro-social Crowdfunding Success, Proceedings of the 36rd ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI 2018), (pdf), April 21-26, 2015, Montreal, Canada, https://doi.org/10.1145/3170427.3188534 (not active yet). Copy provided by the author http://hdl.handle.net/2027.42/142391.


Ye, T., Reinecke, K. and Robert, L. P. (2017). Personalized Feedback Versus Money: The Effect on Reliability of Subjective Data in Online Experimental Platforms in the 20th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion (CSCW 2017), Feb 25-March 1, Portland, OR. http://hdl.handle.net/2027.42/134704.



Book Chapter(s)


Kim, S. and Robert, L. P. (2019). Crowdsourcing Coordination: A Review and Research Agenda for Crowdsourcing Coordination used for Macro-tasks. In J. Khan, I. Lykourentzou, K. Papangelis & P. Markopoulos (Eds.), Macro-task Crowdsourcing: Engaging the Crowds to Address Complex Problems. (pdf), Springer Human Computer Interaction Series. Springer Nature Switzerland AG. Cham, Switzerland.http://hdl.handle.net/2027.42/150620 doi:https://doi.org/10.1007/978-3-030-12334-5_2.


Robert, L. P. (2019). Crowdsourcing Controls: A Review and Research Agenda for Crowdsourcing Controls used for Macro-tasks In J. Khan, I. Lykourentzou, K. Papangelis & P. Markopoulos (Eds.), Macro-task Crowdsourcing: Engaging the Crowds to Address Complex Problems. (pdf), Springer Human Computer Interaction Series. Springer Nature Switzerland AG. Chan, Switzerland. http://hdl.handle.net/2027.42/150493 doi:https://doi.org/10.1007/978-3-030-12334-5_3.