Ontology for Task and Quality Management in Crowdsourcing
This paper suggests an ontology for task and quality control mechanisms representation in crowdsourcing systems. The ontology is built to provide reasoning about tasks and quality control mechanisms to improve tasks and quality management in crowdsourcing. The ontology is formalized in OWL (Web Ontology Language) and implemented using Protégé. The developed ontology consists of 19 classes, 7 object properties, and 32 data properties. The development methodology of the ontology involves three phases including Specification (identifying scope, purpose and competency questions), Conceptualization (data dictionary, UML, and instance creation), and finally Implementation and Evaluation.
L. Ponciano, F. Brasileiro, N. Andrade, and L. Sampaio, “Considering human aspects on strategies for designing and managing distributed human computation,” Journal of Internet Services and Applications, vol. 5, no. 1, p. 10, 2014.
L. Litman, J. Robinson, and C. Rosenzweig, “The relationship between motivation, monetary compensation, and data quality among US- and India-based workers on Mechanical Turk.,” Behavior research methods, Springer US, Jun. 2014.
R. Buettner, “A Systematic Literature Review of Crowdsourcing Research from a Human Resource Management Perspective,” in Proceedings of the 48th Hawaii International Conference on System Sciences, 2015.
R. Alabdujabbar and H. Al-Dossari, “Towards a Classification Model for Tasks in Crowdsourcing,” in the ACM proceedings of the second International Conference on Internet of Things, Data and Cloud Computing (ICC 2017), Cambridge city, United Kingdom. (In Press).
M. Allahbakhsh, B. Benatallah, A. Ignjatovic, H. Motahari-Nezhad, E. Bertino, and S. Dustdar, “Quality Control in Crowdsourcing Systems: Issues and Directions,” IEEE Internet Computing, vol. 17, no. 2, pp. 76–81, 2013.
M. Gan, X. Dou, and R. Jiang, “From ontology to semantic similarity: Calculation of ontology-based semantic similarity,” The Scientific World Journal, 2013.
 R. Alabduljabbar and H. Al-Dossari, “A Dynamic Model for Quality Control in Crowdsourcing Systems,” in Proceedings of the IKE’16 - The 15th International Conference on Information & Knowledge Engineering,July 2016, Las Vegas, USA.
G. Brusa, M. Caliusco, and O. Chiotti, “A process for building a domain ontology: an experience in developing a government budgetary ontology,” Proceedings of the second Australasian workshop on Advances in ontologies, vol. 72, no. c, pp. 7–15, 2006.
A. Gómez-Pérez, M. Fernández-López, and O. Corcho, Ontological engineering: with examples from the areas of Knowledge Management, e-Commerce and the Semantic Web. London: Springer, 2004.
M. Gruninger and M. S. Fox, “Methodology for the Design and Evaluation of Ontologies,” Industrial Engineering, vol. 95, pp. 1–10, 1995.
M. Uschold and M. Gruninger, “Ontologies: principles, methods and applications,” The Knowledge Engineering Review, vol. 11, no. February, pp. 93–136, 1996.
L. Hetmank, “A Lightweight Ontology for Enterprise Crowdsourcing,” in Proceedings of the 22nd European Conference on Information Systems (ECIS 2014), 2014, p. Paper 886.
J. DE Bruijn and D. Fensel, “Ontology Definitions,” in Encyclopedia of Library and Information Science, Marcel Dekker, inc., 2005.
M. Hepp, “Possible ontologies: How reality constrains the development of relevant ontologies,” IEEE Internet Computing, vol. 11, no. 1, pp. 90–96, 2007.
MTurk, “MTurk: Amazon Mechanical Turk,” 2016. [Online]. Available: http://www.mturk.com/. [Accessed: 01-Jan-2016].
Upwork, “Upwork,” 2016. [Online]. Available: https://www.upwork.com/. [Accessed: 24-Mar-2016].
Freelancer, “Freelancer,” 2016. [Online]. Available: https://www.freelancer.com/. [Accessed: 24-Mar-2016].
“Protégé.” [Online]. Available: http://protege.stanford.edu. [Accessed: 01-May-2016].
K. El Maarry, W. Balke, H. Cho, S. Hwang, and Y. Baba, “Skill Ontology-Based Model for Quality Assurance in Crowdsourcing,” Database Systems for Advanced Applications, LNCS, vol. 8505, pp. 376–387, 2014.
http://www.ksl.stanford.edu/software/ontolingua/ , Access: 10 June 2016.
http://www.daml.org/ontologies/ , Access: 10 June 2016.
http://protege.cim3.net/cgi-bin/wiki.pl?ProtegeOntologiesLibrary , Access: 10 June 2016.
http://swoogle.umbc.edu/ , Access: 10 June 2016.
http://jena.sourceforge.net/ , Access: 10 June 2016.
Authors who submit papers with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
- By submitting the processing fee, it is understood that the author has agreed to our terms and conditions which may change from time to time without any notice.
- It should be clear for authors that the Editor In Chief is responsible for the final decision about the submitted papers; have the right to accept\reject any paper. The Editor In Chief will choose any option from the following to review the submitted papers:A. send the paper to two reviewers, if the results were negative by one reviewer and positive by the other one; then the editor may send the paper for third reviewer or he take immediately the final decision by accepting\rejecting the paper. The Editor In Chief will ask the selected reviewers to present the results within 7 working days, if they were unable to complete the review within the agreed period then the editor have the right to resend the papers for new reviewers using the same procedure. If the Editor In Chief was not able to find suitable reviewers for certain papers then he have the right to reject the paper.
- Author will take the responsibility what so ever if any copyright infringement or any other violation of any law is done by publishing the research work by the author
- Before publishing, author must check whether this journal is accepted by his employer, or any authority he intends to submit his research work. we will not be responsible in this matter.
- If at any time, due to any legal reason, if the journal stops accepting manuscripts or could not publish already accepted manuscripts, we will have the right to cancel all or any one of the manuscripts without any compensation or returning back any kind of processing cost.
- The cost covered in the publication fees is only for online publication of a single manuscript.