by Piyush Yadav, Umair ul Hassan, Souleiman Hasan, Edward Curry
Abstract:
Event processing systems involve the processing of high volume and variety data which has inherent uncertainties like incomplete event streams, imprecise event recognition etc. With the emergence of crowdsourcing platforms, the performance of event processing systems can be enhanced by including ‘human-in-theloop' to leverage their cognitive ability. The resulting crowdsourced event processing can cater to the problem of event uncertainty and veracity by using humans to verify the results. This paper introduces the first hybrid crowd-enabled event processing engine. The paper proposes a list of five event crowd operators that are domain and language independent and can be used by any event processing framework. These operators encapsulate the complexities to deal with crowd workers and allow developers to define an event-crowd hybrid workflow. The operators are: Annotate, Rank, Verify, Rate, and Match. The paper presents a proof of concept of event crowd operators, schedulers, poolers, aggregators in an event processing system. The paper demonstrates the implementation of these operators and simulates the system with various performance metrics. The experimental evaluation shows that throughput of the system was 7.86 events per second with average latency of 7.16 seconds for 100 crowd workers. Finally, the paper concludes with avenues for future research in crowd-enabled event processing.
Reference:
Piyush Yadav, Umair ul Hassan, Souleiman Hasan, Edward Curry, "The Event Crowd", In Proceedings of the 11th ACM International Conference on Distributed and Event-based Systems, ACM, New York, NY, USA, pp. 44-53, 2017.
Bibtex Entry:
@inproceedings{Yadav2017,
abstract = {Event processing systems involve the processing of high volume and variety data which has inherent uncertainties like incomplete event streams, imprecise event recognition etc. With the emergence of crowdsourcing platforms, the performance of event processing systems can be enhanced by including ‘human-in-theloop' to leverage their cognitive ability. The resulting crowdsourced event processing can cater to the problem of event uncertainty and veracity by using humans to verify the results. This paper introduces the first hybrid crowd-enabled event processing engine. The paper proposes a list of five event crowd operators that are domain and language independent and can be used by any event processing framework. These operators encapsulate the complexities to deal with crowd workers and allow developers to define an event-crowd hybrid workflow. The operators are: Annotate, Rank, Verify, Rate, and Match. The paper presents a proof of concept of event crowd operators, schedulers, poolers, aggregators in an event processing system. The paper demonstrates the implementation of these operators and simulates the system with various performance metrics. The experimental evaluation shows that throughput of the system was 7.86 events per second with average latency of 7.16 seconds for 100 crowd workers. Finally, the paper concludes with avenues for future research in crowd-enabled event processing.},
address = {New York, NY, USA},
author = {Yadav, Piyush and ul Hassan, Umair and Hasan, Souleiman and Curry, Edward},
booktitle = {Proceedings of the 11th ACM International Conference on Distributed and Event-based Systems},
doi = {10.1145/3093742.3093922},
file = {:Users/ed/Library/Application Support/Mendeley Desktop/Downloaded/Yadav et al. - 2017 - The Event Crowd.pdf:pdf},
isbn = {9781450350655},
keywords = {Event crowd,crowdsourcing,event processing,event uncertainty,human-in-theloop},
mendeley-tags = {Event crowd,crowdsourcing,event processing,event uncertainty,human-in-theloop},
month = {jun},
pages = {44--53},
publisher = {ACM},
title = {{The Event Crowd}},
url = {http://www.edwardcurry.org/publications/DEBS2017-Yadav.pdf},
year = {2017}
}