Masking the Effects of Delays in Human-to-Human Remote Interaction

• Autorzy: Fei Su , John Markus Bjørndalen , Phuong Hoai Ha , Otto J. Anshus
• Języki publikacji: EN

Abstrakty

EN

Humans can interact remotely with each other through computers. Systems supporting this include teleconferencing, games and virtual environments. There are delays from when a human does an action until it is reflected remotely. When delays are too large, they will result in inconsistencies in what the state of the interaction is as seen by each participant. The delays can be reduced, but they cannot be removed. When delays become too large the effects they create on the human-to-human remote interaction can be partially masked to achieve an illusion of insignificant delays. The MultiStage system is a human-to-human interaction system meant to be used by actors at remote stages creating a common virtual stage. Each actor is remotely represented by a remote presence created based on a stream of data continuously recorded about the actor and being sent to all stages. We in particular report on the subsystem of MultiStage masking the effects of delays. The most advanced masking approach is done by having each stage continuously look for late data, and when masking is determined to be needed, the system switches from using a live stream to a pre-recorded video of an actor. The system can also use a computable model of an actor creating a remote presence substituting for the live stream. The present prototype uses a simple human skeleton model.(original abstract)

Słowa kluczowe

EN

Communication on the Internet; Image analysis; Data processing

PL

Komunikowanie w internecie; Analiza obrazu; Przetwarzanie danych

• Czasopismo: Annals of Computer Science and Information Systems
• Rocznik: 2014
• Tom: 2
• Strony: 719--728

Twórcy

autor

Fei Su

• UiT The Arctic University of Norway

autor

John Markus Bjørndalen

• UiT The Arctic University of Norway

autor

Phuong Hoai Ha

• UiT The Arctic University of Norway

autor

Otto J. Anshus

• UiT The Arctic University of Norway

Bibliografia

• Aggarwal S., Banavar H., Khandelwal A., Mukherjee S., and Rangarajan S., "Accuracy in dead-reckoning based distributed multiplayer games," in Proceedings of 3rd ACM SIGCOMM workshop on Network and system support for games. ACM, 2004. doi: http://dx.doi.org/10.1145/1016540.1016559 pp. 161-165.
• Aggarwal S., Banavar H., Mukherjee S., and Rangarajan S., "Fairness in dead-reckoning based distributed multi-player games," in Proceedings of 4th ACM SIGCOMM workshop on Network and system support for games. ACM, 2005. doi: http://dx.doi.org/10.1145/1103599.1103608 pp. 1-10.
• Armitage G. and Stewart L., "Limitations of using real-world, public servers to estimate jitter tolerance of first person shooter games," in Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology. ACM, 2004. doi: http://dx.doi.org/10.1145/1067343.1067377 pp. 257-262.
• Baker H. H., Bhatti N., Tanguay D., Sobel I., Gelb D., Goss M. E., Culbertson W. B., and Malzbender T., "Understanding performance in coliseum, an immersive videoconferencing system," ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), vol. 1, no. 2, pp. 190-210, 2005. doi: http://dx.doi.org/10.1145/1062253.1062258
• Basu A., Raij A., and Johnsen K., "Ubiquitous collaborative activity virtual environments," in Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, 2012. doi: http://dx.doi.org/10.1145/2145204.2145302 pp. 647-650.
• Bernier Y. W., "Latency compensating methods in client/server in-game protocol design and optimization," in Game Developers Conference, vol. 98033, no. 425, 2001.
• Bredel M. and Fidler M., "A measurement study regarding quality of service and its impact on multiplayer online games," in Proceedings of the 9th Annual Workshop on Network and Systems Support for Games. IEEE Press, 2010. doi: http://dx.doi.org/10.1109/NETGAMES.2010.5679537 p. 1.
• Capin T. K. and Pandzic I. S., "A dead-reckoning algorithm for virtual human figures," in Virtual Reality Annual International Symposium, 1997, IEEE 1997. IEEE, 1997. doi: http://dx.doi.org/10.1109/VRAIS.1997.583066 pp. 161-169.
• Chew E., Kyriakakis C., Papadopoulos C., Sawchuk A., and Zimmermann R., "Distributed immersive performance: Enabling technologies for and analyses of remote performance and collaboration."
• Claypool M. and Claypool K., "Latency and player actions in online games," Communications of the ACM, vol. 49, no. 11, pp. 40-45, 2006. doi: http://dx.doi.org/10.1145/1167838.1167860
• David R., "Motion-detection-opencv." [Online]. Available: https: //github.com/RobinDavid/Motion-detection-OpenCV
• Dick M., Wellnitz O., and Wolf L., "Analysis of factors affecting players' performance and perception in multiplayer games," in Proceedings of 4th ACM SIGCOMM workshop on Network and system support for games. ACM, 2005. doi: http://dx.doi.org/10.1145/1103599.1103624 pp. 1-7.
• Francis P., Jamin S., Jin C., Jin Y., Raz D., Shavitt Y., and Zhang L., "Idmaps: A global internet host distance estimation service," Networking, IEEE/ACM Transactions on Networking (TON), vol. 9, no. 5, pp. 525-540, 2001. doi: http://dx.doi.org/10.1109/90.958323
• Gummadi K. P., Saroiu S., and Gribble S. D., "King: Estimating latency between arbitrary internet end hosts," in Proceedings of the 2nd ACM SIGCOMM Workshop on Internet measurment. ACM, 2002. doi: http://dx.doi.org/10.1145/637201.637203 pp. 5-18.
• Huang P., Ishibashi Y., Fukushima N., and Sugawara S., "Interactivity improvement of group synchronization control in collaborative haptic play with building blocks," in Proceedings of the 9th Annual Workshop on Network and Systems Support for Games. IEEE Press, 2010, p. 2.
• Jiang X., Safaei F., and Boustead P., "Latency and scalability: a survey of issues and techniques for supporting networked games," in Networks, 2005. Jointly held with the 2005 IEEE 7th Malaysia International Conference on Communication, vol. 1. IEEE, 2005. doi: http://dx.doi.org/10.1109/ICON.2005.1635458 pp. 6-pp.
• Kharitonov V. Y., "Motion-aware adaptive dead reckoning algorithm for collaborative virtual environments," in Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry. ACM, 2012. doi: http://dx.doi.org/10.1145/2407516.2407577 pp. 255-261.
• Lee Y., Agarwal S., Butcher C., and Padhye J., "Measurement and estimation of network qos among peer xbox 360 game players," in Passive and Active Network Measurement, doi: http://dx.doi.org/10.1007/978-3-540-79232-1_5. Springer, 2008, pp. 41-50.
• Li Z., Tang X., Cai W., and Turner S. J., "Fair and efficient dead reckoning-based update dissemination for distributed virtual environments," in 2012 ACM/IEEE/SCS 26th Workshop on Principles of Advanced and Distributed Simulation (PADS). IEEE, 2012. doi: http://dx.doi.org/10.1109/PADS.2012.18 pp. 13-22.
• Madhyastha H. V., Anderson T., Krishnamurthy A., Spring N., and Venkataramani A., "A structural approach to latency prediction," in Proceedings of the 6th ACM SIGCOMM conference on Internet measurement. ACM, 2006. doi: http://dx.doi.org/10.1145/1177080.1177092 pp. 99-104.
• Malik Khan A., Chabridon S., and Beugnard A., "A dynamic approach to consistency management for mobile multiplayer games," in Proceedings of the 8th international conference on New technologies in distributed systems. ACM, 2008. doi: http://dx.doi.org/10.1145/1416729.1416783 p. 42.
• Pantel L. and Wolf L. C., "On the impact of delay on real-time multiplayer games," in Proceedings of the 12th international workshop on Network and operating systems support for digital audio and video. ACM, 2002. doi: http://dx.doi.org/10.1145/507670.507674 pp. 23-29.
• Papadakis G., Mania K., and Koutroulis E., "A system to measure, control and minimize end-to-end head tracking latency in immersive simulations," in Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry. ACM, 2011. doi: http://dx.doi.org/10.1145/2087756.2087869 pp. 581-584.
• Pavlovych A. and Gutwin C., "Assessing target acquisition and tracking performance for complex moving targets in the presence of latency and jitter," in Proceedings of the 2012 Graphics Interace Conference. Canadian Information Processing Society, 2012, pp. 109-116.
• Pavlovych A. and Stuerzlinger W., "Target following performance in the presence of latency, jitter, and signal dropouts," in Proceedings of Graphics Interface 2011. Canadian Human-Computer Communications Society, 2011, pp. 33-40.
• Roberts D., Duckworth T., Moore C., Wolff R., and O'Hare J., "Comparing the end to end latency of an immersive collaborative environment and a video conference," in Proceedings of the 2009 13th IEEE/ACM International Symposium on Distributed Simulation and Real Time Applications. IEEE Computer Society, 2009. doi: http://dx.doi.org/10.1109/DS-RT.2009.43 pp. 89-94.
• Sawchuk A. A., Chew E., Zimmermann R., Papadopoulos C., and Kyriakakis C., "From remote media immersion to distributed immersive performance," in Proceedings of the 2003 ACM SIGMM workshop on Experiential telepresence. ACM, 2003. doi: http://dx.doi.org/10.1145/982484.982506 pp. 110-120.
• Su F., Tartari G., Bjørndalen J., Ha P., and Anshus O., "Multistage: Acting across distance," in Information Technologies for Performing Arts, Media Access, and Entertainment, ser. Lecture Notes in Computer Science, P. Nesi and R. Santucci, Eds., vol. 7990, no. 978-3-642-40049-0. Springer Berlin Heidelberg, 2013. doi: http://dx.doi.org/10.1007/978-3-642-40050-6_20 pp. 227-239.
• Tang A., Pahud M., Inkpen K., Benko H., Tang J. C., and Buxton B., "Three's company: understanding communication channels in three-way distributed collaboration," in Proceedings of the 2010 ACM conference on Computer supported cooperative work. ACM, 2010. doi: http://dx.doi.org/10.1145/1718918.1718969 pp. 271-280.
• Yasui T., Ishibashi Y., and Ikedo T., "Influences of network latency and packet loss on consistency in networked racing games," in Proceedings of 4th ACM SIGCOMM workshop on Network and system support for games. ACM, 2005. doi: http://dx.doi.org/10.1145/1103599.1103622 pp. 1-8.
• Zhang Y., Chen L., and Chen G., "Globally synchronized deadreckoning with local lag for continuous distributed multiplayer games," in Proceedings of 5th ACM SIGCOMM workshop on Network and system support for games. ACM, 2006. doi: http://dx.doi.org/10.1145/1230040.1230071 p. 7.
• Zimmermann R., Chew E., Ay S. A., and Pawar M., "Distributed musical performances: Architecture and stream management," ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), vol. 4, no. 2, p. 14, 2008. doi: http://dx.doi.org/10.1145/1352012.1352018
• [Online]. Available: http://www.gamasutra.com/view/feature/3230/dead_reckoning_latency_hiding_for_.php
• [Online]. Available: http://www.measurepolis.fi/alma/ALMA%20Human%20Reaction%20Times%20as%20a%20Response%20to%20Delays%20in%20Control%20Systems.pdf
• [Online]. Available: http://www.ntp.org/
• [Online]. Available: http://www.serviceassurancedaily.com/2008/06/latency-and-jitter/
• [Online]. Available: http://www-wanmon.slac.stanford.edu/cgi-wrap/pingtable.pl
• [Online]. Available: https://www.planet-lab.eu/