Tagging Fireworkers Activities from Body Sensors under Distribution Drift

• Autorzy: Marc Boulle´
• Języki publikacji: EN

Abstrakty

EN

We describe our submission to the AAIA'15 Data Mining Competition, where the objective is to tag the activity of firefighters based on vital functions and movement sensor readings. Our solution exploits a selective naive Bayes classifier, with optimal preprocessing, variable selection and model averaging, together with an automatic variable construction method that builds many variables from time series records. The most challenging part of the challenge is that the input variables are not independent and identically distributed (i.i.d.) between the train and test datasets. We suggest a methodology to alleviate this problem, that enabled to get a final score of 0.76 (team marcb). (original abstract)

Słowa kluczowe

EN

Time-series

PL

Szeregi czasowe

• Czasopismo: Annals of Computer Science and Information Systems
• Rocznik: 2015
• Tom: 5
• Strony: 389--396

Twórcy

autor

Marc Boulle´

• Orange Labs, France

Bibliografia

• M. Meina, A. Janusz, K. Rykaczewski, D. Slęzak, B. Celmer, and A. Krasuski, "Tagging firefighter activities at the emergency scene: Summary of AAIA'15 data mining competition at Knowledge Pit," in Proceedings of the 2015 Federated Conference on Computer Science and Information Systems, M. Ganzha, L. Maciaszek, and M. Paprzycki, Eds., 2015, in print September 2015.
• M. Boullé, "Compression-based averaging of selective naive Bayes classifiers," Journal of Machine Learning Research, vol. 8, pp. 1659- 1685, 2007.
• P. Langley, W. Iba, and K. Thompson, "An analysis of Bayesian classifiers," in 10th National Conference on Artificial Intelligence. AAAI Press, 1992, pp. 223-228.
• M. Boullé, "Towards automatic feature construction for supervised classication," in ECML/PKDD 2014, 2014, pp. 181-196.
• D. Hand and K. Yu, "Idiot's bayes? not so stupid after all?" International Statistical Review, vol. 69, no. 3, pp. 385-399, 2001.
• J. Dougherty, R. Kohavi, and M. Sahami, "Supervised and unsupervised discretization of continuous features," in Proceedings of the 12th International Conference on Machine Learning. Morgan Kaufmann, San Francisco, CA, 1995, pp. 194-202.
• H. Liu, F. Hussain, C. Tan, and M. Dash, "Discretization: An enabling technique," Data Mining and Knowledge Discovery, vol. 4, no. 6, pp. 393-423, 2002.
• K. Bache and M. Lichman, "UCI machine learning repository," 2013. [Online]. Available: http://archive.ics.uci.edu/ml
• M. Boulle, "MODL: a Bayes optimal discretization method for continuous attributes," Machine Learning, vol. 65, no. 1, pp. 131- 165, 2006.
• J. Rissanen, "Modeling by shortest data description," Automatica, vol. 14, pp. 465-471, 1978.
• P. Langley and S. Sage, "Induction of selective Bayesian classifiers," in Proceedings of the 10th Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann, 1994, pp. 399-406.
• R. Kohavi and G. John, "Wrappers for feature selection," Artificial Intelligence, vol. 97, no. 1-2, pp. 273-324, 1997.
• L. Breiman, "Bagging predictors," Machine Learning, vol. 24, no. 2, pp. 123-140, 1996.
• J. Hoeting, D. Madigan, A. Raftery, and C. Volinsky, "Bayesian model averaging: A tutorial," Statistical Science, vol. 14, no. 4, pp. 382-417, 1999.
• D. Pyle, Data preparation for data mining. Morgan Kaufmann Publishers, Inc. San Francisco, USA, 1999.
• P. Chapman, J. Clinton, R. Kerber, T. Khabaza, T. Reinartz, C. Shearer, and R. Wirth, "CRISP-DM 1.0: step-by-step data mining guide," The CRISP-DM consortium, Tech. Rep., 2000.
• H. Liu and H. Motoda, Feature Extraction, Construction and Selection: A Data Mining Perspective. Kluwer Academic Publishers, 1998.
• I. Guyon, S. Gunn, M. Nikravesh, and L. Zadeh, Eds., Feature Extraction: Foundations And Applications. Springer, 2006.
• A. J. Knobbe, H. Blockeel, A. Siebes, and D. Van Der Wallen, "MultiRelational Data Mining," in Proceedings of Benelearn '99, 1999.
• S. Kramer, P. A. Flach, and N. Lavrač, "Propositionalization approaches to relational data mining," in Relational data mining, S. Džeroski and N. Lavrač, Eds. Springer-Verlag, 2001, ch. 11, pp. 262-286.
• M.-A. Krogel and S. Wrobel, "Transformation-based learning using multirelational aggregation," in ILP. Springer, 2001, pp. 142-155.
• H. Blockeel, L. De Raedt, and J. Ramon, "Top-Down Induction of Clustering Trees," in Proceedings of the Fifteenth International Conference on Machine Learning, 1998, pp. 55-63.
• A. Bondu and M. Boullé, "A supervised approach for change detection in data streams," in Proceedings of International Joint Conference on Neural Networks, 2011.
• O. Chapelle, B. Schölkopf, and A. Zien, Semi-Supervised Learning. MIT Press, Cambridge, MA, 2006.
• S. Pan and Q. Yang, "A survey on transfer learning," IEEE Transactions on Knowledge and Data Engineering, vol. 22, no. 10, pp. 1345-1359, 2010.
• J. Blitzer, R. McDonald, and F. Pereira, "Domain adaptation with structural correspondence learning," in Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, ser. EMNLP '06, 2006, pp. 120-128.
• J. Blitzer, M. Dredze, and F. Pereira, "Biographies, bollywood, boomboxes and blenders: Domain adaptation for sentiment classification," in Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, 2007, pp. 440-447.
• H. Daume III, "Frustratingly easy domain adaptation," in Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, 2007, pp. 256-263.
• W. Dai, G.-R. Xue, Q. Yang, and Y. Yu, "Co-clustering based classification for out-of-domain documents," in Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ser. KDD '07. ACM, 2007, pp. 210- 219.
• D. Xing, W. Dai, G.-R. Xue, and Y. Yu, "Bridged Refinement for Transfer Learning," in Proc. 11th European Conf. on Principles and Practice of Knowledge Discovery in Databases (PKDD), ser. PKDD 2007. Springer Berlin / Heidelberg, 2007, pp. 324-335.
• ] Y. LeCun and C. Cortes, "The MNIST database of handwritten digits," 1998, http://yann.lecun.com/exdb/mnist/.

Identyfikatory

DOI

10.15439/2015F423