Immersive Photogrammetry in 3D Modelling

• Autorzy: Karol Kwiatek , Regina Tokarczyk

Warianty tytułu

Fotogrametria immersyjna w modelowaniu 3D

• Języki publikacji: EN

Abstrakty

EN

The article presents the concept of 3D modelling from immersive video. The first part of the article presents current approaches to 3D modelling from panoramas, from image-based modelling programs, via manual elaboration of objects from panoramas, to automatic acquisition of the point cloud from dense matching of panoramas. The second part of the article discusses immersive video, numerous applications of this new medium and the methods of imaging all-around space with cameras capable of recording a 360-degree video. The paper investigates the legitimacy of using a large number of immersive images of relatively low resolution in 3D modelling. If the immersive camera moves along the set trajectory, the number of low resolution panoramas taken in this process will facilitate creation of metric 3D models. An examination of the test field was performed with a Ladybug®3 camera. Image orientation and a textured 3D model were developed in Agisoft Photoscan. The paper investigates how such factors as the method of stitching images into panoramas, the selection of the sphere radius, the image file format and a density of panoramas affect the 3D modelling process. The results present the validity of further research in this area.(original abstract)

Artykuł przedstawia koncepcję modelowania 3D z wideo immersyjnego. Pierwsza część artykułu prezentuje dotychczasowe podejścia do modelowania 3D z panoram, od programów typu "image-based modelling", przez manualne opracowanie obiektów z panoram, do automatycznego uzyskania chmury punktów z gęstego matchingu panoram. Druga część artykułu omawia wideo immersyjne, liczne zastosowania tego nowego medium do obrazowania przestrzeni oraz metody i kamery umożliwiające nagrywanie wideo 360-stopniowego. W pracy podejmuje się problem zasadności wykorzystania do modelowania dużej liczby immersyjnych obrazów wideo o stosunkowo niewielkiej rozdzielczości. Jeśli kamera immersyjna będzie się przesuwać według określonej trajektorii, to taka liczba stosunkowo niskorozdzielczych panoram jest podstawą wydajnego sporządzania metrycznych modeli 3D. Do badań na polu testowym wykorzystano kamerę Ladybug®3. Orientację zdjęć oraz model 3D w postaci chmury punktów i teksturowany wykonano w programie Agisoft Photoscan. Zbadano wpływ na modelowanie takich czynników, jak sposób łączenia zdjęć składowych w panoramy, dobór promienia sfery, format plików obrazowych i gęstość panoram. Wyniki pokazują zasadność dalszych badań w tym zakresie.(abstrakt oryginalny)

Słowa kluczowe

EN

Digital photography; Modeling of digital image; Digital images

PL

Fotografia cyfrowa; Modelowanie obrazu cyfrowego; Obrazy cyfrowe

• Czasopismo: Geomatics and Environmental Engineering
• Rocznik: 2015
• Numer: nr 9/2
• Strony: 51--62

Twórcy

autor

Karol Kwiatek

• Cracow University of Economics, Poland

autor

Regina Tokarczyk

• AGH University of Science and Technology Kraków, Poland

Bibliografia

• Barazzetti L., Fangi G., Remondino F., Scaioni M.: Automation in Multi-image Spherical Photogrammetry for 3D Architectural Reconstructions. VAST: International Symposium on Virtual Reality, Archaeology and Intelligent Cultural Heritage-Short and Project Papers, The Eurographics Association, 2010, pp. 75-81.
• Bednarczyk M., Pelc-Mieczkowska R.: Propozycje wykorzystania zdjęć panoramicznych w GIS i geodezji. Roczniki Geomatyki, 1.12, z. 64, 2014, pp. 163-176.
• Chang P., Hebert M.: Omni-directional Structure from Motion. Proceedings on Omnidirectional Yision, IEEE Workshop, 2000, pp. 127-133.
• Fangi G.: The Multi-image Spherical Panoramas as a Tool for Architectural Suvey. XXI International CIPA Symposium, Athens, XXXVI-5/C53, 2007, pp. 311-316.
• Fangi G.: Further Developments of the Spherical Photogrammetry for Cultural Heritage. XXII CIPA Symposium, Kyoto, Japan, 2009, pp. 11-15.
• Fangi G., Nardinocchi C.: Photogrammetric Processing of Spherical Panoramas. The Photogrammetric Record, vol. 28, no.143, 2013, pp. 293-311.
• Griffiths A.: Shwers Down Your Spine: Cinema, Museums, and the Immersive View. Columbia University Press, New York 2008.
• Guidi G., Gonizzi S., Micoli L.: Image Pre-processing for Optimizing Automated Photogrammetry Performances. ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. II-5, 2014, pp. 114-125.
• Guo J., Zhong R., Zeng F.: Panoramie Images Mapping Tools Integrated within the ESRI ArcGIS Software. IOP Conference Series: Earth and Environmental Science, vol. 17, no. 1, 2014, pp. 1-5.
• Kaess M., Dellaert F.: Probabilistic Structure Matching for Visual SLAM with a Multi-camera Rig. Computer Vision and Image Understanding, vol. 114, no. 2, 2010, pp. 286-296.
• Kwiatek K.: 360° Film Brings Bombed Church to Life. ISPRS -International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XXXVIII-5/W16, 2011, pp. 69-76.
• Kwiatek K., Tokarczyk R.: Photogrammetric Applications of Immersive Video Cameras. ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 1, 2014, pp. 211-218.
• Kwiatek K., Woolner M.: Embedding Interactive Storytelling within Still and Video Panoramas for Cultural Heritage Sites. XV International Conference on Virtual Systems and Multimedia, VSMM 2009, IEEE, Vienna, 2009, pp. 197-202.
• Luhmann T., Tecklenburg W.: 3-D Object Reconstruction from Multiple-station Panorama Imagery. Panoramic Photogrammetry Workshops, ISPRS Archives, vol. XXXIV-5/W16, Dresden 2004.
• Nakagawa M., Kataoka K., Yamamoto T., Shiozaki M., Ohhashi T.: Panoramic rendering-based polygon extraction from indoor mobile LiDAR data. ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XL-4, 2014, pp. 181-186.
• Pagani A., Stricker D.: Structure from Motion Using Fuli Spherical Panoramic Cameras. IEEE International Conference on Computer Vision Workshops (ICCV Workshops), 2011, pp. 375-382.
• Parian J.A., Gruen A.: A refined sensor model for panoramic cameras. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 34, no. 2, 2004, pp. 1-12.
• Scheer E., Sewell S., Scenario. University of New South Wales Press, Sydney 2011.
• Schneider D., Maas H.-G.: Geometrie Modelling and Calibration of a High Resolution Panoramic Camera. VI Conference on Optical 3D Measurement Techniques, Zurich, Switzerland, 2003, pp. 122-129.
• Schneider D., Maas H.-G.: Application and Accuracy Potential of a Strict Geometric Model for Rotating Line Cameras. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 34, 2004, pp. 1-5.
• Schneider D., Maas H.-G.: Combined Bundle Adjustment of Panoramic and Central Perspective Images. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 36, no. 5, 2005, pp. 181-186.
• Shi Y., Ji S., Shi Z., Duan Y., Shibasaki R.: GPS-supported Visual SLAM with a Rigorous Sensor Model for a Panoramiec Camera in Outdoor Environments. Sensors, vol. 13, no. 1, 2012, pp. 119-136.
• Szeliski R., Shum H.-Y.: Creating Full View Panoramic Image Mosaics and Environment Maps. Proceedings of 24th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press/Addison-Wesley Publishing Co., New York 1997, pp. 251-258.