We proposed a method to digitally reassemble an object to its original form from the given 3D data
of its components which are assumed to be non-rigidly deformed.
We developed an algorithm to deform the components parametrically with constraints on the deformation
based on the physical properties of the material.
We applied the method to virtually restore the first solar boat of King Khufu.
T. Nemoto, T. Kobayashi, M. Kagesawa, T. Oishi, H. Kurokochi, S. Yoshimura, E. Ziddan, M. Taha,
"Virtual Restoration of Ancient Wooden Ships Through Non-rigid 3D Shape Assembly with Ruled-Surface FFD,"
International Journal of Computer Vision (IJCV), 131, 1269–1283, 2023.
We made an attempt to reproduce dance motion from the Stepanov score, one of the dance scores of ballet, using a CG model.
We also verified the expressiveness and accuracy of the Stepanov score through the process of reproducing.
M. Sato, R. Hakoda, A. Murakami, N. Wake, K. Sasabuchi, M. Nakamura, T. Oishi, T. Itoh, K. Ikeuchi,
"Digital Reconstruction of Ballet Movements from Dance Scores: A Focus on Stepanov's Music Note System and Labanotation,"
The 32nd conference of the International Council of Kinetography Laban/Labanotation, July 17-23, 2022.
These are huge objects existing outdoors and providing various technical challenges.
Geometric models of the cultural heritage assets are digitally achieved through a pipeline, consisting of acquiring
data, aligning multiple range images, and merging these images. We have developed alignment algorithms: a rapid
simultaneous algorithm for quick data checking on site, and a parallel alignment algorithm for precise adjustment.
We have also designed a parallel voxel-based merging algorithm for connecting all aligned range images.
The texture images acquired by color cameras are aligned onto the geometric models.
In an attempt to restore the original appearance of historical objects,
we have synthesized several buildings and statues using scanned data and a literature survey.
R. Shitomi, M. Tsuji, Y. Fujimura, T. Funatomi, Y. Mukaigawa, T. Morimoto, T. Oishi, J. Takamatsu, and K. Ikeuchi,
"Unsupervised learning with physics-based autoencoder for estimating thickness and mixing ratio of pigments,"
Journal of the Optical Society of America. A, Optics, image science, and vision, 40(1), 116–128, 2023.
3D shape comparison with digital copies draws increasing attention in modern culture heritage studies.
Our aim is to analyze portrait sculptures of Augustus with 3D scanned data.
A feasible framework of automatic object categorization is proposed based on shape comparison, where
distinguishing regions are simultaneously detected as well.
High coincidence between our result and previous archaeological speculations is observed in validation experiments, which confirms
the validity of the proposed method.
K. Sengoku-Haga, M. Kagesawa, T. Oishi,
"Apoxyomenoi: replication in antiquity and restoration in modern times,"
22nd International Congress on Ancient Bronzes, Athens, Greece October 17, 2024.
The Bayon Temple of Angkor Thom in Cambodia was built in the 12th century. It is composed of many
masonry towers, and they were constructed by dry masonry. The main tower of it is about 40 meters
high from the ground. The shape of the upper area of the main tower is now complicated because of its
partial collapse in the past. It also risks further collapse due to strong winds. To assess the influence of
the wind pressure on the monument with the complicated shape, we conducted a wind tunnel test using
3D laser scanning data and a 3D printer. Based on the wind tunnel test and the laboratory loading test of dry masonry, we assess the
structural stability of the Bayon main tower.
The Bayon temple in Cambodia was built in the 12th century and is famous for its towers
with four faces at the four cardinal points. According to research by JSA (Japanese government team for
Safeguarding Angkor), the faces can be classified into three groups based on subjective criteria.
We explore a more objective way to classify the faces by using measured 3D geometrical models.
After alignment of 3D faces in the same coordinate system, orientation, and normalization,
we captured in-depth images of each face and then classified them by several statistical methods.
M. Kamakura, T. Oishi, J. Takamatsu and K. Ikeuchi,
"Classification of Bayon Faces Using 3D Model,"Proc. 11th International Conference on Virtual Systems and Multimedia (VSMM 2005),
October 2005. (Paper Award in the category Heritage)
We developed an interactive rendering system for large scale 3D mesh models,
stored on a remote machine through relatively small capacity of networks.
Our system uses both model and image based rendering methods for efficient load balance
between a server and clients. On the server, the 3D models are rendered by the model-based method using a
hierarchical data structure with multi-resolution. On the client, it reconstructs an arbitrary view by using a novel
image-based method, referred to as the Grid-Lumigraph, with blending image colors from sampling images received
from the server. The resulting rendering system can efficiently
render any image in real-time.