Advances in Computer and Communication

Downloads: 43174 Total View: 384158
Frequency: quarterly ISSN Online: 2767-2875 CODEN: ACCDC3
Email: acc@hillpublisher.com

Volumes & Issues

Current Issue

Article http://dx.doi.org/10.26855/acc.2023.02.004

Colouring the Sculpture through Corresponding Area from 2D to 3D with Augmented Reality

Yaozhong Zhang

University of Nottingham, Nottingham, UK.

*Corresponding author: Yaozhong Zhang

Published: April 10,2023

Abstract

With the development of 3D modelling techniques and AR techniques, the traditional methods of establishing 2D to 3D relations are no longer sufficient to meet the demand for complex models and rapid relation building. This paper presents a prototype development implemented that creates many-to-many correspondences by marking images and 3D model regions that can be used to colouring 3D model by colouring images for the end user. Further development related to the creation of rendered textures by changing the Zeus bust model texture and building in the AR environment. The results of testing each part of the prototype show the viability of creating render textures relation method. The advantages of it are easy to build many-to-many relations and adaptability for any model with proper UV mapping. But there are still three main limitations and future work will focus on solving them, building a database to store relation information data and 3D printing coloured models in the real world.

References

[1] Clark, A.; Dünser, A.; Grasset, R. An interactive augmented reality coloring book. 2012 IEEE Symposium on 3D User Interfaces 2012, 7-10. https://doi.org/10.1109/3DUI.2012.6184168.  

[2] Magnenat, S.; Ngo, D.T.; Zünd, F.; Ryffel, M.; Noris, G.; Rothlin, G; Marra, A.; Nitti, M.; Fua, P.; Gross, M.; Sumner, R.W. Live texturing of augmented reality characters from colored drawings. IEEE transactions on visualization and computer graphics 2015, 21, 1201-1210. https://doi.org/10.1109/TVCG.2015.2459871.  

[3] Lee, Y. AR coloring jigsaw puzzles with texture extraction and auto-UV mapping algorithm. International Conference on Dis-tributed, Ambient, and Pervasive Interactions 2015, 9189,182-187. https://doi.org/10.1007/978-3-319-20804-6_17.

[4] Panzanelli, R.; Schmidt, E.D.; Lapatin,K, A.; Brinkmann, V.; Ostergaard, J.S.; Collareta, M.; Potts, A. The color of life: polyc-hromy in sculpture from antiquity to the present, 1st ed.; Getty Research Institute: Los Angeles, United States, 2008; pp. 18–39. https://www.amazon.com/Color-Life-Polychromy-Sculpture-Antiquity/dp/0892369175#customerReviews  

[5] Bradley, M. The importance of colour on ancient marble sculpture. Art history 2009, 32, 427-457. 

https://doi.org/10.1111/j.1467-8365.2009.00666.x

[6] Skovmøller, A.; Brøns, C.; Sargent, M. L. The polychromy of the sculpted garments on the statue of Gaius Fundilius Doctus in the Ny Carlsberg Glyptotek. Polychromy in Ancient Sculpture and Architecture 2018, 93-100. 

https://amis.ku.dk/people/?pure=en%2Fpublications%2Fthe-polychromy-of-the-sculpted-garments-on-the-statue-of-gaius-fundilius-doctus-in-the-ny-carlsberg-glyptotek(87ccd98f-9592-43c4-88cf-a7339bf906c8).html.  

[7] Gods in Color. Available online: https://buntegoetter.liebieghaus.de/en/ (accessed on 07 September 2022).

[8] Color the Peplos Kore: http://www.yanniskoutsoukos.com/en/peploforos (accessed on 07 September 2022).

[9] Archaic Colors: Acropolis Museum. Available online: https://theacropolismuseum.gr/en/exhibition-programs/archaic-colours

(accessed on 07 September 2022).

[10] Feng, L.; Yang, X.; Xiao, S. Magictoon: A 2d-to-3d creative cartoon modeling system with mobile ar. 2017 IEEE Virtual Reality (VR) 2017, 195-204. https://doi.org/10.1109/VR.2017.7892247.  

[11] Norraji, M. F.; Sunar, M. S. wARna—Mobile-based augmented reality colouring book. 2015 4th International Conference on Interactive Digital Media (ICIDM) 2015, 1-4. https://doi.org/10.1109/IC3e.2018.8632639. 

[12] Hanrahan, P.; Haeberli, P. Direct WYSIWYG painting and texturing on 3D shapes: (An error occurred during the printing of this article that reversed the print order of pages 118 and 119. While we have corrected the sort order of the 2 pages in the DL, the PDF did not allow us to repaginate the 2 pages.). ACM SIGGRAPH computer graphics 1990, 24, 215-223. 

https://doi.org/10.1145/97880.97903.                   

[13] Adams, B.; Wicke, M.; Dutré, P.; Gross, M.; H.; Pauly, M.; Teschner, M. Interactive 3D Painting on Point-Sampled Objects. PBG 2004, 57-66. https://doi.org/10.2312/SPBG/SPBG04/057-066.  

[14] Williams, L. 3D paint. SIGGRAPH Comput. Graph 1990, 24, 225-233. https://doi.org/10.1145/91394.91450.   

[15] Igarashi, T.; Cosgrove, D. Adaptive unwrapping for interactive texture painting. Proceedings of the 2001 symposium on Interactive 3D graphics 2001, 209-216. https://doi.org/10.1145/91385.91450 . 

[16] Lu, S.; Mok, P.Y.; Jin, X. A new design concept: 3D to 2D textile pattern design for garments. Comput. Aided Des. 2017, 89, 35-49. https://doi.org/10.1016/j.cad.2017.03.002.  

[17] Zilles, C. B.; Salisbury, J. K. A constraint-based god-object method for haptic display. Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots 1995, 3, 146-151.

https://doi.org/10.1109/IROS.1995.525876.   

[18] Basdogan, C.; Srinivasan, M. A. Haptic rendering in virtual environments. In Handbook of virtual environments, 1st ed.; Hale, K. S., Stanney, K. M., Eds.; CRC Press: Boca Rato, United State, 2002; pp. 117-134. 

https://www.amazon.com/Handbook-Virtual-Environments-Implementation-Applications/dp/080583270X.  

[19] Theoktisto, V.; Fairén, M.; Navazo, I.; Monclús, E. Rendering detailed haptic textures. Second Workshop in Virtual Reality Inte-ractions and Physical Simulations (VRIPHYS 05) 2005, 16-23. 

https://www.academia.edu/50205980/Rendering_detailed_haptic_textures.

[20] Wakita, W.; Murakami, K.; Ido, S. A texture-based haptic model design with 3D brush. Proc. 18th International Conference on Artificial Reality and Telexistence (ICAT2008) 2008, 51-56. https://icat.vrsj.org/ICAT2008_Proceedings/Papers/PS2_2.pdf.  

[21] Manipulation of Render Texture. Available online: 

https://docs.unity3d.com/2019.4/Documentation/Manual/class-RenderTexture.html (accessed on 07 September 2022).

[22] Description of Render Texture. Available online: https://docs.unity3d.com/ScriptReference/RenderTexture.html (accessed on 07 September 2022).

[23] RealTime Painting: Tutorials: Unity Asset Store. Available online: from 

https://assetstore.unity.com/packages/templates/tutorials/realtime-painting-33506 (accessed on 07 September 2022).

[24] Azuma, R. T. A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 1997, 6, 355-385.

https://doi.org/10.1162/pres.1997.6.4.355.  

[25] Craig, A. B. Understanding augmented reality: Concepts and applications, 1st ed.; Morgan Kaufmann: Burlington, United States, 2013; pp. 1-36. https://doi.org/10.1016/B978-0-240-82408-6.00001-1. 

[26] QuiverVision. Available online: https://quivervision.com/ (accessed on 07 September 2022).

[27] Lee, Y.; Choi, J. Texture Extraction from Video and Image Warping for AR Coloring Book*. Computer Science and its Applica-tions. Lecture Notes in Electrical Engineering 2015, 330, 361-362. https://doi.org/10.1007/978-3-662-45402-2_55.  

[28] Dinosaur Sketchbook. VUiDEA. Available online: http://www.vuidea.com/ (accessed on 07 September 2022).

[29] Cho, K.; Kim, H.; Lee, Y. Augmented reality coloring book with transitional user interface. Indian Journal of Science and Technology 2016, 9, 1-5. https://doi.org/10.17485/ijst/2016/v9i20/94692.  

[30] Mokhtar, M. K.; Mohamed, F.; Sunar, M. S.; Arshad,M. A. M. ; Mohd Sidik, M. K. Development of Mobile-Based Augmented Reality Colouring for Preschool Learning. IEEE Conference on e-Learning, e-Management and e-Services (IC3e) 2018, 11-16. https://doi.org/10.1109/IC3e.2018.8632639.  

[31] Olsen, L.; Samavati, F.; Jorge, J. NaturaSketch: Modeling from Images and Natural Sketches. IEEE Computer Graphics and Applications 2011, 31, 24-34. https://doi.org/10.1109/MCG.2011.84.  

[32] Colossal marble bust of Zeus: British Museum. (n.d.). Available online: 

https://www.britishmuseum.org/collection/object/G_1836-0709-1 (accessed on 07 September 2022).

[33] Colossal marble bust of Zeus 3D model. Available online: 

https://sketchfab.com/3d-models/colossal-marble-bust-of-zeus-9246efe1279543a784a08be62e6b96a8 (accessed on 07 September 2022).

[34] Explore the possibilities of RealityCapture. 

Available online: http://www.capturingreality.com/ (accessed on 07 September 2022).

[35] MacBook Pro 13-inch - Technical Specifications. Available online: https://www.apple.com/uk/macbook-pro-13/specs/ (accessed on 07 September 2022).

[36] iPad Pro - Technical Specifications. 

Available online: https://www.apple.com/uk/ipad-pro/specs/ (accessed on 07 September 2022).

[37] Mccarthy, J.; Sebo, E.; Wilkinson, B.; Sheehan, F. Open Workflows for Polychromatic Reconstruction of Historical Sculptural Monuments in 3D. J. Comput. Cult. Herit 2020, 13, 1-16. https://doi.org/10.1145/3386314。

[38] The paper is published in a preprint version with different structure and acknowledgement in arXiv. Available online: 

https://doi.org/10.48550/arXiv.2202.04259 (accessed on 07 September 2022).

How to cite this paper

Colouring the Sculpture through Corresponding Area from 2D to 3D with Augmented Reality

How to cite this paper: Yaozhong Zhang. (2023) Colouring the Sculpture through Corresponding Area from 2D to 3D with Augmented Reality. Advances in Computer and Communication4(1), 25-36.

DOI: http://dx.doi.org/10.26855/acc.2023.02.004