Sunday, 30 July 2017

The Lady of K'anamarka and the relevance of computer graphics for tourism



For the eighth time, I traveled to Peru, as I have always been very well treated and enjoyed good moments throughout the social spectrum. The big difference from this episode in relation to the other seven is perhaps the fact that I realized how graphic computing might be relevant to apparently disconnected areas of their initial claims, such as tourism. In the face of this I will share with you my reflections and history of how things unfolded in that beautiful Andean country.

Stages of facial reconstruction of the Lady of K'anamarka. This woman was a victim of a trepanation surgery on her modified skull (artificially deformed skull, "ET skull").

Something similar had happened in previous episodes, it is enough to mention the facial reconstruction of Gufán (the Brazilian of 2000 years) that took in one day the number of visitors of a month to the Museum Paranaense. The presentation of the bust of St. Valentine in St. Valentine of the South city (Brazil), which crowded a 1200-seat church in a town of just over 2000 inhabitants. In addition to these two facts, I can not fail to mention the reconstruction of the men of Lagoa Santa, a feat propagated in the national and international media, which, of course, drew attention to the archaeological site of the city, as well as considerably increased the number of visitors to the Museum of the Lapinha.
Views of the skull of the Lady of K'anamarka

The Lady of K'anamarka


Returning to Peru, the first project presented there was the face of the Lady of K'anamarka, whose remains were found by the archaeologist Marco del Pezo in 2004. I was invited to participate in this project by physical anthropologists Dr. Oliver Medina and Dr. Elva Torres. The work was tranquil, since Dr. Medina is a specialist in photogrammetry and passed me the richly digitized skull in 3D. From there I built the face and designed its presentation with the help of the Inca Garcilaso de la Vega University, of which I am part of the team and with whom I developed a series of projects in that country.


Some interesting events guided the presentation of the face. Initially the revelation of the face was scheduled to be made in a room with 120 seats. On the first day of the seminar where we were introduced, the audience showed up in weight and many people had to watch the event standing up. This forced the organizers to change rooms, the other day the face presentation happened in a space for 400 seats! The press appeared in weight and the news of the reconstruction became headline in the main newspapers and TVs of Peru.


The other day I was invited to visit the archaeological site of K'anamarka, where they discovered the skull. A four-hour trip from Cusco, where we met. Beyond the distance we would climb a little higher, towards 4000 meters of altitude! I feared for my breath and my stomach, but fortunately for all indications I have excellent resistance to altitude, because I felt nothing different, except for the air that was not as abundant as in the lower parts.


Arriving at the site I was treated almost like a head of state, at least it was what I felt. After a four-hour drive and in that place of clean, wonderful visual air, I could see that a delegation was already waiting for us at the entrance to the old city. As I descended, I was approached by reporters, guides and representatives of the Municipality of Espinar, who gave me some gifts, among them showy local clothes, which softened the cold and warmed the heart with so much human warmth.


Each step we took was accompanied by a series of people, all properly filmed and photographed.


After visiting all points of the site, we were treated to a delicious lunch, with delicacies from the local cuisine. The soul was fed, but the body was not yet, we did not waste time and devoured that delicacy, closing the bill with a local drink that aided in digestion.


The other day we had the great joy of seeing the enormous repercussion of the work in newsstands and national TVs. More than that, TV Latina, one of the main ones of Peru made a special matter from the facial reconstruction. The material they composed (thanks immensely to the reporter Jesus Noriega) addressed our work and gave a tremendous emphasis to tourism of the region, while showing the natural beauties and qualities of its warm people. In total there were 17 minutes of video transmitted to the whole country!


The statue of the Lord of Sipán


The facial reconstruction of the Lord of Sipán was a work begun in 2016, also in partnership with the Inca Garcilaso de la Vega University, the EBRAFOL and the Royal Tombs of Sipán Museum. That year we unveiled the face digitally and the event became news worldwide, being propagated in 27 languages!


The closing of this project took place in great style, with the printing of the bust by the CTI Renato Archer and the painting of the piece by the skilled hands of the artist Mari Bueno, award-winning Brazilian painter, whose works were the theme of exhibitions in Brazil and in other countries.


Unlike the 2016 event that took place in Lima, this was held in Lambayeque, more precisely at the archaeological site where they found the body of the Lord of Sipan. In addition to the presence of Dr. Walter Alva, the archaeologist who discovered it, the Peruvian Minister of Culture, Salvador del Solar, a former actor very dear to the population, whose management has high approval ratings, Cultural development.



I was very happy because my presence and that of Dr. Eduardo Ugaz Burga, dean of Garcilaso University was informed during the ceremony and things did not stop there. Soon after the revelation of the bust, me and the university were awarded an honor offered by the Regional Government of Lambayeque.

Like K'anamarka, the other day the newspapers and TVs stamped the presentation of the statue of the Lord of Sipan.

Conclusion


I'm kind of tired of talking about it, but research work is almost always an activity that happens away from the knowledge of the general public and the spotlight of the press. However, when this work is recognized the feeling of gratitude goes beyond the limits of the body and the smile. I am honored to promote the tourism of a region and, in a way, to make known the places where I present the faces. The joy of the conquest is only tainted, when distance myself from the great friends that I am getting on these trips.


Monday, 3 July 2017

Faces and FACCE much more than two exhibitions


I met the staff of Arc-Team in 2011, it is an archaeological research company that works mostly with free software. My first contact was through a post about photogrammetry, that is, the technique of scanning a 3D object using photographs.

Although not so distant, that year I knew little about 3D scanning, 3D printing, reconstruction of CT scans and even, almost nothing about forensic facial reconstruction.


I started almost parallel studies of photogrammetry and facial reconstruction and, thanks to the good relationship I developed with the Arc-Team staff, I was able to put these two fields together in a very nice project, the reconstruction of the face of the Taung Child in 2012.


This project was a partnership between Arc-Tem, myself, the University of Padova and the NGO Antrocom. We barely imagined future ramifications of all this.

Encouraged by the technical repercussion of this first attempt, I began to outline a new project, this time, having the archaeologist Moacir Elias Santos in the team. Together with him and supported by the Egyptian Museum and Rosicrucian, we organized the first exhibition of facial reconstruction applied to human evolution, called Faces of Evolution, which was inaugurated in 2013.

Inspired by this exhibition, the Arc-Team and the Museum of Anthropology of the University of Padova started a new venture, an exhibition focused on the human face and our ancestors of evolution. Your name: FACCE - i molti volti della storia umana.


While the Brazilian exhibition was composed of 11 posters and replicas of reconstructions, the Italian exhibition would have 27 facial reconstructions, 5 of them historical and 22 evolutionary, as well as other environments that would touch the various facets of a face, around the world, At different times and in different philosophical approaches.

Still at the end of 2013 I was in charge of reconstructing the face of St. Anthony of Padua. This reconstruction marked the whole year of 2014, since the work was news on the main TV channels in Brazil and Italy, even extrapolating the limits of those being published in 18 languages!

The FACCE show was finally inaugurated in early 2015, and in the face of its success, it was extended until the end of that year.

In 2016, using the same material from this show, with the addition of a new hominid, Homo naledi, Facce da Evoluzione exhibition was auctioned in Genoa.

Now, in 2017, I decided to make a survey, about the direct and indirect repercussion of this work, which began in 2012 and little by little took our technique to the four corners of the world. For this, I created a clipping with all the reports involving the reconstructions I worked with, as well as the languages in which they were published. Why languages? Because it would be simply impossible to organize all this based on the countries or media. By focusing on the languages, we attest to how far the work has come.


The work that had more occurrences in different languages was the reconstruction of Paranthropus boisei, carried out in 2013, 21 in total. Then, the already mentioned face of Santo Antonio and Homo erectus, both with 18 occurrences. In the table above we can see the other works and their numbers.

The total was 43 different languages, which together total 5.26 billion speakers, meaning a considerable part of the world can read the news stories with our work!


The languages with the highest occurrence were English and Portuguese, which appeared in 15 citations of the 15 selected terms. A little behind appears the Spanish (14), followed Italian (14), Russian (11) and Turkish (9).

The most impressive, was to attest that important sites such as the BBC, Discovery Channel, History Channel, National Geographic, Scientific American, Science News, Wired, RAI, Globo TV, Encyclopedia Britannica, The Washington Post, Science News and Homo naledi  and Australopithecus sediba own discoverer, Dr. Lee Berger, shared stories by way of illustration of reconstructions made for the exhibits covered in this post.

The Arc-Team group always has the mantra to share the results of the work, so all reconstruction images were donated to the Wikimedia Commons under free license. That was one of the main factors for all this repercussion.

The work does not stop here, there is much to come and many fruits will emerge as a result of research in the field of facial reconstruction of modern men and ancestors of human evolution. The knowledge that I gained in the facial approach of these fossils has helped me even in one of the areas that I work professionally, the planning of facial surgeries, as well as accident monitoring tools. It seems unlikely that such separate areas have points in common, but they are more numerous than you might think.

As a member of this fantastic team I can only say that we have achieved our main goal, which was to make our work accessible and to make it free so that as many people could use them. May the next come!

Thursday, 27 April 2017

ArcheOS Hypatia and Archeorobotics: ROS for 3D dynamic documentations

Dynamic 3D documentation is a technique we are using more and more in professional archaeology. It can be useful to map in a very fast way any kind of earth-moving work during negative archaeological controls (from wide open area to small trenches, like we did here) or to record in real-time archaeological evidences and layers during a normal excavation (like the video below).




Using this methodology during an ordinary project allows us to perform the segmentation of the 3D model directly on the field (within the software Cloud Compare), dividing each layer of palimpsestic documentation (we spoke about this problem during our presentation at the CHNT conference 2016). This solution avoid long post-processing operations, and it is ideal to spare time and money in low-budget archaeological investigations. For this reason we are evaluating the possibility to insert ROS (Robot Operating System) in ArcheOS Hypatia.
I hope to give you soon good news about the release of the next version of ArcheOS. In the meantime stay tuned to follow our research in testing new Open Source and Free Software. Like always, if you want to help in the development, just contact us in one of our channels: FaceBook, YouTube or Blogger
Have a nice day! 

Monday, 24 April 2017

ArcheOS Hypatia Virtual Globe: Cesium

Hi all,
I am starting here a series of short post to show some of the features of the main software selected for ArcheOS Hypatia, trying to explain the reasons of these choices. The first category I'll deal with is the one of Virtual Globes. Among the many available options of FLOSS, one of the applications which meets the needs of archaeology is certainly Cesium. This short video shows its capability of import geolocalized 3D complex models, which is a very important possibility for archaeologist. In this example I imported in Cesium the 3D model (done with Structure from Motion) of a a small boat which lies on the bottom of an alpine lake (more info in this post).


Soon I'll post other short videos to show other features of Cesium. Have a nice evening!

Thursday, 13 April 2017

ROS and professional archaeology

It is a long time since we wrote something in this blog, but (like every year) the excavation season leaves us few time for research. For this reason, today I want to break our silence and show some results of our latest studies regarding archeorobotics (the use and development of robotic devices in archaeology).
If you are a regular reader of ATOR, you probably know that since 2012 we are working on optical sensor to achieve a real-time 3D documentation of archaeological evidences (or any kind of data we need to acquire during our projects). Since we started to work on different kind of drones (UAV, ROV, etc...), we discover the nice universe of ROS (Robot Operating System) and SLAM (Simultaneous Localization And Mapping) algorithms. In this post we summarized our research on this topic, focusing on the use of Kinect. Currently we already used this techniques on professional projects (like large scale surveys or excavations), adapting the system to work with RGB-D devices (in underground environment or during cloudy days) or stereocameras (with direct sun light conditions). For instance we helped our friend Cristian Boscaro of IUAV to test this technology in order to document the tunnels which connect the domes of the Abbay of S. Giustina in Padua. This evening I will post a video which shows a particular use of ROS and Kinect to solve a technical problem we had on the field today. We were working to assist the excavator in doing a trench for a pipeline near the Sanctuary of S. Romedio, in difficult logistic condition. Despite the absence of archaeological evidences, the Superintendence asked us to document the track of the trench, since often what is realize during the execution of this kind of work is different from what is planned in the map. Due to the fact that too few hours were left to accomplish a documentation with GPS and total station and that this strategy would have been pretty tricky (inside the gorge of the river S. Romedio) and not so accurate (for the scattering effect of the wood), we decided to use SLAM to get a real time 3D documentation of the track and later to georeference the result on the LIDAR data which the Autonomous Province of Trento releases freely. The video below shows the final result, which completely satisfies the (high) archaeological tolerance of this project.


That's all for today! Have a nice evening!

Wednesday, 8 March 2017

The story of a chestnut-eared aracari who received a 3D-printed beak


In 1987 my family moved to the municipality of Sinop, a small city in the north of Brazil (135,000 inhabitants). We came with the hope of finding a better life in the face of the difficulties spent at that time... and we have been here for 30 years! The time passed and the affection for this city solidified in my heart, one of the great dreams that I had was to see his name appearing in Brazil and in the world. With a lot of work and dedication I was able to make my small contribution to see this happen, but the most notorious fact was undoubtedly an unprecedented project that yielded until the visit of a European news agency in this municipality: the first prosthesis of aracari in the world printed in 3D!

Background

In August of 2015 the firemen of the city of Sinop, in the interior of Mato Grosso, received an unusual call. A bird very similar to the toucan was found in the forests of the region with the broken lower beak.

Sent to the Association of Rehabilitation and Reintroduction of Wild Animals (ARRAS), the aracari (P. castanotis) can find better conditions, keeping alive and fed by specialists in wild animals.

French TV story

The news of the animal with the broken beak was posted on a local website and addressed in its content the possibility of making a prosthesis to replace the damaged structure.

Coincidentally, less than a month before our team had created the carapace of the Freddy Turtle, using 3D technology. Because of this, a number of people sent me the link and asked if I could do anything about the aracari.

CBS TV - USA

I contacted the firefighter who had discovered the animal and he put me in contact with zootechnician Dr. Paula Andrade Moreira and veterinarian Dr. Vanessa Nachbar, both volunteers in the care of abandoned animals in the region.

After talking to the two of them, I went to the place where the bird was and I met him "personally". I discovered that his name was Tuc-tuc, and that if he was docile and had adapted well to living with humans, on the other site he still had a pair of well articulated beaks that pressed without mercy the unwary who took him to examine.

Chinese TV story

At first I tried to scan the beak through the photogrammetry technique, but the process proved almost useless against the precision we needed. At that time we still did not use the dental mold making. In addition to the difficulty of raising the volume of the beak, we would need to enable the placement of the prosthesis by the specialists of our team, but all were in the state of São Paulo and bring it to Mato Grosso would be a very expensive endeavor.

German TV story

The months went by and the hope was fading, until appear the possibility of TecnoFASIPE, a computer event idealized by the faculty where I teach Computer Graphics classes (I'm also a coordinator of TecnoFASIPE). One of the members of the team of animal prostheses, Dr. Paulo Miamoto was invited to lecture at the conference. I imagined that this could be one of the necessary steps for the Tuc-Tuc prosthesis, since Dr. Miamoto was responsible for the replication of the nozzles, an accurate technique that aided the digitization of these structures. In addition he also printed the prostheses and subjected to a treatment that increased resistance and made them more pleasing to the eye.

Faced with an emerging possibility, I activated the other members of the team and I decided to sponsor one of them coming to the city. He was Dr. Sergio Camargo, respected Veterinarian, surgeon and specialist in spouts. Another member chose to come to the city on his own, Dr. Rodrigo Rabello, also a veterinarian and surgeon.

Brazilian (in Portuguese) TV story

In the meantime, I coordinated with the SEMA (a Brazilian agency that takes care of animals) specialist, Sandro Depiné, the documentation necessary for the surgical procedure to take place. I also had the honor to meet Prof. Dr. Elaine Dione, Veterinary anesthesiologist, representative of the UFMT Veterinary Hospital in Sinop.

To close the initial coordination process, I closed with a French news agency to follow the placement of the prosthesis, ie the event would yield an international story!

Creation process and surgery

Taking advantage of the arrival of the French, I chose to insert the participation of local experts in the design of the beak. I contacted two well-known dentists in the city, Dr. Paulo Bueno and Dr. Bruno Tedeschi. For 3D printing I got the support of a former student named Cristian Saggin. I still got a sponsorship for the stay of one of the specialists, thanks to the generosity of a local company, the Centauro Systems.

It was insane work, at the same time as I recorded with the staff, I also helped coordinate the project. All the steps went well, we were able to replicate the prosthesis making technique here in Sinop, in the interior of Mato Grosso, just as we did in São Paulo.


The first step was to create a replica of the beak. The structure was immobilized and a negative was generated, without the need to sedate the animal. This negative was filled with plaster and then destroyed for the retort to be removed. The replica received a series of tracings for the photogrammetry algorithm to digitize it accurately.

The replica of the beaks made in three stages: 1) Full beak (closed to have an idea of the structure), 2) Top nose (rhinoteca), 3) Lower nozzle or gnatoteca.

This is necessary, cause  we align the prosthesis in relation to the nozzle with the complete structure. By the way, the prosthesis is created using as reference a donor, in this case, the corpse of an aracari of the same species.

The surgery was performed on April 17, 2016, successful, allowing the animal to feed naturally as soon as recovered from anesthesia.

Unfortunately not everything went as expected. A macaw, Gisele, who would also receive a prosthesis did not withstand some complications during surgery and died. I was very sad at that moment and this feeling was captured in the story edited by the French. Even so, we learned a lot from the process and even though the macaw has gone... it certainly helped a lot in the history of making veterinary prostheses.

Repercussion and recognition

The procedure had wide repercussion, both in Mato Grosso and internationally. The material edited by the French reporter Zinedine Boudaud was broadcast on the open TV of France and Germany. The CBS TV also presented material, the most curious being that we even heard about Tuc-tuc.

French TV story: http://sites.arte.tv/futuremag/fr/animaux-bioniques-futuremag

German TV story:  http://sites.arte.tv/futuremag/de/bionische-tiere-futuremag

CBS TV: http://www.insideedition.com/headlines/15976-toucan-found-injured-on-roadside-gets-new-3d-printed-beak

Matéria em chinês: https://v.qq.com/x/cover/sgkr3aihie62aiz/f019597c45k.html

Portuguese TV story: http://g1.globo.com/mato-grosso/mttv-2edicao/videos/t/edicoes/v/equipe-desenvolve-protese-com-impressora-3d-e-salvam-vida-de-aracari-em-sinop/4981097/

Portuguese text story: http://g1.globo.com/mato-grosso/noticia/2016/04/ave-abandonada-com-bico-mutilado-recebe-protese-de-impressora-3d.html

The site of the University of Darmstadt in Germany, the institution that developed the algorithm used in the scanning of the beak made a post about the prosthesis of the aracari: https://www.informatik.tu-darmstadt.de/de/aktuelles/neuigkeiten/neuigkeiten/artikel/schnabel-aus-dem-3d-drucker-mit-technologie-aus-darmstadt/


As soon as the work was finalized, we received of a motion of applause offered by Sinop's City Council, a project of the councilor Fernando Brandão.

For all of us, it was a tremendous honor, to see Sinop emerging in the world and bringing good news, tied to scientific scholarship.

Acknowledgements

We thank all those who helped in the project, enabling it and allowing one more life to find fulfillment.

Roberto Fecchio (Veterinarian, leader of the Avengers), Profa. Dr. Elaine Dione (Postdoctoral Veterinary Surgery with Emphasis in Veterinary Anesthesiology), Fátima Escalabrin (Psychologist), Sandro Depiné (Sema), Anderson Eduardo Wagner (Green Action Institute), Cris Cesco Diel (Biologist, Specialist in Environmental Law And Sustainable Development), Ailton Santiago (Forest Park), Prof. Dr. Paula Moreira (Zoothecnist, PhD in Biological Sciences in the Animal Behavior Area), Dr. Vanessa Nachbar (Veterinary Medicine), Cristhian Saggin, Dr. Everton da Rosa (Bucomaxillo Facial Surgeon) Dr. Paulo Bueno (Dental Surgeon),Dr. Bruno Tedeschi (Dental Surgeon), Raissa A. Chagas Martins (Veterinary Medicine), Dr. Luiz Fernando Bianchini Venâncio (Veterinary Medicine), Patricia Ribeiro Barroso (Veterinary Medicine), Dr. Raquel Giachini Dr Rodrigo da Costa (Veterinarian), Lis Caroline de Quadros Moura (Zootecnista), Deivison Pinto (President Fasipe President), Adriano Barreto (ADS Course Coordinator - Fasipe), Klayton Conçalves, Cesar Rosenelli, Rodrigo da Costa, Jamerson (Reporter), Desirêe Galvão (Reporter), Andressa Godois (Reporter), Zinedine Boudaoud (Reporter), Melice Losso (Reporter), Laércio Romão (Reporter), Edneuza Trugillo and Luíza Trugillo.

Tuesday, 28 February 2017

The 3D facial reconstruction of Saint Valentine, the patron saint of lovers!


Follow the details about the facial reconstruction of Saint Valentine, the patron saint of lovers who had his face revealed and whose news was published in 32 languages!

Project coordination and initial data capture: Dr. José Luís Lira
3D digital scanning, recovery and digital facial reconstruction: Cicero Moraes
Forensic consulting: Dr. Marcos Paulo Salles Machado

3D printing: CTI Renato Archer
Painting on the 3D bust: Mari Bueno

Background


I met Dr. José Luís Lira, still in 2014, on the occasion of the presentation of St. Anthony's face. As a hagiologist, a specialist in the life of the Saints, he introduced me to a series of relics around the world that could be reconstructed.

The first result of our partnership was the reconstruction of the face of St. Mary Magdalene in 2015, made from her supposed skull, present in the Basilica that bears the name of the saint in the French city of Saint-Maximin-la- Sainte-Baume.

Months later, almost at the end of the year, we present another result, the facial reconstruction of Santa Paulina.

The reconstrucion was news in 32 languages. See the details here.

Dr. Lira has always had free transit among religious, even because he studied in a seminary to be a priest, although after he left it, graduated and built his professional career in the legal area (academically is a university professor, Ph.D. in Law from the Università degli Studi di Messina, Italy). In addition to the connection with the Catholic Church, he published several books on saints and also belongs to the Equestrian Order of the Holy Sepulcher of Jerusalem, whose origins date back to the First Crusade when its leader, Godfrey of Bouillon, freed Jerusalem. It is currently an International Public Association of believers, with canonical and public juridical personality, constituted by the Holy See and the Holy Father is responsible for the Order (Source: Site of the order).

Chinese TV story

To this day I had worked with the facial reconstruction of seven saints (Anthony of Padua, Mary Magdelene, Saint Sidoine of Aix, Rose of Lima, Martin of Porres, Jhon Macías, and Paulina Visintainer) and two beats (Luca Belludi and Ana de los Ángeles Monteagudo). From the beginning of our partnership we plan to write a book about these works, treating both sides of the coin, the technical and the religious.

Ukrainian TV story

On the occasion of the reconstruction of the face of St. Mary Magdalene we had the opportunity to exercise our aspirations, as we wrote and published a book about the works with the saint.

We came in contact with a number of relic-bearing churches in order to rebuild the face of all of them. However, contacting via the internet has not always proved to be a very effective option, either because of the high number of e-mails ignored, the only “OK” after many attempts (Mary Magdelene) or the categorical "no".

Vietnamese TV story

Among the series of unanswered emails was the one sent to the Basilica of Santa Maria in Cosmedin, located in Rome, Italy. According to our studies, in that church there was a skull belonging to St. Valentine Martyr.

Turkish TV story

Many sources attribute this relic to the religious who lived between 170 and 270 AD. C. and that gave rise to the day of the lovers, but the history of the saint is surrounded in a lot of mystery, as it quotes the own magazine História Viva (Brazil):

"However, the whole saga of the martyr is uncertain. There are at least three religious under the name of Valentine, two of them buried in Rome and a third who would have been killed in Africa. The Catholic Church itself, in 1969, stop celebrating the saint's birthday by considering its origins - and even its existence - uncertain."


In our research the only skull that appears is precisely this, one of the three mentioned in the text and one of the two that have the buried bodies in Rome.

Important information: When searching for "St Valentine skull" in Google image, the results returned only show the skull used in this reconstruction work.

Screenshot with search result in Google Images
When traveling to that city, during the canonization of Blessed José Sánchez del Río, Dr. Lira decided to visit the basilica where the remains of the saint (Valentine) were located. Perhaps, conversing personally with those responsible for the guard, the chance to rebuild the face was greater. As he related, on the thirteenth, he thought of going to Venice, but at dawn he had severe pains and cramp in his right leg, he decided to stay in Rome, because, besides everything, it was raining. Staying very close to the Vatican, he went to St. Peter's Square to see the preparation for the canonization and thinking he could go "in search" of St. Valentine. After lunch in the vicinity of San Pedro, he returned to the Square and to surprise, a lady who sold holy images offered him one of Saint Valentine, with the same image that is stained glass of the Basilica of Terni. Excited, he decided to go to the basilica where the saint's relic was.

Holy image received by Dr. Lira

Work in loco


On arriving at the Church on October 13, 2016, Dr. José Luís Lira first walked around the Church, took some photos and in the sacristy explained to the secretary of the Rector of the Basilica the reasons for the visit and, after waiting, Was attended by Fr. Mtanious Hadad, the Rector himself. After a meeting, it was agreed that the hagiologist would come back the other day, the 14th, to take pictures of the skull at 11 am.

Dr. José Luis Lira photographing the relic of St. Valentine in Rome, Italy
At 11 o'clock on the morning of October 14, 2016, Dr. José Luís Lira had access to the altar where the relic of Saint Valentine is found and spent about 40 minutes photographing it. So that the photos could be made with tranquility the main door of the Basilica was closed, following the determination of the Father Hadad, nevertheless, the faithful could have access by the other entrances. Some even photographed him doing the work.

An interesting fact about Dr. Lira's participation in data collection is that he had never done this before. The photographs are usually taken by a person trained in the technique and to prevent something from going wrong he proceeded with the works doing 251 photos of the reliquary!

Term of authorization for facial reconstruction
Some of the photos used in the photogrammetry process
From these images were selected 35 for the digitization of the skull and 9 for the reconstruction of the reliquary, which served as a reference scale, since its measurements were taken by Dr. Lira at the time of the photographs.

Previous digital work


This phase of the work was developed by me and includes everything from the scanning of the skull to digital facial reconstruction.

Three-dimensional digital model scaled in 1: 1 scale
Two scans were required, one focused on skull scanning and another scanning the reliquary structure, which would serve as a reference for scale, since the forogrammetry technique does not automatically resize the objects. The dimensions of the area with the glass were of 20x36 cm, according to the measurements of Dr. Lira. To scan the skull the system used was the Recap360 from Autodesk® and to scan the reliquary was chosen by Agisoft® Photoscan©. The positioning of the cameras in 3D was achieved through the PPT-GUI software.

Region of the skull scanned in 3D without texture (color)
In order to continue with the work of recovering the missing parts of the skull, the initial files of the scan were sent to the IML expert from Rio de Janeiro, Dr. Marcos Paulo Salles Machado, who analyzed the material and inferred that was a male. It is important to note that Dr. Machado received the files with the text "Valentine" hidden, and without any preliminary information about the skull, so that the analysis was done blindly.

Remaining digital vs. Recovery of the skull in various points of view
The 3D scanning algorithm, though very good, was able to reconstruct only one region of the skull. Partly because the camera used was in automatic mode and did not balance the illumination very well and partly because the skull was packed in a reliquary that significantly limits the scanning of the entire surface by the photos.

To recover the missing part, I used a skull from my 3D digital collection. The piece was chosen with the most compatible form the anatomy of the relic. Some adaptations have proved necessary until the "digital remnant" is coupled. It was necessary to exclude, in the other skull, the region that coincides with the remainder so that the model was unified in only one object.

Photography vs. Imposition of the recovered digital skull (with jaw)
A fim de recuperar as partes faltantes respeitando o volume real do crânio, as referências das câmeras virtuais, posicionadas através do PPT-GUI, foram usadas nas 9 fotos mais distantes e nas 35 fotos mais próximas. Com esta característica a anatomia foi reconstruída com pequenas intervenções manuais, recuperando a região que não foi automaticamente digitalizada pelo processo de fotogrametria.

Reconstrução facial 3D digital


Com os dados do gênero (masculino), ancestrais (europeu) e faixa etária (+ 55) fornecidos pelo Dr. Marcos Paulo Salles Machado, pude iniciar a reconstrução facial 3D.



Before any modeling work, it is necessary to place the soft tissue thickness markers. These are pins with different heights at different points of the skull. These heights correspond to the thickness of the soft tissue (skin, muscles, etc.) at the points where they were fixed, based on a mean raised from a population mean, in this case, we chose data acquired in the measurement of hundreds of individuals Male, with European ancestry and over 55 years old. More details about this process can be found in the free ebook "Digital Facial 3D Reconstruction" (in Portuguese) through this link.

When tracing a line within the limits of the soft tissue thickness markers, and respecting the nasal projection, we have a basic outline of the face profile.


The main facial muscles are then modeled to aid in reconstruction with an anatomical parameter.


Once the muscles are set up, the next step is to proceed with a low-resolution digital sculpture, so as to shape a base of the face, using as reference the muscles and especially the soft tissue thickness markers. The basic sculpture is finished when the markers are all hidden by the mass corresponding to the soft tissue.


The region of the face undergoes a process called retopo, where a more organized 3D mesh involves the base sculpture and receives more data, such as the ears and muscles.


The 3D mesh is pigmented by projection of mapping and digital painting, to give the colors of the face.


The 3D mesh is pigmented by projection of mapping and digital painting, to give the colors of the face.


The next step is to implant hair and the beard digitally, in order to finalize the composition of the face, according to the age group.


Finally the reconstruction is finished, with the placement of the clothing.


The properly pigmented, dressed and haired model is then finalized. It goes through a process called rendering, which provides light, shade and more quality to the image.

According to remarks on the clothing punctuated by Dr. Lira, St. Valentine uses the pallium of current use of the cardinals and archbishop, since it was common at the time being larger than the current. The image is in a tunic, an official liturgical vestment of every priest during the celebrations he presides over. The tunic is a white robe and hides the individuality of the priest, so that the Christ presiding over the Sacrifice can be perceived in him. The tunic reminds us that the priest who, before being ordained was baptized with Christ, now symbolically covers the new man (to preside over the Eucharistic Sacrifice). Because it is a holy martyr, it was decided to use the red color for a kind of chasuble, a solemn vestment proper to the priest (deacon can not use it), which has no seam on the sides and is used in Sunday Masses and days Holidays. Martyrdom is the most primitive form of recognition of the sanctity of a Christian, and therefore a reason for celebration, so we chose this dress, defined by the expert who knows the subject.


An infographic is generated so that the interested ones can understand how the work was developed and sent to the Father Mtanious Hadad, who gave authorization for the facial reconstruction, for its appreciation.

Media Projection

The reporter Janet Tappin Coelho, like other opportunities, was chosen by the team to write exclusively on the process of facial reconstruction of the Saint. On February 13, 2017 the first report was published on the website of the British newspaper Daily Mirror and on the 14th in the The Mirror. Quickly the news won the world being replicated, so far, in 32 languages!

Conclusion

Coincidentally the facial reconstruction was finalized on January 14, exact three months after the start of the project and a month before the feast of the Holy Patron Saint Valentine.

For all who participated in this endeavor the result was fantastic. This is the tenth Catholic figure we had the honor of rebuilding and now we have a good basis to continue with the project, both in our written work and in the sequence of this job, whose next steps are the 3D impression of the bust (CTI Renato Archer) and later the painting done by the artist Mari Bueno.

Coming soon!

Monday, 30 January 2017

Digitizing the excavation

The 21st Conference on Cultural Heritage and NEW Technologies (CHNT 21, 2016) took place in Vienna  the first week of November 2016. In that occasion we gave a presentation entitled "Digitizing the excavation. Toward a real-time documentation and analysis of the archaeological record". Today I found the time to publish it in our blog, to share our research regarding this topic and in particular some interesting projects of "archeorobotics" we are working on.
Here below you can see the video of the presentation, done like always with the open source software impress.js and Strut...



... and here is a short description of each slide:

SLIDE 1

The title (strictly related with Digital Archaeology in general)

SLIDE 2

A short presentation of Arc-Team

SLIDE 3

All the work has been done thanks to Free/Libre and Open Source Software. In order to keep going on with our research regarding archaeological methodology we need the source code!

SLIDE 4

The fundamental schema of the archaeological cognitive process elaborated by G. Leonardi in 1982. The schema shows the progressive reduction of the informations regarding human actions before and during the archaeological excavation (Human activities --> Traces on the soil --> Natural and anthropological degradation of the record --> archaeological excavation --> archaeological documentation) until the interpretative knowledge starts recover information during the post-excavation stage (with analitical data interpretation and reconstructive hypothesis)

SLIDE 5

A practical example of the schema from the site of Torre dei Sicconi in Italy (a medieval castle):
1. Human activities (summarized in the building of the castle, the medieval battle and the destruction of the main structure and the controlled explosion during the Great War)

2. Traces on the soil (summarized in the evidences of the battle, of the controlled explosion and of recent agrarian activities, while just negative layers were found regarding the construction of the structure)

3. Natural and anthropological degradation (summarized in the battle, the explosion, the agrarian activities and the normal natural dynamics)

4. Archaeological excavation (the most destructive investigation: in Torre dei Sicconi all the layers concerning the tower and the main central building has been removed by this activity)

5. The importance of archaeological documentation comes from distructive analysis (excavation). Being a long term project, Torre dei Sicconi was documented both with traditional and digital methodology

6. Data analysis. During this stage our knowledge of the site started to grow again. In this case both archaeological and historical techniques have been used

7. Reconstructive hypotheses represent the maximum increase of our (interpretative) knowledge of the site. For Torre dei Sicconi this stage has been achieved just for the central part of the castle (tower and main building)

SLIDE 6

The archaeological excavation is the most critical (destructive) stage of our knowledge regarding a site.

SLIDE 7

Arc-Team's excavation strategies:
1. increasing the amount of information registered decreasing the time-consuming operation of archaeological documentation
2. on-site direct observation for a better interpretation, avoiding at the same time any kind of data selection
3. moving the lab into the field (chemical and physical analyses)

SLIDE 8

A milestone of our research: in 2006 the development of the "Metodo Aramus" gave us a better (more precise and accurate), faster and corect (equalized) 2D digital documentation with FLOSS.

SLIDE 9

Another milestone. Between 2008 and 2009 the migration from pure photogrammetric software to SfM and MVSR methods (through the development of a GUI for +Pierre Moulon's application  Python Photogrammetry Suite) gave us better and faster 3D digital documentation

SLIDE 10

Even today we still use a combination of 2D and 3D techniques to meet different requirements of various archaeological projects

SLIDE 11

2D digital documentation through GIS is fast enough for on site interpretation during emergency excavation

SLIDE 12

A software like +QGIS  allows a direct interpretation on the field without the necessity of long post-rpocessing

SLIDE 13

3D documentation gives better results, but needs longer processing time (even if it does not need long data acquisition on the field, which is always performed)

SLIDE 14

We achieved (a lower quality) 3D data acquisition which has the fundamental characteristic of being real-time, thanks to open hardware (archeorobotics)
SLIDE 15
Our experience in archeorobotics dates back to 2006 with our first prototype of UAV, which could be use professionally just in 2008.

SLIDE 16

Currently or archeorobotics research regards our last prototype of Archeodrone (a UAV specifically designed for aerial archaeology)...

SLIDE 17

... some CNC machines and, above all, the Fa)(a 3D, a 3D open hardware printer which without any kind of modifications was able to satisfy our archaeological needs (like 3D printing casts of unique finds or exctract and print DICOM data form x-ray CT scan)...

SLIDE 18

... and the ArcheoROV, the open hardware Remotely underwater Operated Vehicle which we developed with the +Witlab Fablab 

SLIDE 19

Some pictures of the first test of the ArcheoROV

SLIDE 20

A first step into 3D real-time documentation through SLAM (Simultaneous Localization and Mapping) techniques has been done with the open source ROS (Robot Operating System) and RTAB-Map via Kinect...

SLIDE 21

... and tested for 3D real-time documentation in wooden areas (where SfM and MVSR or laserscab would have been too slow), reaching in almost one hour of work a model (with real dimension) of 75000 points.

SLIDE 22

A benefit of archaeorobotic system like these (which are ROS capable) is the possibility to change the sensor in order to adapt the hardware to different situation, using monocular or stereo cameras (for odometry) as well as LIDAR or SONAR devices.

SLIDE 23

Another benefit is the wide range of possibilities offered by the different open source software (e.g. RTAB-Map, LSD-SLAM, REMODE, Cartographer, ecc...)

SLIDE 24

Currently the precision/accuracy level of a real-time 3D archaeological documentation cannot be compared with the results achieved with post-processing through traditional SfM - MVSR systems, but there are good prospects for improvement.

SLIDE 25

Nowadays, basing on our professional experience, the best use of such devices seems to be during extreme operations, such as high mountain archaeology, glacial archaeology, underwater archaeology or speleoarchaeology

SLIDE 26

Another important step to improve the reaction time of professional archaeology, in order to avoid errors during the critical stage of the excavation, is the possibility to perform some basic archaeometrical analyses (chemical and physical) directly on the field.

SLIDE 27

Considering the composition of any archaeological layer based on two different elements, the skeleton (macroscopic) and the fine earth (microscopic), it is obvious that different analyses can be performed in different work environment.

SLIDE 28

For instance, in the case of the skeleton, a fast petrografic (ontoscopic) analysis can be easily performed directly on the field (defining allogeneic elements), while further (more specific) investigations need an equipped laboratory.

SLIDE 29

Also in the case of fine earth, some raw descriptive analyses can be performed on the field, while laboratory investigation can reach very detailed results (e.g. with the Scanning Electron Microscope).

SLIDE 30

The field analysis of the fine earth is more problematic (compared with the skeleton) the most common test (e.g. the Soil texture by feel) are anametric and subjective
SLIDE 31
For this reason, archaeometric test are the better choice (e.g the sedimentation test)

SLIDE 32

The sedimentation test on the field can be improved with basic physical analysis (e.g. considering the Stoke's Law in order to define sand, silt and clay by the tme they need to sediment)

SLIDE 33

Another implementation on the field for the sedimentation test is the possibility to directly store the data into a PostreSQL/PostGIS database (through some specific fields of the archaeological recording sheet), using the open source application geTTexture.

SLIDE 34

An example of the use of geTTexture

SLIDE 35

Other archaeometric test which are simple to perform directly during the excavation are based on basic chemical analyses, and specifically with the quantification of compounds like phosphates or nitrates.

SLIDE 36

Moreover, with some simple workarounds, it is possible to turn anametric (boolean) analyses of carbonates or organic substances, into metric (quantitative) observations.

SLIDE 37

The Archaeological excavation is a destructive process, subject to fatal (not reversible) errors. Moreover the reduced time and budget in professional and emergency archaeology increase stress conditions during decision making stages.
Real-time 3D mapping can speed up data interpretation, avoiding data selection on the field, while on-site chemical and physical analyses (geoarchaeology and archaeometry) can define a better (data-driven) digging strategy.


I hope this presentation can be useful. Have a nice day!

Sunday, 29 January 2017

Gufan, the 2000 year old Brazilian


Background


In 2013 I visited the Paranaense Museum with Dr. Moacir Elias Santos. At that time I was in Curitiba to present the face of an Andean mummy, on the occasion of the II Happy Mommy's Day.
Panel printed with Gufan's facial reconstruction process - Photo: Karen Becker
Dr. Moacir had told me that I would be surprised by the rich collection of the museum. In fact I was surprised, every room I could see pieces and more pieces, which together made up a historical panel, not only of the state of Paraná, but of Brazil and even of other countries.


TV story about the facial reconstruction of Gufan and the use of virtual reality


After dazzling myself with old vestments, pictures, coins and infographics, we arrived at a room where the bones of an abogirinal child of a few hundred years were being presented.

I wasted no time and took a series of photographs of the skull, already with the intention of digitizing it in 3D and later reconstruct it.

As soon as I returned to Mato Grosso, that's exactly what I did. I showed the work to Dr. Moacir and he appreciated it, but he asked me to contact those responsible for the museum so that they would know about the work I was doing, after all, I had not agreed with them to use the pictures.



I called the museum, explained the situation and the clerk transferred me to Dr. Claudia Parellada. Undoing my initial fears, which foresaw a future dominated by coercion, she was interested in the idea of reconstruction and not only allowed me to post the work on my site, but also raised the possibility of building a partnership, since she relied on others skulls, some of them over a thousand years old.

The facial reconstruction project


The story does not stop there. In 2008 I traveled to Curitiba for the first time at the invitation of my friend Alessandro Binhara, to lecture on Blender and computer graphics at the educational institution he was working on. The talk was given and we agreed to one day we would work on a project together.

Steps of facial reconstruction

Nine years passed and the opportunity appeared. I closed an in-house workshop with Mr. Binhara, Beenoculus staff, and my other buddy, the developer Sandro Bihaiko. The plan was to bring together a number of experts and study some applications using virtual and augmented reality.

In the meantime I realized that it was a good opportunity to resume the discussions with the staff of the Paranaense Museum and I went back to talking with Dr. Claudia Parellada and Dr. Renato Carneiro, director of the institution.


I learned then that they had a rich collection of skulls, and among them was Gufan, a 2000-year-old proto-Jê autochthon. The name Gufan comes from the Kaingang language and means "ancestor". For the integrity of the anatomical piece she proved to be the most apt to be reconstructed.

Dr. Parellada and Dr. Carneiro collected all the data about Gufan, as well as sent me a series of photos that served as a basis for 3D scanning by the photogrammetry technique. Shortly afterwards I had the skull digitized and the reconstruction work started.

Facial reconstruction


The process of facial reconstruction went smoothly with nothing new in relation to the other works. Starting with the positioning of soft tissue thickness markers, I then went through digital sculpture, retopo (simplification of the mesh), mapping and pigmentation, and finally the placement of hair and generation of images.

The base of facial texture
It must be documented that I received the mapping references with an international flavor. My friend Santiago González photographed one of his students in Lima, Peru and sent a series of images to be used at work. I take this opportunity to thank him and the student!

I had to resort to this solution because here in my city I did not have any individuals with indigenous traits to take pictures. I thought about it a little and turned to my Peruvian friends, since in that beautiful country, a considerable part of the population carries the appearance of its historic and warrior people.

The Virtual Reality


With the face of Gufan reconstructed I traveled to Curitiba where I would meet with the team to carry out our project. The works took place at the premises of Beenoculus, a virtual reality glasses assembly company and interactive content.

The excitement was so great that our workshop was just about creating a presentation for Gufan. Beenoculus donated a state-of-the-art goggles, my friend Binhara came in with cutting-edge machinery, a generous video card for the application to roll without choking, and Sandro Bihaiko wrote the application with the help of local officials.

While the presentation was developed on one side, we moved to the Paranaense Museum to see if everything was right with the space where the revelation would be held. A panel was assembled illustrating the stages of facial reconstruction, we talked about the distribution of the elements and seats and everything was right, just wait for the big day.

The face presentation

The presentation of the face of Gufan was held on January 24, 2016. Initially we expected 20 to 30 people, but I articulated a rapprochement with the press in order to supplant that number without much pretension, of course.



Before traveling to Curitiba I composed a release with the digital technology personnel and the management of the Paranaense Museum. I also telephoned several TVs and newspapers in the city and soon faced the biggest newspaper (Gazeta do Povo) and the biggest TV (RPC, Globo) showed interest in the agenda. The result of all this has been translated into two newspaper covers and a 7-minute story with two live insertions in the midday issue of January 24.

And during the presentation, instead of 20 or 30 people came 170 according to the organizers! A lot of people had to attend the two lectures standing. Total success!

Acknowledgment


I just have to thank everyone who made this possible: Claudia Parellada, Renato Carneiro, Alessandro Binhara, Sandro Bihaiko, Anelise Daux, Junior Evangelista Terrabuio, Rawlinson Terrabuio, Matheus Dalla, Victor Ullmann, Amilton Binhara, Adelina Binhara, Lucas Gabriel Marins, Durval Ramos, Angieli Maros, Fernanda Fraga, Keyse Caldeira, Caroline Olinda Everton da Rosa e  Karen Lisse Fukushima.

Not forgetting to mention the companies and institutions involved: Paranaense Museum, Azuris, Beenoculus, State Secretary of Culture of Paraná, Government of Paraná, Arc-Team Italy and all the press.

I hope from the bottom of my heart that this partnership continues and that good news the future holds. A big hug and thank you for reading!

BlogItalia - La directory italiana dei blog Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.