The TRADR consortium has recently made public some rosbags which were shot inside the churches of San Francesco and Sant Agostino in Amatrice. These rosbags are datasets containing timestamped videos plus additional robot data.
Partners of the TRADR project (Long-Term Human-Robot Teaming for Disaster Response) met for a Joint Exercise with end users from the Joint Firebrigade of the Rotterdam harbour region (Gezamenlijke Brandweer; https://www.gezamenlijke-brandweer.nl). After similar events in Italy and in Germany in previous years, this was the first such event in the Netherlands. It took place at a firebrigade training facility on June 26-30 2017. The purpose was to test the TRADR integrated system in a realistic scenario set up by the end users and obtain their feedback on the current system functionalities and usability
The system setup consisted of ground robots and a drone. It was used by a team of firemen who received training on various components of the TRADR system throughout the week, such as UGV control, UAV control, mapping, remote arm operation, adaptive traversability and the use of the TRADR system for tactical information management.
After that the full TRADR system was used in a series of exercises, in which the team had to perform a variety of situation assessment tasks (such as i.e., mapping, searching for victims, fire, smoke and leakage detection) in an environment too dangerous for humans to access, due to danger of explosions and collapsing structures. The functionalities of the integrated system included UGV and UAV operation, map creation, adaptive traversability, realtime gas and smoke detection, tactical information management, team activity reporting and speech processing to extract information about task assignment from human team communication.
The firemen were as always very enthusiastic about the TRADR system and the potential of robot-assisted disaster response in general.
The TRADR team had shown some of this potential during the real deployment in September 2016 in the earthquake-struck Amatrice, Italy (cf. www.tradr-project.eu for more details).
On Thursday September 1 2016 a team of the TRADR project deployed two ground robots and three drones in Amatrice, Italy, to assist the post-earthquake response. The team was asked by the Italian Vigili del Fuoco (VVFF), represented by Emanuele Gissi, to provide 3D textured models of two churches: San Francesco and Sant’Agostino, both in a state of partial collapse, in need of shoring to prevent potential further destruction and to preserve the national heritage.
UGV in San Francesco church, aerial view by the UAV that also entered.
View taken by the UAV inside the San Francesco church
We entered San Francesco with two UGVs (operated by Vlada Kubelka and Mario Gianni, who were supported by Erik Zimmermann and Luigi Freda, respectively), teleoperating them entirely out of line of sight, and partially in collaboration: one UGV provided a view of the other one to enable maneuvering in very constrained space with low connection bandwidth.
View taken by the UAV inside the Sant Agostino church
UAV entering the Sant Agostino church (red circle). Two other UAVs provide a view for maneuvering (one in yellow circle, the other providing the image).
Several flights were carried out on the outside and one flight inside of each church. Entering with the drone was a tough challenge, which we managed thanks to a collaboration between three drones operated in parallel: while one drone (piloted by Hartmut Surmann who was supported by Erik Zimmermann) was entering through a hole in the roof the other two (piloted by Kresimir Dilic and Wolfgang Rottner) were providing simultaneous video feed from different angles. The mission fulfilled its goal to collect data for the construction of high quality textured 3D models. Additional great success was the fact that the TRADR team was able to arrive and deploy at the location within 48 hours from receiving the request. The VVFF has expressed high appreciation to the TRADR project for the success of the mission and the smooth operation.
The main street of Amatrice after the earthquake, state on Friday Sep1 2016.
TRADR team in Amatrice (left-to-right): Erik Zimmermann; Wolfgang Rottner; Hartmut Surmann; Ivana Kruijff-Korbayová; Emanuele Gissi;VdF fire fighter; policeman Luigi Ugliano; Mario Gianni; Kneeling: Krešimir Dilic; Václav Hlaváč; Luigi Freda; Valsamis Ntouskos; Vladimír Kubelka.
Browsable versions of the 3D models of the interior and exterior of both San Francesco and Sant’Agostino churches generated from the data collected during the deployment in Amatrice can be accessed here.
The news of deployment was reported by Reuters, although without reference to the TRADR project. Many other media took this announcement and video over. In Germnay, for example: Frankfurter Allgemeine, Sueddeutsche Zeitung, n24, Die Zeit, Stern, MSN.
