Human-machine interaction and artificial intelligence in space
New technology demonstrator with improved ‘sense of direction’ and ‘empathy
@AirbusSpace @DLR_en @Space_Station @astro_CIMON #CIMON #ISS #SpX19

Cape Canaveral, 5 December 2019 – A new CIMON for the International Space Station (ISS): CIMON-2 (Crew Interactive MObile companioN) lifted off on its journey into space on 5 December 2019. This modified version of the astronaut assistant has been equipped for new tasks and was developed and built in Germany. Like its predecessor, CIMON-2 will be deployed in the Columbus European research module. CIMON is a free-flying, spherical technology demonstrator for human-machine interaction and features artificial intelligence.

“CIMON-1 – our prototype – landed back on Earth on 27 August 2019 after spending 14 months on the ISS, and has now arrived at Airbus in Friedrichshafen,” says Dr Christian Karrasch, CIMON Project Manager at the German Aerospace Center (Deutsches Zentrum für Luft- und Raumfahrt; DLR) Space Administration in Bonn. The technology experiment was developed and built by Airbus in Friedrichshafen and Bremen on behalf of the Space Administration and funded by the German Federal Ministry for Economic Affairs and Energy (Bundesministerium für Wirtschaft und Energie). The demonstrator’s artificial intelligence is based on IBM’s Watson technology, with medical experts from the Ludwig-Maximilian University Hospital in Munich (Klinikum der Ludwig-Maximilians-Universität München, LMU) responsible for scientific issues. On 15 November 2018, CIMON-1 became the world’s first AI to be deployed on the ISS, working with German ESA astronaut Alexander Gerst.

“We want to use CIMON-2 to build on the successful demonstration with CIMON,” says Christian Karrasch. During its debut the first CIMON impressively demonstrated that an AI-based mobile application can function on the ISS, working together with Alexander Gerst for 90 minutes.

“CIMON-2 is expected to remain on the ISS and support the crew for up to three years,” explains Till Eisenberg, CIMON Project Manager at Airbus. “CIMON-2’s microphones are more sensitive, and it has a more advanced sense of direction. Its AI capabilities and the stability of its complex software applications have also been significantly improved. ”Another key point in CIMON’s evolution is its extended service life: “During this mission, we are also considering further steps, such as uploading the AI to a cloud on the ISS.”

This would represent a milestone in the development of a completely autonomous assistance system. According to DLR Project Manager Christian Karrasch: “When travelling to the Moon or Mars, the crew would then be able to rely on an AI-based assistance service, even without a permanent data link to Earth. One application back on Earth could be to support people with complex tasks in areas with poor infrastructure, for example.”

IBM is responsible for the implementation of CIMON’s artificial intelligence. “During its first deployment on the ISS, CIMON proved that it can not only understand content in context, but also the intention behind it,” explains Matthias Biniok, IBM project lead for the Watson AI. “CIMON-2 is taking this a step further. Thanks to the IBM Watson Tone Analyzer from IBM Cloud in Frankfurt, Germany, it is now capable of assessing the astronauts’ emotions and reacting in a manner that is appropriate to the situation, either at the request of the astronauts or when its emotional analysis is being tested as part of an experiment. This means CIMON-2 can, if required, switch from being a scientific assistant to an empathetic conversation partner.”

The CIMON ‘family’

The interactive astronaut assistant CIMON was developed and built by Airbus in Friedrichshafen and Bremen on behalf of the German Aerospace Center Space Administration (DLR) and funded by the German Federal Ministry for Economic Affairs and Energy. Watson AI technology from IBM Cloud provides voice-controlled artificial intelligence. Scientists from the Ludwig-Maximilian University Hospital in Munich (LMU) helped develop and oversee the human aspects of the assistance system. An approximately 50-strong project team from DLR, Airbus, IBM and LMU have been working on the implementation of CIMON since August 2016. The prototype of the technology experiment was on board the ISS from 2 July 2018 to 27 August 2019, and made its 90-minute debut – a world first – on 15 November 2018 with German ESA astronaut Alexander Gerst. It is no coincidence that CIMON’s name is reminiscent of ‘Professor Simon Wright’, the robotic assistant – or the ‘flying brain’ – from the Japanese science fiction series ‘Captain Future’.

CIMON – the idea

Developed and built in Germany, CIMON is a technology experiment to support astronauts and increase the efficiency of their work. CIMON is able to show and explain information and instructions for scientific experiments and repairs. The voice-controlled access to documents and media is an advantage, as the astronauts can keep both hands free. It can also be used as a mobile camera to save astronaut crew time. In particular, CIMON could be used to perform routine tasks, such as documenting experiments, searching for objects and taking inventory. CIMON can also see, hear, understand and speak. CIMON can orientate itself using its ‘eyes’ – a stereo camera and a high-resolution camera that it uses for facial recognition – as well as two other cameras fitted to its sides that it uses for photos and video documentation. Ultrasound sensors measure distances to recognise potential collisions. Its ‘ears’ consist of eight microphones to identify directions, and an additional directional microphone to improve voice recognition. Its ‘mouth’ is a loudspeaker that it can use to speak or play music. At the heart of the AI for language understanding is IBM Watson AI technology from IBM Cloud. CIMON has not been equipped with self-learning capabilities and requires active human instruction. The AI used for autonomous navigation was provided by Airbus and is designed for movement planning and object recognition. Twelve internal rotors allow CIMON to move and rotate freely in all directions. This means it can turn towards the astronaut when addressed, nod and shake its head, and follow the astronaut – either autonomously or on command.

About Airbus

Airbus is a global leader in aeronautics, space and related services. In 2018 it generated revenues of € 64 billion and employed a workforce of around 134,000. Airbus offers the most comprehensive range of passenger airliners. Airbus is also a European leader providing tanker, combat, transport and mission aircraft, as well as one of the world’s leading space companies. In helicopters, Airbus provides the most efficient civil and military rotorcraft solutions worldwide.



Contacts:

Ralph HEINRICH 
+49 (0)171 30 49 751
Email Contact 

Jeremy CLOSE 
+44 (0)7766 536 572
Email Contact  

Guilhem BOLTZ  
+33 (0)6 34 78 14 08
Email Contact 

Francisco LECHON 
+34 630 196 993
Email Contact 

Mathias PIKELJ 
+49 (0)162 29 49 666
Email Contact