Yama Sarayji has four arms. Two of them hug him. The limbs that cover Saraji are long, lanky and robotic, and they are connected to the backpack that he wears. The hands are controlled remotely by another person who wears the Oculus Rift VR and sees the world from the perspective of Sarayjee (the cameras attached to the backpack provide a good view) and uses hand controllers to control the connected hands.
After hugging, robotic arms release Sarayji and the right hand gives him “five.”
Sarayjee is an assistant professor of the media design school at Keio University in Tokyo, leading the development of these “hands from a backpack” called Fusion, wants to find out how people could work together, manage inflicting another person's body. Although some of the actions shown by Saraji on video look silly, this device can be useful for physical therapy and remote human instructing.
What are robotic manipulators capable of?
In addition to hugging and stumbling, the operator of robotic arms can lift things or move arms next to the person who wears a backpack. Mechanical hands can be removed and replaced with belts, which bind the limbs of the carrier of the backpack, if you need to really manage his hands. The device that Sarayji created with colleagues from Keio University and the University of Tokyo will be shown at a conference on computer graphics and technology interaction Siggraph in Vancouver in August.
Attempts to create extra limbs that can be worn repeatedly, this case is not accidental, so to speak: Sarayjee and other Fusion researchers have previously developed portable limbs called MetaLimbs. The carrier controlled them with their feet.
The limbs that are operated by someone else – that is, someone in another room or another country – is different. Saraji says he wants to see what happens if someone else, in some sense, “sinks” into your body and takes control.
In the backpack there is a PC that transmits data over the wireless network between the robotic limb carrier and a man who controls limbs in virtual reality. The PC also connects to the microcontroller, which makes it clear how to position the robotic arms and how much torque to apply to the joints.
Robotic arms, each with seven joints, protrude from the backpack along with a kind of head. In my head are two cameras that show the remote operator in live mode everything that the carrier of a backpack sees. When the operator moves the head to the VR, the sensors monitor this movement and cause the head to move in response (it can turn left or right, tilt up and down, swing from side to side).
The worn system is equipped with a battery that lasts only an hour and a half . Installation is quite heavy – about 10 kilograms. Of course, while this is just a prototype.
Various buttons on the Oculus Rift controllers activate various finger functions: the operator can move the little finger, ring and middle finger simultaneously at the touch of a button, while the index finger and thumb have their own controls.  Sarayjee plans to turn his project into a real product with the help of the Tokyo Business Accelerator.