This is pretty cool as far as tech goes, but also seems rather ridiculous practically. Productivity with a HMD will likely amount to a lot more than the same 2D dynamic images we already have(screens) being placed arbitrarily in 3D space. What will it look like instead? one may ask, to which I have no definitive response.
What we have here seems like an extrapolation of what we have now, which may prove fruitful if we have nothing else to go off of (and is the nature of incremental progress). If I had many more monitors I'd place a class (or any other abstraction) on every screen, so maybe every class will have its own 2D plane of text and they'll be organized semantically & dynamically in 3D space. Also resolution here needs to be really really high. Idk, just interesting food for thought.
As you say, it's an interesting tech demo (which looks like it would be even more fun if you coupled it with a physics engine btw), but not particularly practical.
The way I could see it working though (without a significant change in OS UI) is by arranging your 2D desktop across multiple virtual 2D screens in 3D space, ie a bank of monitors angled towards you. You could use a conventional keyboard and mouse to navigate the 2D space (with perhaps mouse movement assisted or replaced by hand/head/eye tracking), and drag windows between screens, set programs to open on certain ones, with full screen clipping to screen edges - all basically as many OSes do already.
But because they're virtual, you could resize, split and merge screens, curve large ones, have ones which float in front of your vision to use for toolbar windows and HUDs. You could even use existing technology like VMs or VNC to use multiple OSes at the same time.
Mount your keyboard and mouse to a swivel chair which tilts, and you could comfortably have a 360 degree working area (assuming you can touch type) 4 or so screens deep, which would put traders' setups to shame (and at a fraction of the price). Throw in some panoramic backgrounds and you can move your office to a forest or a beach. Take it further you could even set up some sort of virtual office, being able to virtually get up from your desk and visit the workspaces of remote-working colleagues and friends to collaborate.
The exciting thing is that none of this is a massive leap from where we are now, and it would map pretty seamlessly to the software and UI we already use. The main thing holding it back would seem to be the resolution of 3D goggles, but with 4k rising, even that can't be too far off.
What we have here seems like an extrapolation of what we have now, which may prove fruitful if we have nothing else to go off of (and is the nature of incremental progress). If I had many more monitors I'd place a class (or any other abstraction) on every screen, so maybe every class will have its own 2D plane of text and they'll be organized semantically & dynamically in 3D space. Also resolution here needs to be really really high. Idk, just interesting food for thought.