A Canadian company called EMR Laboratories that has developed a stereoscopic 3D camera for use for FPV flying with remote controlled planes and helicopters a few years ago, the product is called 3D Cam FPV, has recently finished the crowdfunding effort for their new product called Transporter3D. This device consists of an improved version of their original 3D Cam FPV for the capture of both 2D and 3D video with interaxial distance of the two camera lenses the same as the normal human inter-ocular distance to generate a realistic 3D experience. This camera is placed on a remote controlled plane, helicopter or a quadcopter, though other RC vehicles are Ok as well and the video feed can be transmitted via a wireless link to the Transporter3D processing board that can process and output the video in a format that can be viewed directly on the Oculus Rift. This way the Transporter3D should be able to provide one of the most realistic FPV experiences for use with remote controlled models as commapred to other FPV solutions already available.
The backers of the Transporter3D’s indiegogo campaign should start receiving their units in December and probably early next year we are going to see the product also available for purchase. The price for backers of the project for a Transporter3D was $599 CAD and for the 3D-Cam module $299 CAD, but this does not include a Rift and a wireless video transmission solution, so for the complete solution you are looking for something that will cost you about $1500 USD.
ShadowPlay is an extra functionality that allows the owners of compatible Nvidia Kepler-based graphic cards to take advantage of the built-in H.264 encoder to record gameplay video with hardware acceleration directly into small in size MP4 video files. ShadowPlay is a part of the GeForce Experience software that now comes as a part of the Nvidia video drivers, and although it is still in Beta stage it looks quite promising. And while ShadowPlay was introduced last month with the release of the GeForce Experience 1.7 software I still haven’t been able to try the software, but now I can and since Nvidia just released a new GeForce 331.82 WHQL video driver that comes with an update to GeForce Experience 1.7.1 it is time to try out this feature. Aside from the new version of the Geforce Experience software the new video drivers also come with a 3D Vision profile for the game Assassin’s Creed IV: Black Flag and it is rated as “Good” for playing in stereo 3D with 3D Vision setups.
Looking at the ShadowPlay interface you can easily see that it is designed with the normal users in mind, by providing you with a simple and easy to understand clickable buttons for configurations. But more advanced users like me will miss some simple things like an option to remap the default ALT + F9 key combination for manual start/stop of the recording for example or an option to control the recording resolution or framerate and so on. Hopefully Nvidia is going to add some more extra controls for the more advanced users as well with upcoming updates.
What I still haven’t mentioned regarding ShadowPlay is if ti supports recording of stereoscopic 3D gameplay videos as this is something that people playing on 3D Vision setups actually do need and can appreciate. Officially before the release of the ShadowPlay feature Nvidia did not say that it will have stereo 3D support, and now that the software is available still no official 3D Vision support. The good news is that ShadowPlay can actually already record stereo 3D gameplay videos, but with one important thing to note – the 3D video you get is also in 1920×1080 resolution meaning that it is essentially recorded in Half Side by Side format (half horizontal resolution per eye). Not that this is a bad thing compatibility wise, but it would’ve been nice if the user can select between Half SbS mode and Full Side by Side (maybe limitation of the hardware H.264 encoder?). FRAPS for example as the only other gameplay video capture software with stereoscopic 3D video recording support does only output in Full Side by Side format, but the major problem with FRAPS is that the video output is hardly compressed and recording 3D video does result in a lot of gigabytes per minute of recording.
So to summarize things, the ShadowPlay feature is apparently intended for gameplay video recording of 2D gameplay, though it also supports 3D gameplay video recording in Half Side by Side format meaning that the two views are squashed in a single Full HD frame and FRAPS on the other hand produces Full Side by Side output when recording stereoscopic 3D video. ShadowPlay does output small H.264 compressed video files that are ready for online sharing, unlike FRAPS that produces multi-gigabyte files for each minute of recorded footage and recording 3D makes the files even bigger, s you need to re-compress them before uploading and sharing them. The performance drop when using ShadowPlay should be significantly less, because the hardware H.264 encoder of the video card is used to compress and output small files, unlike FRAPS where the CPU handles the minimal compression applied and the HDD/SSD needs to handle the serious load caused by the large amounts of data written each second, so the performance drop is more significant. FRAPS has more features and more controls for the more advanced users while maintaining ease of use by the normal user as compared to the way too user friendly and somewhat lacking features interface of the ShadowPlay.
And now for some tests of ShadowPlay and a comparison with FRAPS when both are set to record video at 1080p 60 fps in various conditions in the game Battlefield 4. The game was chosen because it can be quite heavy even for the fastest GPUs when you up the graphical settings to the maximum as in the current case – Ultra Quality with 4xMSAA with a GeForce GTX 780 Ti video card. Battlefield 4 is not recommended by Nvidia to be played in stereoscopic 3D mode with 3D Vision, but it is still Ok for benchmarks and recording, so take a look at the interesting results below.
– 96 fps in 2D mode playing with 3D Vision disabled in the Control Panel
– 90 fps in 2D mode with ShadowPlay recording and 3D Vision disabled in the Control Panel
– 51 fps in 2D mode recording video with FRAPS and 3D Vision disabled in the Control Panel
– 69 fps in 2D mode playing with 3D Vision enabled in the Control Panel, but turned off
– 38 fps in stereo 3D mode with 3D Vision enabled and running
– 36 fps in stereo 3D mode with ShadowPlay recording video
– 25 fps in stereo 3D mode with FRPAS recording video on an SSD drive
– FRAPS 1 min 2D – 2.8 GB
– FRAPS 1 min 3D – 4.4 GB
– ShadowPlay 1 min high 2D/3D ~ 112 MB (varies based on the content)
As you can see from the results above, by using ShadowPlay you get to loose much less FPS compared to when recording video with FRAPS and also the output video’s file size can be significantly less. Aside from that you can probably notice that Battlefield 4 does not handle that well performance wise with 3D Vision enabled, even when it is not active you still get significant performance drop as compared to normal 2D mode and that is probably half the reason why the game has a Not Recommended rating for 3D Vision and the other half is the visual issues when rendering in stereo 3D mode.
And one interesting observation that I made while testing was the fact that as long as 3D Vision is activated from the Nvidia Control Panel then when you record gameplay video with ShadowPlay you are getting a stereo 3D recording in Half Side by Side format, regardless if you have pressed CTRL+T to enable or disable the display of 3D data on the screen. So you need to be careful when you want to play and record gameplay video in 2D mode you will have to disable the 3D Vision stereoscopic 3D support form the Control Panel before running the game and for recording stereo 3D gameplay video the good thing is that you may not actually play in stereo 3D mode while recording in it.
I’ve introduced the free Gimpel3D manual 2D to 3D stereo conversion software here on the blog back in 2011, and now the author has made it an open source software by releasing the code of the project on Sourceforge. Gimpel3D is a free application that can help you convert a single 2D image or image sequence into stereoscopic 3D written by René Gimpel. The conversion to 3D is manual and the software only assists you, so do not expect automation like with an 2D to 3D autoconversion solutions that do everything with just a click of a button, with Gimpel3D however you can get much better results.
Since the original freeware release of Gimpel3D, many of the ideas presented in the software have become standard features in commercial software and as a result the author of the program has decided that there is no significant advantage to continue developing it as a stand-alone proprietary solution, although the codebase makes a nice platform for future research and experimentation. René Gimpel has released all source code for G3D under the GPL so that other stereo researchers, hobbyists, and/or professionals can build upon his existing work, and integrate/test new capabilities using the projective modeling environment.