pmdtechnologies (pmd), who is Google’s depth sensing partner for Project Tango, now is making its 3D technology available for CardBoard developers and has successfully partnered with gestigon to enable the most intuitive and immersive input for VR: touchless interaction.
pmd is sponsor of the Techcrunch Hackathon 2016 in New York City and hosting a contest. We will equip the hackers with everything they need to build new and exciting software. The development kit will enable them to use the setup for hand tracking, gesture recognition and much more. But what they will do with it in the end, is all up to them.
Together with our friends at Gestigon and Scandy, we offer a unique combination: Carnival, and a pico flexx in a CardBoard VR headset. The pmd CamBoard pico flexx 3D Time-of-Flight (TOF) camera, attached to the CardBoard, delivers depth data and a point cloud. Carnival provides a 3D gesture recognition API integrated into Unity for an immersive VR experience. Enriching 3D content comes from Scandy.
Hackers will get a Samsung S7 as development platform. Experienced Unity developers will feel right at home with the Gestigon Carnival gesture recognition Unity Asset.
Alternatively, if they want to dive deeper, they can use pmd’s Royale C++ API to directly access the pico flexx TOF camera’s depth images and point clouds, giving full freedom to create full featured 3D applications from the ground up.
Pmd’s 3D ToF technology in combination with gestigon’s Carnival SDK enables hackers to understand where users’ hands and fingertips are. Playing VR chess, re-decorating your VR living room, grap/touch/push/pull VR content and even bringing real objects into the virtual world.
At the NY TechCrunch Hackathon, developers also will be introduced to the Scandy API. Scandy will provide an alpha API for developers to query the full Scandy.co platform, which will enable access to 3D files that can be easily imported to Unity VR apps. They will also be demoing their 3D scanning app for Android. Scandy has been working with pmd to enable the pico flexx to create 3D scans in real time on Android smartphones.
"We’re absolutely excited about our first Hackathon and can’t wait to see the hackers put their hands on the technology – and into the VR world! The outcomes will be great and game-changing, that’s already foreseeable", said Jochen Penne, Director Business Development at pmd.
For more info about the pmd contest @ Techcrunch Hackathon, check out pmdtec.com/hackathon-nyc and disruptny2016.devpost.com.
About gestigon
gestigon develops middleware algorithms that work with 3D depth sensors to recognize human poses, gestures and biometrical features. Addressed markets are AR/VR headsets, automotive and consumer electronics/smart home. The software solution is recognized for its speed (low latency) and wide range of deployment, including embedded systems. The company is headed by co-founders Moritz v. Grotthuss (CEO) and Sascha Klement (CTO) and has grown to 27 employees since it was founded in 2011. The main office is located in Lübeck/Germany, with a project office in Sunnyvale/USA.
About Scandy
Located in New Orleans, LA, Scandy creates software to allow users to capture, share, and print 3D content from mobile devices. For more information, please visit scandy.co.