Part II : Make the camera wireless with ESP8266

  Let’s sum up what we have done so far : we ordered a pair of color tracking cameras we modified them into Infrared tracking cameras we updated their firmware to track Infrared and tested them we built a small case to give them a nice look There is one last modification we have to bring to the cameras, and that modification is a game changer : we are going to make them wireless ! Of course we won’t send the video, but the coordinates of the points the camera is tracking. In this article we are going to connect an ESP8266 Wifi shield to the CmuCam to send coordinates over Wifi. Here is what we are going to do, step by step. All you need to know for this part is how to program an Arduino (I have seen 8 years old doing it so…I’ll give you a link just in case).   The basics Connect NodeMCU to CmuCam Program the ESP8266 The basics Here we’ll go through all you need to know to make it out of this tutorial alive. First if you don’t know what is Arduino, please read about it here : Arduino. We are not going […]
Read More ›

Part III : Set Up Unity for a VR Experience

First, this isn’t going to be a long post showing you how to install and use Unity. In a few words, Unity is one of the most famous Game Engine. It allows you to develop games for PC, Android, iP Wii and almost every other platform. Unity is the most advanced Game Engine for VR (as opposed to Unreal Engine for example). Here I am just going to share some links and info to help you jumpstart your development of VR applications in unity.   The most important step is to integrate OpenCV in Unity. Then we need to communicate with the cameras using websockets. Finally we have to create a calibration sequence using OpenCV and add the tracking function. All of this had been done in the previous version using a Gateway, but I now have to translate all the code from python to C# and clean it of course. Get Unity Simply download and install the latest Unity Free version on your PC/Mac Communicate with the cameras (Websocket) The cameras communicates on your Wifi network using Websockets (each camera is a websocket server). To receive their 2D datas, your PC or phone has to be turned into a Websocket client. So we […]
Read More ›
Skip to toolbar