Research Notes:
https://en.baydachnyy.com/2014/11/20/kinect-2-and-unity-3d-how-to/
- kinect allows to track bodies, leans, colors and so on
- But if you want to use functionality, which relates to face (emotions, face HD tracking etc.) you will need the second package – Kinect.Face.2.0.1410.19000.unitypackage.
- In order to start working with Kinect 2 SDK you need a Kinect 2 sensor
- If you have Kinect for Xbox One, you will able to buy a special Kinect adapter for Windows, which will allow you to connect existing sensor to PC. The adapter costs around 50 dollars, which is much cheaper than a new Kinect sensor. Because I already have Xbox One, I decided to buy adapter only.
- provides basic information about tracked people (up to 6) like skeleton information, leans, hand states etc.;
- AudioSource – allows to track a sound source from a specific direction;
https://peted.azurewebsites.net/kinect-4-windows-v2-unity-3d/
After installing the Kinect v2 SDK from here http://www.microsoft.com/en-us/download/details.aspx?id=44561 you can also download the supporting Unity 3D plugins here http://go.microsoft.com/fwlink/?LinkID=513177.
Kinect SDK v2.0
https://www.microsoft.com/en-us/download/details.aspx?id=44561
https://developer.microsoft.com/en-us/windows/kinect
https://www.youtube.com/watch?v=GPjS0SBtHwY
- 25 skeleton joints for 6 people > bio correct skeletal joints plus more points and rotations
- range depth ranger 50 cm to 8 m
- 4 microphone arrays
- data sources
- color
- infrared,
- depth
- bodyindex,
- body
- audio
- audio can detect direction
- steerable “cone” for focus for audio
- data is audio samples captured over a specific interval of time
- 30 fps to 15 fps based on lighting
- hand pointer gestures
- face
- detection (outputs a bounding box around face, can be visualized in color or IR)
- alignment (identifies 5 facial landmarks on the face, can be visualized in color or IR)
- orientation (returns quaternion of the head joint)
- expressions (provides classifiers for happy, left / right eye open, engagement, mouth open and mouth moving
kinect for windows SDK 2.0
https://www.microsoft.com/en-us/download/details.aspx?id=44561
kinect plugin for unity
https://go.microsoft.com/fwlink/p/?LinkId=513177
3d scan for Kinect
https://www.microsoft.com/en-us/p/3d-scan/9nblggh68pmc?activetab=pivot%3aoverviewtab
Tutorials:
http://www.voratima.com/getting-started-with-kinect-v2-unity-3d-and-c/
Microsoft Programming series for Kinect
https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/01
https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/02
https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/03
https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/04
https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/05
https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/06
https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/07