Blog Entry – Research and Project Updates 1

Research Notes:

https://en.baydachnyy.com/2014/11/20/kinect-2-and-unity-3d-how-to/

  • kinect allows to track bodies, leans, colors and so on
  • But if you want to use functionality, which relates to face (emotions, face HD tracking etc.) you will need the second package – Kinect.Face.2.0.1410.19000.unitypackage.
  • In order to start working with Kinect 2 SDK you need a Kinect 2 sensor
  • If you have Kinect for Xbox One, you will able to buy a special Kinect adapter for Windows, which will allow you to connect existing sensor to PC. The adapter costs around 50 dollars, which is much cheaper than a new Kinect sensor. Because I already have Xbox One, I decided to buy adapter only.
  • provides basic information about tracked people (up to 6) like skeleton information, leans, hand states etc.;
  • AudioSource – allows to track a sound source from a specific direction;

https://peted.azurewebsites.net/kinect-4-windows-v2-unity-3d/

After installing the Kinect v2 SDK from here http://www.microsoft.com/en-us/download/details.aspx?id=44561 you can also download the supporting Unity 3D plugins here http://go.microsoft.com/fwlink/?LinkID=513177.

 

Kinect SDK v2.0

https://www.microsoft.com/en-us/download/details.aspx?id=44561

https://developer.microsoft.com/en-us/windows/kinect

 

https://www.youtube.com/watch?v=GPjS0SBtHwY

  • 25 skeleton joints for 6 people > bio correct skeletal joints plus more points and rotations
  • range depth ranger 50 cm to 8 m
  • 4 microphone arrays
  • data sources
    • color
    • infrared,
    • depth
    • bodyindex,
    • body
    • audio
  • audio can detect direction
    • steerable “cone” for focus for audio
    • data is audio samples captured over a specific interval of time
    • 30 fps to 15 fps based on lighting
    • hand pointer gestures
    •  face
      • detection (outputs a bounding box around face, can be visualized in color or IR)
      • alignment (identifies 5 facial landmarks on the face, can be visualized in color or IR)
      • orientation (returns quaternion of the head joint)
      • expressions (provides classifiers for happy, left / right eye open, engagement, mouth open and mouth moving

    kinect for windows SDK 2.0

    https://www.microsoft.com/en-us/download/details.aspx?id=44561

    kinect plugin for unity

    https://go.microsoft.com/fwlink/p/?LinkId=513177

     

     

    3d scan for Kinect

    https://www.microsoft.com/en-us/p/3d-scan/9nblggh68pmc?activetab=pivot%3aoverviewtab

    Tutorials:

    http://www.voratima.com/getting-started-with-kinect-v2-unity-3d-and-c/

    https://andreasassetti.wordpress.com/2015/11/02/develop-a-game-using-unity3d-with-microsoft-kinect-v2/

     

     

    Microsoft Programming series for Kinect

    https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/01

    https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/02

    https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/03

    https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/04

    https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/05

    https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/06

    https://channel9.msdn.com/series/Programming-Kinect-for-Windows-v2/07

 

via GIPHY