MS details Kinect’s “brain” ahead of CES keynote

By Patrick Garratt, Wednesday, 5 January 2011 06:29 GMT

kinect

With Microsoft expected to announce something called “Avatar Kinect” at CES in Las Vegas tomorrow, the company’s posted up a lengthy piece on the Xbox blog about how to camera actually works.

The breakdown takes in the sensor itself, how it finds and recognises humans, gesture recognition and more.

The “brain” part of the equation’s awesome. Apparently Kinect uses something called “multiple centroid proposals” to judge whether or not the body parts the camera’s seeing and the “right” body parts.

“Each pixel of the player segmentation is fed into a machine learning system that’s been trained to recognize parts of the human body,” explained the company.

“This gives us a probability distribution of the likelihood that a given pixel belongs to a given body part. For example, one pixel may have an 80% chance of belonging to a foot, a 60% chance of belonging to a leg, and a 40% chance of belonging to the chest. It might make sense initially to keep the most probable proposal and throw out the rest, but that would be a bit premature.

“Rather, we send all of these possibilities (called multiple centroid proposals) down the rest of the pipeline and delay this judgment call until the very end.”

It was reported yesterday that Microsoft is readying a reveal of “Avatar Kinect” in Las Vegas tonight. The CES keynote’s being streamed: get all the details on that here.

Sometimes we include links to online retail stores. If you click on one and make a purchase we may receive a small commission. For more information, go here.

Comments

Headlines

Avatar Kinect

  • Avatar Kinect is now available for download

    A post over at Major Nelson’s blog has confirmed that Avatar Kinect is now available for download.

  • Rumour - Avatar Kinect to launch next week in wake of system update

    WinRumors is claiming its usual Microsoft insider sources for a July 27 release for Avatar Kinect. The suite of chat tools uses Kinect to animate users’ avatars. It integrates with existing Live features to form party chats and make and upload videos. Adding fuel to speculation is Major Nelson’s announcement of Tuesday’s mysterious Xbox 360 […]