If you click on a link and make a purchase we may receive a small commission. Read our editorial policy.

MS details Kinect's "brain" ahead of CES keynote

kinect

With Microsoft expected to announce something called "Avatar Kinect" at CES in Las Vegas tomorrow, the company's posted up a lengthy piece on the Xbox blog about how to camera actually works.

The breakdown takes in the sensor itself, how it finds and recognises humans, gesture recognition and more.

The "brain" part of the equation's awesome. Apparently Kinect uses something called "multiple centroid proposals" to judge whether or not the body parts the camera's seeing and the "right" body parts.

"Each pixel of the player segmentation is fed into a machine learning system that’s been trained to recognize parts of the human body," explained the company.

"This gives us a probability distribution of the likelihood that a given pixel belongs to a given body part. For example, one pixel may have an 80% chance of belonging to a foot, a 60% chance of belonging to a leg, and a 40% chance of belonging to the chest. It might make sense initially to keep the most probable proposal and throw out the rest, but that would be a bit premature.

"Rather, we send all of these possibilities (called multiple centroid proposals) down the rest of the pipeline and delay this judgment call until the very end."

It was reported yesterday that Microsoft is readying a reveal of "Avatar Kinect" in Las Vegas tonight. The CES keynote's being streamed: get all the details on that here.

Sign in and unlock a world of features

Get access to commenting, homepage personalisation, newsletters, and more!

In this article
Awaiting cover image

Avatar Kinect

Xbox 360

Related topics
About the Author
Patrick Garratt avatar

Patrick Garratt

Founder & Publisher (Former)

Patrick Garratt is a games media legend - and not just by reputation. He was named as such in the UK's 'Games Media Awards', the equivalent of a lifetime achievement award. After garnering experience on countless gaming magazines, he joined Eurogamer and later split from that brand to create VG247, putting the site on the map with fast, 24-hour a day coverage, and assembling the site's earliest editorial teams. He retired from VG247, and the games industry, in 2017.

Comments