Kinect

Kinect V2

Introduction

The Kinect is a motion sensing input device. Based around a webcam-style add-on peripheral, it enables users to control and interact with their computer by retrieving joint information. Microsoft enables a non-commercial Kinect SDK for gestures and spoken commands.

Description

The device features an "RGB camera, depth sensor and multi-array microphone running proprietary software, which provide full-body 3D motion capture, facial recognition, voice recognition and acoustic source localization capabilities.

The depth sensor consists of an infrared laser projector combined with a monochrome CMOS sensor, which captures video data in 3D. Kinect is capable of simultaneously tracking up to six people. sensors output video at a frame rate of 15 Hz(low light) to 30 Hz. The default RGB video stream uses 8-bit VGA resolution (512 x 424 pixels) with a Bayer color filter, but the hardware is capable of resolutions up to 1920x1080 @30fps colour image. The Kinect sensor has a practical ranging limit of 1.2–4.5 m distance. The Kinect can process 2 gigabytes of data per second, so it uses USB 3. The SDK runs only on windows 8.

Look at the color depth:)

You can retrieve this joint information as well as finger information

Presentation software

begin;

array{
  ellipse_graphic {
     ellipse_width = 1;
     ellipse_height = 1;
     color = 255, 0, 0;
  };
  ellipse_graphic {
     ellipse_width = 1;
     ellipse_height = 1;
     color = 0, 255, 0;
  };
}arrayJoints;

picture {

text { font = "Arial"; font_size = 20; caption = "move a bit:)"; } cap; x = 0; y = -400;

} pic;

begin_pcl;

array<vector> data[0]; # in centimeters
array<int> body_ids[0];
int counter = 0, dataBody;
string toScreen;

sub change_caption( string caption ) begin

cap.set_caption( caption, true ); pic.present()

end;

sub showJoint( int joint , int partNr) begin

pic.set_part_x(partNr+1,data[joint].x() * 10); pic.set_part_y(partNr+1,data[joint].y() * 10); if partNr <= 3 then arrayJoints[partNr].set_dimensions(data[joint].z(),data[joint].z()); arrayJoints[partNr].redraw(); end;

end;

kinect k = new kinect();
depth_data dd = k.depth();
dd.RES_512x424;

body_tracker tracker = k.body();
tracker.set_seated( true );
tracker.start();

pic.present();
body_data bd;
loop until !is_null( bd ) begin

bd = tracker.get_new_body();

end;

#add the joints to picture
loop

int count = 1;

until count > 6 begin

pic.add_part(arrayJoints[count],0,0); count = count + 1;

end;

dd.start();
loop until false begin
  if (dd.new_data()) then

counter = counter + 1; bd.get_positions( data, body_ids); if data.count() > 0 then showJoint(bd.HAND_RIGHT,1); showJoint(bd.HAND_LEFT,2); showJoint(bd.HEAD,3); showJoint(bd.WRIST_RIGHT,4); showJoint(bd.HAND_TIP_RIGHT ,5); showJoint(bd.THUMB_RIGHT,6); toScreen = "dataCount: " + string(counter) + "\n"; toScreen.append("data X: " + string(data[bd.HAND_RIGHT].x()) + "\n"); toScreen.append("data Y: " + string(data[bd.HAND_RIGHT].y()) + "\n"); toScreen.append("dataZ: " + string(data[bd.HAND_RIGHT].z()) + "\n"); change_caption( toScreen ); end;

  end;
end;