Categories
Kinect

HDFusion – Kinect Fusion in steroids

Great video from Microsoft Research

HD Fusion improves upon the original KinectFusion in terms of scaling. It is now possible to:

– scan scenes at a higher level of detail than before
– scan scenes of virtually infinite size
– increase the viewing distance proportionally to the number of GPUs

UPD: Looks like video temporary disabled. Hope they return it back soon.

Categories
Augment Reality Kinect

Primesense Capri 3D Sensor specifications.

Primesense revealed specifications for their new smallest 3D sensor named Capri.
PrimeSense_Capri-Gum-630x307

Capri 1.25 has many similarities with the successful Carmine 1.08, and includes the following features:

  • Field of View 57.5×45
  • Range 0.8m-3.5m
  • VGA depth map (640×480)
  • USB2.0 powered
  • Standard off the shelf components
  • OpenNI compliant

Cant wait for play with it!

Categories
Kinect

Kinected BrowserКинект в браузере

Nice Microsoft Research project – Kinected Browser.

Kinected Browser allows Web page authors to create immersive interactive experiences inside the browser. The
platform provides high and low level access to the Kinect device to enable a variety of designs.
The goal of Kinected Browser is to provide a platform for experimentation with Natural User Interface in the
browser. This package is experimental quality and should not be used for production applications.

Features

1. Scriptable high level DOM events for joint activity such as leftHandOver, rightKneeMove, etc.
2. Access to full skeleton tracking
3. Support for multiple and custom methods for mapping physical space into the browser
4. Access to the depth stream with built in methods for drawing to HTML5 CanvasНаткнулся на прикольный проект в Microsoft Research – Kinected Browser.

Добавляет в браузер (пока только IE 9 и IE 10) возможность использовать Кинект. Среди заявленных фич – использование джоинтов скелета, распознавание жестов, методы для отрисовки карты глубины в HTML5 canvas и другое. Для экспериментов самое то

Categories
Kinect

The Kinect For Windows SDK v1 is out!Вышел Windows Kinect SDK v1!

Kinect for Windows SDK finaly out from beta. Download Kinect for Windows SDK v1.

Changes since the Kinect for Windows SDK Beta 2 release

  • Support for up to 4 Kinect sensors plugged into the same computer, assuming the computer is powerful enough and they are plugged in to different USB controllers so that there is enough bandwidth available. (As before, skeletal tracking can only be used on one Kinect per process. The developer can choose which Kinect sensor.)

· Skeletal Tracking

    • The Kinect for Windows Skeletal Tracking system is now tracking subjects with results equivalent to the Skeletal Tracking library available in the November 2011 Xbox 360 Development Kit.
  • The Near Mode feature is now available. It is only functional on Kinect for Windows Hardware; see the Kinect for Windows Blog post for more information.
  • Robustness improvement including driver stability, runtime and audio fixes.
  • API Updates and Enhancements
    • Many renaming changes to both the managed and native APIs for consistency and ease of development. Changes include:
      • Consolidation of managed and native runtime components into a minimal set of DLLs
      • Renaming of managed and native APIs to align with product team design guidelines
      • Renaming of headers, libs, and references assemblies
    • Significant managed API improvements:
      • Consolidation of namespaces into Microsoft.Kinect
      • Improvements to DepthData object
      • Skeleton data is now serializable
      • Audio API improvements, including the ability to connect to a specific Kinect on a computer with multiple Kinects
      • Improved error handling
    • Improved initialization APIs, including addition the Initializing state into the Status property and StatusChanged events
    • Set Tracked Skeleton API support is now available in native and managed code. Developers can use this API to lock on to 1 or 2 skeletons, among the possible 6 proposed.
    • Mapping APIs: The mapping APIs on KinectSensor that allow you to map depth pixels to color pixels have been updated for simplicity of usage, and are no longer restricted to 320×240 depth format.
    • The high-res RGB color mode of 1280×1024 has been replaced by the similar 1280×960 mode, because that is the mode supported by the official Kinect for Windows hardware.
    • Frame event improvements. Developers now receive frame events in the same order as Xbox 360, i.e. color then depth then skeleton, followed by an AllFramesReady event when all data frames are available.
    • Managed API Updates

Correct FPS for High Res Mode

ColorImageFormat.RgbResolution1280x960Fps15 to ColorImageFormat.RgbResolution1280x960Fps12

Enum Polish

Added Undefined enum value to a few Enums: ColorImageFormat, DepthImageFormat, and KinectStatus

Depth Values

DepthImageStream now defaults IsTooFarRangeEnabled to true (and removed the property).

Beyond the depth values that are returnable (800-4000 for DepthRange.Default and 400-3000 for DepthRange.Near), we also will return the following values:

DepthImageStream.TooNearDepth (for things that we know are less than the DepthImageStream.MinDepth)

DepthImageStream.TooFarDepth (for things that we know are more than the DepthImageStream.MaxDepth)

DepthImageStream.UnknownDepth (for things that we don’t know.)

Serializable Fixes for Skeleton Data

We’ve added the SerializableAttribute on Skeleton, JointCollection, Joint and SkeletonPoint

Mapping APIs

Performance improvements to the existing per pixel API.

Added a new API for doing full-frame conversions:

public void MapDepthFrameToColorFrame(DepthImageFormat depthImageFormat, short[] depthPixelData, ColorImageFormat colorImageFormat, ColorImagePoint[] colorCoordinates);

Added KinectSensor.MapSkeletonPointToColor()

public ColorImagePoint MapSkeletonPointToColor(SkeletonPoint skeletonPoint, ColorImageFormat colorImageFormat);

Misc

Renamed Skeleton.Quality to Skeleton.ClippedEdges

Changed return type of SkeletonFrame.FloorClipPlane to Tuple<int, int, int, int>.

Removed SkeletonFrame.NormalToGravity property.

· Audio & Speech

    • The Kinect SDK now includes the latest Microsoft Speech components (V11 QFE). Our runtime installer chain-installs the appropriate runtime components (32-bit speech runtime for 32-bit Windows, and both 32-bit and 64-bit speech runtimes for 64-bit Windows), plus an updated English Language pack (en-us locale) with improved recognition accuracy.
    • Updated acoustic model that improves the accuracy in the confidence numbers returned by the speech APIs
    • Kinect Speech Acoustic Model has now the same icon and similar description as the rest of the Kinect components
    • Echo cancellation will now recognize the system default speaker and attempt to cancel the noise coming from it automatically, if enabled.
    • Kinect Audio with AEC enabled now works even when no sound is coming from the speakers. Previously, this case caused problems.
    • Audio initialization has changed:
      • C++ code must call NuiInitialize before using the audio stream
      • Managed code must call KinectSensor.Start() before KinectAudioSource.Start()
      • It takes about 4 seconds after initialize is called before audio data begins to be delivered
      • Audio/Speech samples now wait for 4 seconds for Kinect device to be ready before recording audio or recognizing speech.

· Samples

    • A sample browser has been added, making it easier to find and view samples. A link to it is installed in the Start menu.
    • ShapeGame and KinectAudioDemo (via a new KinectSensorChooser component) demonstrate how to handle Kinect Status as well as inform users about erroneously trying to use a Kinect for Xbox 360 sensor.
    • The Managed Skeletal Viewer sample has been replaced by Kinect Explorer, which adds displays for audio beam angle and sound source angle/confidence, and provides additional control options for the color modes, depth modes, skeletal tracking options, and motor control. Click on “(click for settings)” at the bottom of the screen for all the bells and whistles.
    • Kinect Explorer (via an improved SkeletonViewer component) displays bones and joints differently, to better illustrate which joints are tracked with high confidence and which are not.
    • KinectAudioDemo no longer saves unrecognized utterances files in temp folder.
    • An example of AEC and Beam Forming usage has been added to the KinectAudioDemo application.
  • Redistributable Kinect for Windows Runtime package
    • There is a redist package, located in the redist subdirectory of the SDK install location. This redist is an installer exe that an application can include in its setup program, which installs the Kinect for Windows runtime and driver components.

Kinect под Windows SDK как и был обещан зарелизился. Скачать Kinect for Windows SDK v1.

Categories
Kinect

Kinect EffectKinect Effect

Kinect was released year ago with great success. Check the great inspirational video below.

And one more awesome video with kinect and handheld projector.

Кинект вышел год назад и был очень хорошо встречен пользователями и разработчиками. Предлагаю вам посмотреть отличное видео, которое сняли в Microsoft к годовщине.

И еще одно интересное видео с кинектами и переносным проектором.