Showing posts with label nvidia xavier. Show all posts
Showing posts with label nvidia xavier. Show all posts

Thursday, November 14, 2019

NVIDIA Jetson Xavier Multi-Camera Artificial Intelligence Demo from RidgeRun

Jetson Xavier Multi-Camera Artificial Intelligence Demo from RidgeRun

This demo from RidgeRun shows the capabilities of the Jetson Xavier by performing :

  • Multi-camera capture through FPD-LINK III with Virtual Channels support,
  • Display of each individual camera stream on a grid, 
  • Application of CUDA video processing filters, classification and detection inference, 
  • Video stabilization processing and video streaming through the network.

Please watch Jetson Xavier Multicamera + AI + Video Stabilization + CUDA Video Processing FIlters demo from RidgeRun :

Demo components:

D3 Engineering-Nvidia-Xavier FPD-Link III interface card
                                   
D3 Engineering-D3RCM-OV10640-953 Rugged Camera Module

The 8 camera streams are downscaled to 480x480 resolution and displayed on a grid. Following are the extra processing is applied to different camera streams:

Camera_1: No extra processing, just normal camera stream. Intended to be used as a point of comparison against the streams with CUDA video processing filters.

Camera_2: Sobel in X-axis CUDA video filter applied with GstCUDA plugin.

Camera_3: Border Enhancement CUDA video filter applied with GstCUDA plugin.

Camera_4: Grayscale CUDA video filter applied with GstCUDA plugin.

Camera_5: No extra processing, just normal camera stream. Intended to be used as a point of comparison against the stream with video stabilization processing.

Camera_6: Video stabilization processing applied with GstNvStabilize plugin. 

Camera_7: InceptionV1 Classification Inference applied with GstInference plugin using GPU accelerated TensorFlow.

Camera_8: TinyYoloV2 Detection Inference applied with GstInference plugin using GPU accelerated TensorFlow.

One individual camera stream selected by the user from the demo menu is streamed to the network using the GstWebRTC plugin and an OpenWebRTC application.

Demo setup, demo features in detail, demo code and performance profiling information are explained in this RidgeRun & D3 Engineering - Nvidia Partner Showcase : Jetson Xavier Multi-Camera AI Demo RidgeRun Developer Wiki.

Contact Us

Please visit our Main Website for the RidgeRun online store or Contact Us for pricing information of the engineering support, product and services.                                                                              
You can also send an email to support@ridgerun.com for a technical support, more information about the features, evaluation version (if available) or for a details about how to sponsor a new feature.

Thursday, September 5, 2019

Nvidia Jetson Xavier multi camera Artificial Intelligence demo showcase by RidgeRun

This demo from RidgeRun shows the capabilities of the Jetson Xavier by performing :
  • Multi-camera capture through FPD-LINK III with Virtual Channels support, 
  • Display of each individual camera stream on a grid, 
  • Application of CUDA video processing filters, classification and detection inference, 
  • Video stabilization processing and video streaming through the network.

RidgeRun demo screen:
RidgeRun & D3 Engineering Nvidia Partner Showcase Jetson Xavier Multi-Camera AI Demo.

Demo components:
D3 Engineering-Nvidia-Xavier FPD-Link III interface card
                                   
D3 Engineering-D3RCM-OV10640-953 Rugged Camera Module

The 8 camera streams are downscaled to 480x480 resolution and displayed on a grid. Following are the extra processing is applied to different camera streams:

Camera_1: No extra processing, just normal camera stream. Intended to be used as a point of comparison against the streams with CUDA video processing filters.

Camera_2: Sobel in X-axis CUDA video filter applied with GstCUDA plugin.

Camera_3: Border Enhancement CUDA video filter applied with GstCUDA plugin.

Camera_4: Grayscale CUDA video filter applied with GstCUDA plugin.

Camera_5: No extra processing, just normal camera stream. Intended to be used as a point of comparison against the stream with video stabilization processing.

Camera_6: Video stabilization processing applied with GstNvStabilize plugin. 

Camera_7: InceptionV1 Classification Inference applied with GstInference plugin using GPU accelerated TensorFlow.

Camera_8: TinyYoloV2 Detection Inference applied with GstInference plugin using GPU accelerated TensorFlow.

One individual camera stream selected by the user from the demo menu is streamed to the network using the GstWebRTC plugin and an OpenWebRTC application.

Demo setup, demo features in detail, demo code and performance profiling information are explained in this RidgeRun & D3 Engineering - Nvidia Partner Showcase : Jetson Xavier Multi-Camera AI Demo RidgeRun Developer Wiki.

Contact Us

Please visit our Main Website for the RidgeRun online store or Contact Us for pricing information of the engineering support, product and services.                                                                              
You can also send an email to support@ridgerun.com for a technical support, more information about the features, evaluation version (if available) or for a details about how to sponsor a new feature.

Wednesday, December 26, 2018

RidgeRun's USB Video Class Gadget Library - LibGUVC v1.4.0 - NVidia Xavier and NXP iMX Support

The UVC Video Class Gadget Library or libguvc for short is a platform agnostic library that simplifies the development of UVC based gadget devices by encapsulating the most of the UVC communication leaving just the basic setup to the user. The USB video class gadget runs on top of the UVC function driver in the user space and takes care of the communication between the user application and the linux driver stack.

Release of libGUVC v1.4.0, is now supporting NVIDIA Jetson platform along with previously supported NXP-iMX6 family of processors, thanks to the new bulk transfer support.

It has never been easier to implement a UVC application on your hardware, libGUVC make it easy to interact with the UVC driver and expose a variety of useful features such as:

  •     USB 2.0 and USB 3.0 support
  •     Isochronous and bulk endpoint support
  •     YUV2, MJPEG and H264 video streaming support
  •     Extension Unit support
  •     MMAP and UserPtr support.

Since the driver is agnostic to the platform, you can run it on almost any platform with quality USB and UVC drivers, making it really simple to convert it into a UVC capable device.

 libGuvc in action - Running libGuvc on NVidia Xavier

 


 libGuvc in action - Running libGuvc on NXP-iMX6

 

You can find more information about the library in this developer wiki from RidgeRun Engineering : USB Video Class Gadget Library - libguvc

For more technical information please contact us at support@ridgerun.com. Please post your inquiry at our Contact Us page for purchase related questions and also since the libguvc is platform agnostic, you can request for a custom demo image for any other platform using this link.





Monday, December 10, 2018

RidgeRun - NVIDIA Xavier - Deep Learning Tutorials using Jetson Inference

Jetson-inference is a training guide for inference on the TX1 and TX2 using NVIDIA Deep Learning GPU Training System (DIGITS). 

This blog details the summary of original Jetson-inference training from NVIDIA with a focus on inference part.

You can learn about following details in this developer wiki from RIdgeRun Engineering : NVIDIA Xavier - Deep Learning - Deep Learning Tutorials - Jetson Inference

Building jetson-inference.

Classifying Images with ImageNet.

Locating Object Coordinates using DetectNet.

Image Segmentation with SegNet.

and run a Live Demo.

With jetson-inference you can deploy deep learning examples on the NVIDIA Xavier in a matter of minutes. An example application is shown below.

The input is an image and it outputs the most likely class and the probability that the image belongs to that class using ImageNet classification network. ImageNet is a classification network trained with a database of 1000 objects.


Fig1: imagenet-console output image

It detects the image as 'Boston bull, Boston terrier' with imagenet class id of 0195 at 96.305% classification accuracy. Image recognition networks output a class probabilities corresponding to the entire input image.

Detection networks, on the other hand, find where in the image those objects are located. DetectNet accepts an input image, and outputs the class and coordinates of the detected bounding boxes.


                            Fig2: detectnet-console output image using coco-dog pretrained model


If you are new to the Xavier or planning on getting one, please visit our Jetson Xavier Wiki page.

Article related : 

Read this blog on deep reinforcement learning Deep Reinforcement Learning on the Jetson Xavier

For more information please contact us at support@ridgerun.com