AT logo - The Machine Vision Specialists  
  Cameras  
  Frame Grabbers  
  Lenses  
  Lighting  
  Software  
  Vision Systems  
  Accessories  
  News  
  Careers  
  Contact AT  
  Site Map  
Request product information

Contact
info@adeptturnkey.com.au

Perth:
(08) 9242 5411

Sydney:
(02) 9905 5551

Melbourne:
(03) 9384 1775


Defence Recognised Supplier Scheme Logo

 

iDS NXT Ocean: A simplified Artificial Intelligence workflow experience

Back to Newsletter
Go to iDS NXT Ocean Product Page

Go to iDS Cameras
Go to High-resolution Colour Cameras
Go to High-resolution Monochrome Cameras
Go to GigE Cameras

iDS NXT Ocean editorial three of four: How to train an inference model for the IDS NXT ocean AI workflow

Throughout this four-part series, we will continue to take you through the steps to implement your own AI based image processing with the all-in-one iDS NXT Ocean. The four basic steps to your AI solution are: grab, label, train and run AI.

The iDS NXT Ocean provides you with everything you need to create your own AI inference camera. It significantly simplifies the workflow related to training and running neural networks.

In part-one, we described how to acquire image data from the iDS NXT cameras for labeling, training and model creation. Please refer back to our May Newsletter editorial for detailed information.


Click here to see our editorial on the "grab" element.


In part-two, we covered the steps required to upload images to the iDS NXT Lighthouse web-based AI training service and explain how to apply labels and annotations to the images for classification and object detection tasks.


Click here to see our editorial on the "label" element.



In this editorial, part-3, we will focus on the training process and how to build neural networks to run successfully on your camera.

To complete the training process the web application iDS NXT Lighthouse is used. iDS NXT Lighthouse is a cloud-based online platform. It enables users to manage images to train a model for AI based image processing tasks and to create the individual neural network. To gain access to iDS NXT Lighthouse, users must log-in and start a new project by clicking the ''add" button and by choosing the project type. Users have the option to choose between classification and detection. We will provide an example for both of these options.

After choosing the classification option the browser opens a new project window. On the project window, users can name the project, provide it with a meaningful description and assign a thumbnail image for easy identification. The "new project" window also provides an option for users to add accessible email addresses whereby a notification email will be sent, once each training process is completed by iDS NXT Lighthouse.




Following this, users will select the data set they wish to use. The data set tab, located near the top of the page, provides your chosen thumbnail image, a summary of the data set, a number of corresponding annotations and the number of images chosen for the data set. On the right of the data set tab you can select the utilization drop down box, which allows the selection of what proportion of images will be used for training and what percentage will be used for validation. The default is a 70/30 (training/validation) split but users can customize based on their own preference.Once you have selected your data set and what proportion of the images will be used for training and validation you can test your data set for training.

The first part of the training section provides the opportunity for data augmentation - with options to rotate, zoom, shift, distort and shift colour channels. This is done to help improve thegeneralization of the neural network. Users can use the slider to control the extent of the transformation. Flipping images is only relevant for applications where the object does not have a logical orientation. For example, mirroring text would not be beneficial to for your intended application. In contrast, with objects like fruit and nuts if all the available transformations are applied, the outcome for your intended application would typically be improved.

The next section is related to the neural network requirements. In this section, users can choose the iDS NXT OS version - in most cases it is recommended to use the latest version, however for compatibility with existing deployed systems the appropriate version can be selected from the drop down list. Users will now choose the inference time. You can choose options between 13-milliseconds to 75-milliseconds - the appropriate selection is based on the necessary decision time for the system balanced against the accuracy requirements. In some cases it can be helpful to create multiple neural networks with different inference times in order to compare performance. Once you have selected these parameters click "train neural network" to begin the training process.

During the training NXT Lighthouse provides a graph which documents the achieved accuracy for the training sequences of the neural network.

The above example is for classification and the process of training neural networks for object detection is quite similar. Users follow the same process but at the start of the project creation we select detection as the project type. Similarly, users enter the project name, description and add a thumbnail and email addresses for the notifications.



Image: iDS NXT Lighthouse offers a data augmentation tool which allows you to rotate, zoom, shift, distort and shift colour channels in order to improve application outcomes


Training neural networks for tasks related to object detection on iDS NXT Lighthouse provides the same high level data augmentation except for the image flipping tool. For detection we will select the maximum degree of variation for the data augmentation aspect. After this stage users will click to the train neural network button.

Object detection does not allow you to choose the inference time, it is fixed at 132 milliseconds because of the neural network architecture.



In the next editorial we will discuss how to run the AI Inference on the camera once it has been created. The NXT Ocean package is designed specifically for tasks related to object detection and classification.This workflow maximises the efficiency of your application as it makes it a lot simpler and more flexible. The iDS NXT Ocean package can be purchased as individual components or in a kit to simplify initial purchase. See below for more information on this kit.

 

What the iDS NXT Ocean kit includes
   

iDS Rio camera with
1.6 MP
Sony colour sensor

iDS NXT Rio is a fully-fledged standard industrial camera that can execute neural networks with hardware acceleration giving inference times of a few milliseconds thanks to the integrated, specially developed AI core ("deep ocean core"). Thanks to features such as C-Mount, GigE network connection with RJ45 connector, a serial RS232 interface and REST web interface, this model is ideally suited for use in industrial environments.

With the Sony global shutter CMOS sensor the camera is suitable for customers with high demands on image quality, dynamic range and sensitivity. It provides a resolution of 1.6 MP at 3.45 µm pixel size. The iDS NXT Rio GS29016 is available in monochrome or colour.

 

6 Month license for
iDS NXT Lighthouse

The iDS NXT Lighthouse cloud software allows those without expertise in the area of artificial intelligence or camera programming to train an AI classifier with their own image data. As a web application, the necessary means to create the neural network are immediately available, meaning you wont have to initially set up your own development environment.

Subsequently you can start on your own neural network straight away. Image processing can take place entirely or partially on the camera FPGA, this reduces bandwidth and computing load.

 
The iDS NXT Ocean kit also includes:

High quality
lens



Gigabit Ethernet
Cable


Camera power supply
with necessary adapters



Camera tripod
adapter


 
Specifications
iDS NXT Rio GS29016
Sensor Type
CMOS Colour
Shutter
Global Shutter
Sensor characteristic
Linear
Resolution
1456 x 1088 Pixel
Pixel Size
3.45 x 3.45 um
 
Need a price or more application information? Please email Adept Turnkey or call our offices
Adept Turnkey Pty Ltd is "The Machine Vision and Imaging Specialists" and distributor of iDS products in Australia and New Zealand. To find out more about any iDS product, please call Adept Turnkey at Perth (08) 9242 5411 / Sydney (02) 9905 5551 / Melbourne (03) 9384 1775 or contact us online.
 

 

 

If you like this page, please recommend and share it.

Facebook Twitter More