• Skip to main content
CosmiqWorks
  • cosmiqworks-logo-r@2x
  • Projects
  • Blog
  • Podcasts
  • Resources
  • About
  •         

Multispectral Imagery (MSI) & Deep Learning Analysis

December 27, 2018 by rocky

Multispectral Imagery (MSI) & Deep Learning Analysis

SEE ALL PROJECTS

This project explored the utility of visible and near infrared (VNIR) multispectral imagery (MSI) for training algorithms to artificially generate spectral information and for deep learning object detection algorithms. Initially, two leading object detection algorithms were adapted to analyze multispectral data. A performance comparison using these algorithms on grayscale, 3-band RGB, and 8-band multispectral imagery indicated a  performance advantage to three-band imagery over grayscale imagery. This finding motivated the study of methods to artificially generate color images from grayscale.

Sample SpaceNet cutout. Left: 3-band image. Right: Ground truth building labels.

To this end, a generative adversarial network (GAN) architecture was developed to artificially generate 3-band images from grayscale imagery and 8-band images from 3-band imagery. While the GAN recovered a majority of the multispectral information in the test images, some areas and objects were reconstructed with higher accuracy than others. To gauge the utility of GAN colorization, the performance of two leading object detection algorithms, Multi-task Network Cascades (MNC) and You Only Look Twice (YOLT), were tested using grayscale imagery, real 3-band imagery, and artificially generated 3-band imagery. While the best performance was achieved with real 3-band images, algorithm performance was significantly better on the artificial 3-band images than on the grayscale images. Such initial results encourage future research in this subject area. Specifically, based on these initial results, the GAN might be an effective preprocessing step for imagery collected in bandwidth-constrained environments.

Related Posts

  • Panchromatic to Multispectral: Object Detection Performance as a Function of Imaging Bands
  • Artificial Colorization of Grayscale Satellite Imagery via GANs: Part 1
  • Artificial Colorization of Grayscale Satellite Imagery via GANs: Part 2
  • Artificial “Multispectralization” of Color Satellite Imagery via GANs

Filed Under: Archived Projects Tagged With: models

  • Projects
  • Podcasts
  • Blog
  • Resources
  • About

  • Copyright © 2019 · IQT Labs LLC - All Rights Reserved | Terms of Use | Privacy Policy

We use cookies to analyze the usage of our websites and give you a better experience. You consent to our cookies if you click on “Agree” and continue to use our website. Read our Privacy Policy for more information and to know how to amend your settings.AgreePrivacy policy