Archived Projects

You Only Look Twice

by

You Only Look Twice (YOLT)

SEE ALL PROJECTS

The You Only Look Twice (YOLT) object detection pipeline was designed to address some of the shortcomings identified in classic object detection techniques. The pipeline was based off of the You Only Look Once framework and dramatically improved performance of object detection at varying scales over legacy techniques. In order to tailor the framework for use on remote sensing data sets such as satellite imagery, YOLT provides three major modifications:

  1. Upsampling via a sliding window to look for small, densely packed objects
  2. Augment training data with re-scalings and rotations
  3. Define a new network architecture such that the final convolutional layer has a denser final grid

In late 2017, we released YOLT version 2 which incorporated a number of improvements to the original paper. These enhancements significantly improved the accuracy while maintaining a speed advantage over other options such as Faster R-CNN and SSD.

Related Posts

GITHUB

Multispectral Imagery (MSI) & Deep Learning Analysis

by

Multispectral Imagery (MSI) & Deep Learning Analysis

SEE ALL PROJECTS

This project explored the utility of visible and near infrared (VNIR) multispectral imagery (MSI) for training algorithms to artificially generate spectral information and for deep learning object detection algorithms. Initially, two leading object detection algorithms were adapted to analyze multispectral data. A performance comparison using these algorithms on grayscale, 3-band RGB, and 8-band multispectral imagery indicated a  performance advantage to three-band imagery over grayscale imagery. This finding motivated the study of methods to artificially generate color images from grayscale.

Sample SpaceNet cutout. Left: 3-band image. Right: Ground truth building labels.

To this end, a generative adversarial network (GAN) architecture was developed to artificially generate 3-band images from grayscale imagery and 8-band images from 3-band imagery. While the GAN recovered a majority of the multispectral information in the test images, some areas and objects were reconstructed with higher accuracy than others. To gauge the utility of GAN colorization, the performance of two leading object detection algorithms, Multi-task Network Cascades (MNC) and You Only Look Twice (YOLT), were tested using grayscale imagery, real 3-band imagery, and artificially generated 3-band imagery. While the best performance was achieved with real 3-band images, algorithm performance was significantly better on the artificial 3-band images than on the grayscale images. Such initial results encourage future research in this subject area. Specifically, based on these initial results, the GAN might be an effective preprocessing step for imagery collected in bandwidth-constrained environments.

Related Posts

SpaceNet 3

by

SpaceNet 3: Road Network Detection

SEE ALL PROJECTS

Millions of kilometers of the worlds’ roadways remain unmapped. In fact, there are large organizations such as the Humanitarian OpenStreetMap Team (HOT) Missing Maps Project whose entire goal is to map missing areas. The SpaceNet 3 Road Detection and Routing Challenge was designed to assist the development of techniques for generating road networks from satellite imagery. The deployment of these techniques will hopefully expedite the development and publication of accurate maps.

The Challenge specifically asked participants to turn satellite imagery into usable road network vectors. For this challenge, we created a new metric, Average Path Length Similarity (APLS) for evaluating the similarity between a ground truth and proposal road network. We also created new feature labels specifically for this challenge. The new dataset consists of 8,000 km of road centerlines with associated attributes such as road type, surface type, and number of lanes. All roads were digitized from existing SpaceNet data — 30 cm GSD WorldView 3 satellite imagery over Las Vegas, Paris, Shanghai, and Khartoum.

The challenge was conducted from November 2017 to February 2018 and hosted on the Topcoder platform. It received 342 submissions from 33 challenge participants from the across the world. The code for the top five submissions were open sourced under the Apache 2 License on SpaceNet Github repository.

CosmiQ Works conducted this project in coordination with the other SpaceNet Partners: Radiant Solutions, Amazon Web Services, and NVIDIA.

Learn more at www.spacenet.ai.

Related Posts

GITHUB

SpaceNet 2

by

SpaceNet 2: Building footprint detection in geographically diverse settings

SEE ALL PROJECTS

In building off of the results and lessons learned from SpaceNet 1, CosmiQ and the SpaceNet Partners decided to launch a second public data science challenge focused again on automated building footprint extraction from high resolution satellite imagery. While it used the same evaluation metric from the previous challenge, SpaceNet 2 included an expanded dataset featuring four new cities, Paris, France, Shanghai, China, Khartoum, Sudan, and Las Vegas, Nevada, at a higher resolution than SpaceNet 1 — 30cm ground sample distance collected by DigitalGlobe’s Worldview 3 satellite. The new dataset contained over 300,000 manually curated building footprint features across the four cities. The challenge was conducted from July 2017 to August 2017 and hosted on the TopCoder platform. The code for the top three submissions were open sourced under the Apache 2 License on SpaceNet Github repository.

CosmiQ Works conducted this project in coordination with the other SpaceNet Partners: Radiant Solutions, Amazon Web Services, and NVIDIA.

Learn more at www.spacenet.ai.

Learn More

Related Posts

GITHUB

SpaceNet 1

by

SpaceNet 1: Building Footprint Detection

SEE ALL PROJECTS

Foundational map features such as roads, building footprints, and points of interest are primarily created through manual techniques. Advancing automated feature extraction techniques will serve important downstream uses of geospatial data such as humanitarian assistance and disaster response. To that end, CosmiQ Works worked with DigitalGlobe to launch SpaceNet, a collaboration initiative aimed at accelerating open source geospatial analytics applied research. The first SpaceNet Challenge was structured around automated building footprint identification in a single city, Rio de Janeiro, Brazil. The SpaceNet team developed and open sourced a data consisting of a DigitalGlobe Worldview mosaic along with nearly 400,000 hand-annotated building footprint polygons. The public data science challenge was hosted on TopCoder and ran from November 2016 to January 2017. The code from the top 5 challenge participants were open sourced under the Apache 2 License on SpaceNet Github repository.

CosmiQ Works conducted this project in coordination with the other SpaceNet Partners: DigitalGlobe, Amazon Web Services, and NVIDIA.

Learn more at www.spacenet.ai.

Learn More

Related Posts

GITHUB

Commercial Remote Sensing Market Analysis

by

Commercial Remote Sensing Market Analysis

SEE ALL PROJECTS

The rapid growth in commercial space startup activity, commonly referred to as Space 3.0, led to numerous claims about the potential size and growth trajectory of the satellite remote sensing market. Many of the optimistic market projections were largely based on the assumption that both startups and incumbents could derive unique and valuable insights from low-cost, frequently collected remote sensing data using emerging, advanced analytics techniques such as artificial intelligence specifically computer vision. Over the past several years, venture capitalists have invested in a diverse array of space startups ranging from rockets to payloads to data analytics companies. As the Space 3.0 startup market matured, we wanted to explore whether those market projections held true given the market developments over the last few years. Thus, CosmiQ conducted a comprehensive analysis of the commercial space remote sensing market to quantify market trends as well as analyze and project investment trends.