Data Wrangling (High Res)

From Projects
Jump to: navigation, search

Here is a Powershell script to download the tiled images from the Consilium VM: The private key needs to be named p2kaggle.pem in the local directory. Input parameters are:

  • image: '104001002B124500' or '10400100265ED400'
  • tile: the tile number ranging from 0 to 49 for '10400100265ED400' and 0 to 160 '104001002B124500'
.\download_images.ps1 -image 104001002B124500 -tile 64


From trial and error the tiles of overlap are:

  • 104001002B124500 - Magenta - 2017-03-31T03:00:47.616Z
    • 80, 81, 82, 83; 88, 89, 90, 91; 96, 97, 98, 99; 104, 105, 106, 107; 112, 113, 114, 115; 120, 121, 122, 123; 128, 129, 130, 131;
  • 10400100265ED400 - Cyan - 2017-01-15T02:50:50.846Z
    • 3, 4, 5, 6, 7; 11, 12, 13, 14, 15; 19, 20, 21, 22, 23; 27, 28, 29, 30, 31; 35, 36, 37, 38, 39; 43, 44, 45, 46, 47; 51, 52, 53, 54, 55; 59, 60, 61, 62, 63;

Complete Dataset - Overlapping view:

Notable Aspects

The images are geoaligned but do not line up properly, as shown in the following image:

In order to overcome this, a preprocessing step which includes image alignment utilizing open-CV is being investigated. <a href="https://www.learnopencv.com/image-alignment-ecc-in-opencv-c-python/" class="external-link" rel="nofollow">https://www.learnopencv.com/image-alignment-ecc-in-opencv-c-python/</a>



Additional access to gbdx systems has listed HR images for the following dates:

  • '2017-01-14T02:35:18.346Z'
  • '2017-01-15T02:50:50.846Z'
  • '2017-11-22T02:50:45.000Z'
  • '2017-03-31T03:00:47.616Z'
  • '2017-01-14T02:36:11.597Z'
  • '2017-01-15T02:51:48.945Z'
  • '2016-01-06T02:45:55.697Z'
  • '2016-11-02T02:55:58.829Z'
  • '2016-06-25T02:47:48.409Z'
  • '2015-04-21T02:29:34.173Z'
  • '2015-04-21T02:28:29.048Z'