GeoAI: a feature extraction tool set using Tensor Flow and Keras to classify features using RGB imagery

The amount of earth observation imagery available has multiplied exponentially in the age of satellites and drones. But how can we take advantage of this vast data source and turn it into valuable insights in near real time? 

Traditional methodologies of extracting and classifying features of the earth's surface are time consuming and labour intensive. Orbica's solution to this problem is to automate using artificial intelligence (AI) deep learning algorithms and geospatial processes. We've invested in research and development to build our solution and have applied it to waterbodies, roads, vegetation and building outlines. This tool has many uses, from identifying informal settlements to providing valuable datasets for urban planning, environmental management, disaster response and humanitarian mapping. The tool is a very cost-effective solution completely developed using open source technologies and has no proprietary licensing costs.

Though AI has been used by the geospatial community for a long time in the form of remote sensing, supervised/unsupervised classification, feature extraction etc. it had a limited scope and required resource expensive multispectral/hyperspectral imagery. Now, with proliferation of AI in almost all sectors of our economy such as autonomous cars, healthcare, finance, agriculture, asset management etc. it has grown the number of players exponentially. This has opened the flood gates for ideas to pour in mainly in the open source space. Lot of AI tools, models and technologies are being developed using open source frameworks allowing for usage of these tools in unimaginable ways. For example, it is now possible to use tools developed to identify faces in a picture to identify potential pests and diseases in crops, or tools used to assist doctors during diagnosis to predict stock markets.

The GeoAI feature extraction tool is one such tool: it uses Keras with Tensorflow or Theano as the back-end technologies to identify environmental features using only RGB imagery. This tool uses the power of machine learning and deep learning, such as convolutional neural networks (CNN), to identify building footprints, water bodies and land use, and classify them based on core geographic principles. The tool then uses libraries from GDAL, SAGA, GRASS, Shapley and QGIS to apply geoprocessing techniques to further classify and improve these features. The features are then served up using Geoserver for consumption into mapping applications and other geospatial workflows. 

All the results from the tool feedback to the AI model to increase accuracy and precision of the datasets, which results in an ever-improving dataset.

Presentation type: Full length
Session: Remote Sensing


Sagar Soni

Sagar is a data scientist and an AI specialist with an MTech in IT. His enthusiasm for the deep space of data sends him exploring for hidden treasures using machine learning and deep learning algorithms. A multilingual coder, he is proficient in Java, Python and R. His insights solve real-world complex problems. He developed Deep learning algorithms with NVIDIA's GPUs to extract features from satellite and aerial captured imagery.