Our Methodologies
Our Methodologies
In this section, we will discuss and explain our application methodologies more in-depth and cite some reference paper to validate our output.
Automatically Tree inventory
Airborne LiDAR data, includes the followings:
1) Geometry of the structure
2) Intensity (surface return)
3) Height based classification (classification code)
4) GPS time, scan angle and more
Load the data from .las to array (use pylas, numpy or pandas package to read the file
Use the default .las classification code to filter the ground and non-ground points
The non-ground vegetation point is the canopy height mode CHM(x,y) = max(Z(x,y)) - DTM(x,y)
Run the tree point segmentation by the watershed segmentation algorithm of Vincent and Soille (1991) to identify the individual trees
The processed CHM will be treated as a topographic surface and identify the ridges and valleys that separate the watersheds of each tree
Flood the surface from the lowest points and mark each pixel (volex) with the label of the corresponding watershed
In the watershed segmentation algorithm,
The gradient of the CHM will be defined as G(x,y) = ||∇CHM(x,y)||, where ∇ is the gradient operator, the set of markers as M = {x | G(x) = 0} and the set of catchment basins as B = {B_i | i = 1,...,N}, where N is the number of catchment basins and B_i is the set of all points that flow to marker i.
The set of watersheds as W = {W_i | i = 1,...,N}, where W_i is the set of all points that flow to catchment basin i.
For each of the segmented trees, computed the height, crown spread, inclination and extract the mid-point coordinates.
Height is determined by the maximum z point of the segmented tree minus the averaged height of the interpolated digital terrain model from classification code 2.
Crown spread is estimated by the Minimum bounding rectangle (MBR), the maximum and minimum x and y coordinate of the segmented crown, it is used to define the corners of the MBR, apply the distance formula to the resulted length and width of the bounding box will be the estimated crown spread.
Tree inclination is computated by the Principal component analysis (PCA), by computing the principal components of the tree points, this code is essentially finding the direction of maximum variance in the x and y coordinates of the tree points. Then, apply the arctan to calculate the correct quadrant and inclination of the tree angle.
Canopy-slope intergrate simulation
Digital Terrain model and surface model was created and result by the Airborne LiDAR survey, the DTM shows the original terrain profile (included) the cutted and filled slopes and the DSM shows the canopy layers among the man-made slopes. Therefore, we can adopt both of them do eveulated the flow direction and simulate the flow accumulation areas.
Compute the CHM model and the flow directions from DTM and DSM.
Then the DSM and result from the Auto-tree inventory can help us to plot the trees along the slope for referencing.
Calculate the flow direction and accumulation raster by the DTM, create a fishnet plotting for the data visulisation, the raster computation is avalibale online in https://huggingface.co/spaces/OttoYu/FlowDynamics.
Then, we can make use of the flow raster to eveulate the protential root decays and damage areas that will higher flow accumulation rate.
This process is similar to Riley et al. (1999) Terrain ruggedness index (TRI), which measure of the topographic heterogeneity. TRI used to identify areas of high or low flow accumulation, as well as areas of potential erosion or sediment deposition. Still, our method is to locallised into man-made slope based approch for the urban forestry application in Hong Kong.
Tree Health monitoring and prediction
Aerial imagries captured by the LandsD quarterly may helps to detect the the abnomaities among our tree and forest along the whole Hong Kong terriority. By these images, we can calculate the remote sensing index and eveulate the seasonal change over a period of time.
Forestree adopted the Normalized Difference Vegetation Index (NDVI), Enhanced Vegetation Index (EVI) and Green Chlorophyll Index (GCI) to account for the plant stress and health conditions.
NDVI from Tucker, C. J. (1979) is computed by subtracting the reflectance of near-infrared (NIR) radiation from the reflectance of visible red light and dividing the result by the total of the two. This indicator is sensitive to variations in plant cover and productivity since it primarily monitors the quantity of chlorophyll in vegetation. NDVI levels are often greater in healthy vegetation than in stressed or barren regions.
EVI from Huete, A., Didan, K., Miura, T., Rodriguez, E. P., Gao, X., & Ferreira, L. G. (2002) is a modified form of NDVI that considers atmospheric impacts as well as other elements that might influence plant reflectance. It is more sensitive to changes in plant cover and productivity than NDVI and is frequently employed in locations where there are significant aerosol concentrations or other atmospheric disturbances.
GCI from Gitelson, A. A., & Merzlyak, M. N. (1994) is especially intended to assess the quantity of green chlorophyll in plants. It is computed by dividing the reflectance of green light by the reflectance of red light.
Deep learning with local tree species identificiation
Hong Kong's local tree identification process is still labour intensive and time consuming, by deep learning from ALS (airborne LiDAR scanning), it will also be an effective way to count and identifies tree from point cloud.
The tree identification from TLS and handheld LiDAR was developed from Fuentes-Pérez, J. F., Lillo-Saavedra, M., & López-Sánchez, C. A. (2020). and Wang, M., & Wong, M. S. (2023). respectively. These research paper shows the capability of the LiDAR point cloud data are avaliable to distingish tree species and identifies them.
Forestree segmented tree species samples, from Airborne LiDAR point cloud
In the Wang, M., & Wong, M. S. (2023) proposed algorithm is evaluated using two types of tropical trees with two different branch structures, i.e. linear branch structure and complex branch structure of large and crown-heavy tropical trees and general tropical trees, respectively. The separation results demonstrate that the proposed method can obtain promising wood-leaf separation accuracy for both general and large trees.
Still, there will be very different case in the MMS (close-ranging mobile mapping system) and ALS, as the point cloud LoD (Level of detials) are very different and coarse, spreaded compare to the TLS and handheld scanning, also the scanning angles is limited for the MMS and ALS due to they are embed into the vehicles.
On the other hand, Forestree is still developing a solution to deal with MMS and ALS data for tree species identification, we have already explore 350+ tree samples and 33 common species in Hong Kong. There are some key findings though our explorations, such as the intensity can help use to derive the co-dominate trucks, point spacing can shows the tree leaf style (needle-like or board leaf), geometries and point alignment can shows the type of tree by it shapes.
Soundscape ecoloy - Tree-Bird combined auto-inventory
Remote sensing is not limited to the 2D image and 3D point cloud processing, but also includes the 1D signal processing and analysis. Using sound to detect and track the living bodies is one of the soundscape ecology and bioacoustics applications. For example, detecting the bird flying pattern and tracking their movements across the forest can enhance the understanding to our ecosystem.
In the field of urban planning and ecology, we can adopt the soundscape to measure and monitor the animals species diversity, behaviour and habitat by sound, across a regional wide range from grid/ selective sampling. With the IoT (internet of things technologies), devices can capture different kinds of frequencies for the researcher to map up and trim down the data remotely.
Acoustic environment is one of the fundamental way to capture and analyse our environment, it can also improve and qualified the way to do the EIA (environmental impact assessment) with less human bias.
Our sample output with auto-bird inventory
Reference list:
Bryan C. Pijanowski, Almo Farina, Stuart H. Gage, Bernie Krause, Nadia B. M. Oliveira, Soundscape Ecology: The Science of Sound in the Landscape, Landscape Ecology, November 2011, Volume 26, Issue 10, pp 1213–1232, DOI: 10.1007/s10980–011–9600–8.
Fuentes-Pérez, J. F., Lillo-Saavedra, M., & López-Sánchez, C. A. (2020). Tree Species Classification Using Structural Features Derived From Terrestrial Laser Scanning. Forests, 11(11), 1198. doi: 10.3390/f11111198
Gitelson, A. A., & Merzlyak, M. N. (1994). Spectral reflectance changes associated with autumn senescence of Aesculus hippocastanum L. and Acer platanoides L. leaves. Spectral features and relation to chlorophyll estimation. Journal of Plant Physiology, 143(3), 286-292. doi: 10.1016/S0176-1617(11)81678-5
Hosoi, F., Omasa, K., & Saito, Y. (2009). Estimating tree height and crown structure parameters using airborne LiDAR in an urban area. Remote Sensing, 1(3), 562-577. doi: 10.3390/rs1030562
Huete, A., Didan, K., Miura, T., Rodriguez, E. P., Gao, X., & Ferreira, L. G. (2002). Overview of the radiometric and biophysical performance of the MODIS vegetation indices. Remote Sensing of Environment, 83(1-2), 195-213. doi: 10.1016/S0034-4257(02)00096-2
Hyyppä, J., Hyyppä, H., Leckie, D., & Gougeon, F. (2001). Review of methods of small-footprint airborne laser scanning for extracting forest inventory data in boreal forests. International Journal of Remote Sensing, 22(2-3), 143-158. doi: 10.1080/01431160010006971
Pijanowski, Bryan & Villanueva-Rivera, Luis & Dumyahn, Sarah & Farina, Almo & Krause, Bernie & Napoletano, Brian & Gage, Stuart & Pieretti, Nadia. (2011). Soundscape Ecology: The Science of Sound in the Landscape. BioScience. 61. 10.1525/bio.2011.61.3.6.
Riley, S. J., DeGloria, S. D., & Elliot, R. (1999). A terrain ruggedness index that quantifies topographic heterogeneity. Intermountain Journal of Sciences, 5(1-4), 1-4.
Tucker, C. J. (1979). Red and photographic infrared linear combinations for monitoring vegetation. Remote Sensing of Environment, 8(2), 127-150. doi: 10.1016/0034-4257(79)90013-0
Vincent, L., & Soille, P. (1991). Watersheds in digital spaces: An efficient algorithm based on immersion simulations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(6), 583-598. doi: 10.1109/34.87344
Wang, M., & Wong, M. S. (2023). A novel geometric features based wood-leaf separation method for large and crown-heavy tropical trees using handheld laser scanning point cloud. International Journal of Remote Sensing. https://doi.org/10.1080/01431161.2023.2055996