Home

Geoscience Australia Building Geometry Model User Guide

1. 5 Lersure amp Heavy Industry T Energy Production 8 Communications Q Informal Sellerments 10 Health and Well are 11 Gowernrrirrl 12 Trans perbalieni 13 Recerved Areaz 14 Emergency and Defense 15 Flood Control 16 Water Supply L7 Agriculture 18 Food Security 1 Livestock Do you want to procecd the process of the matched landuses 4 6 RUN THE PROCESS e Click the Run button Clicking the Run button will start the process of data over the AOl s defined in the above steps e Validate input parameters After clicking on the Run button the system will first validate all input parameters to make sure that mandatory fields are filled all paths files shapefiles raster images and directories exist and all values entered are valid If any the parameters are invalid or non existing it will not start the process Instead specific error messages will be printed out on the Runtime Information window and Status bar Ti Missing Input Tile Datasets d amp Warning input datasets for Tile 5051610 may be missing DEM 505161001001 DSM 595161001001 Do you want to ignore the missing tibe and continue the process In addition the system will also check the existence of all DEM and DSM tile images If any of the required tile images do not exist in the corresponding input DEM or DSM directories a separate dialog window will pop out with warning message and ask the user to confirm whether or not to
2. Aerial Imagery Tile File Name Imagery2011 RGBI 025 03 0001 0001 Imagery2011 RGBI 25EEENNNN 03 0001 0001 Save Cancel Clicking the Save button on the bottom of the dialog window will save all new filename formats defined and then close the dialog window If any filename formats are saved all saved formats will be automatically loaded upon the next opening of the BGM and populated to the dialog window However if the user chooses to click the Cancel button the dialog window will be closed and will discard any changes Add More Masks button The extraction of building areas and and calculation of heights can be constrained by specifying polygonal areas that will be excluded from the calculations Aside from a Road Mask Shapefile and a Water Mask Shapefile the user can also specify other shapefiles to be used in the masking process Clicking on the Add More Masks button will display a dialog window for editing the formats of tiled filenames By default the window will show the directory path for the Aerial Imagery as well as the name and path of the Road Mask and Water Mask Shapefiles These are numbered as 1 through to 3 T Add Edit Extra Mask Paths Ho Name of Mask Path of Mask ox o 2 _ _ __ _ _ ___ ______________ x 1 Aerial Imagery Path C Temp samples raster d ata Vegetation 2 Road Mask Shapefile C Temp samples
3. Area of Interest AOI denotes mandatory fields AO Shapefile C_Compilation Pasig_City Administrative_Boundaries Pasig_City_Admin_Bou ndaries_201210 shq El Field Defining AOls Please seleg Please select Name of AOI Whole Region BARANGAY CITY MUNIC Select Area s Of Interest AOls Once a field name from the Field Defining AOls menu box is selected as the AOI field all distinct values of that field will be retrieved from the AOI shapefile and populated to the Name of AO dropdown menu box If there is only one value then that value will be shown and selected by default in the Name of AOI menu box However if there is more than one value available an extra value of All AO s will be added as the first item in the menu box The user can select any of valid AOI values or All AO s in the menu box for each single run Due to the limitation of OptionMenu in Python the GUI does not support the selection of arbitrary multiple AOls For the examples shown in the figures below if the BARANGAY is selected as the AOI field the Name of AOI dropdown menu box will display the All AOls as the default choice because that the menu box now contains more than 20 items each of which represents a barangay The user can select All AOls to process all barangays over the whole region in a run or select a single item to process a specific barangay Select Area of Interest AOI oenotes mandatory fields
4. EEENNNN represents the tile number and 01001 is the fixed suffix for all tiles For example as shown in the image on the right the DEM path is C PRS92_ voIl201 10905 Digital Elevation Model iles1km 1km which contains a list of sub directories for tile data such as e455157201001 e455157301001 e455157401001 e455157501001 4 Digital Elevation Model DEM Index e2011 Mosaiclm a Tileslkm 1km Le 6455157201001 Le e455157301001 Le e455157401001 do e455157501001 In the example shown above the prefix and suffix of the tiled DEM filenames are e and 01001 respectively If they are not the same formats as defined previously you may edit the filename format via the button as stated above Digital Surface Model Path Digital Surface Madel Path Is an input textbox defining the path of a directory containing Digital Surface Model DSM raster data The value to this field can be either entered directly or selected through the browse button al It is a mandatory field The internal folder structure of the DSM path is similar to the DEM path described above The DEM path contains a list of subdirectories for tiled DSM raster data The tile names are in a format of SEEENNNNO 1001 where s stands for surface Tile Index Shapefile Tile Index Shapefile Sl Is an input textbox defining the full path of a polygon shapefile that defines tile indexes associated with either DEM or DSM raster data It i
5. Inter Storey Height Excel File C temp samples lookup table Inter Storey Heights v0 1 xls Aerial Imagery Path C temp samples raster data Vegetation Road Mask Shapefile C Temp samples vector data Sample Road Areas shp Water Mask Shapefile C Temp samples vector data Sample Water Areas shp Output Directory C temp Select System Settings denotes mandatory fields Cle e 0 E e ee W Delete temporary intermediate files Minimum Roof Height B Blue Feature Index 30 Iw Write runtime information to log file Maximum Tree Height 40 3 OutputPixel CellSize v 1m C 2m W Save settings on successful validation Minimum Footprint T Land Use Field Name Please select NDVI Threshold 0 3 Imagery Band Numbers Red Band 1 Green Band 2 Blue Band 3 a Infra Red Band 4 Runtime Information eh Commonwealth of Australia Gerscience J About BGM Disclaimer Click the Field Defining AOIs dropdown menu box and select CITY as this is the only one item available in the dropdown menu box Select Area s Of Interest AOls AOI Shapefile C Temp BGM v1 0 samples vector data Sample Area of interest shp Field Defining AOIs CITY Name of AOI Sample rea Sample Area After selecting CITY for the Field Defining AOls menu box Sample Area appears on the Name of AOI dropdown menu box as it is the only item available Define edit the formats for tile filenames Click the Edit Tiled Filename Forma
6. a target area by illuminating the target area with light often using pulses from a laser scanner LIDAR has many applications in a broad range of fields including aiding in mapping features beneath forest canopies creating high resolution digital elevation and surface models A Digital Surface Model DSM represents the earth s surface and includes all objects on it while the Digital Elevation Model DEM represents the bare ground surface without any natural or artificial objects such as vegetation structures and buildings The Building Geometry Model BGM application is a Python based software system used to execute ArcGIS geoprocessing routines developed by Geoscience Australia which can derive the horizontal and vertical extents and geometry information of building and other elevated features from LiDAR data The Building Geometry Model algorithms were developed in response to the availability of LiDAR data for the development of exposure information for natural hazard risk analysis The LiDAR derivatives were used to estimate building footprint areas inter storey heights across areas occupied by buildings and eventually an estimate of gross floor area of different types of buildings The design and development of the BGM application started in February 2012 as part of a natural hazard risk analysis project in the Philippines Many of the examples of interface usage in this document contain references to locations and terms used in the Phili
7. as an executable file Object oriented approach Object oriented programming was used to design and build the BGM application It is modulated and well structured and promotes code reuse and efficiency Different components and modules are implemented at the interface level making it easy for future changes and expansions Easy maintenance There are no hard coded input parameter values that will be changed frequently Most system settings and parameters are configurable and easy to change via the GUI The filename formats for input DEM DSM and GeoTIFF datasets are configurable In addition runtime information and error messages are displayed making it easy for the user to track any bugs or errors if or when they occur 2 2 SYSTEM REQUIREMENTS The BGM application V 7 7 can be run on the Microsoft Windows platform which supports ArcGIS 10 0 software by Esri and Python 2 6 or above ArcGIS software by Esri is commercially available software that currently runs in the Windows ike environments Python is freeware that can run in numerous environments however if experiencing issues running python in Windows see http docs python org 2 using windows html The system has currently only been tested on Windows XP and Windows platforms and may be able to run on other OS systems with ArcGIS 10 0 and Python 2 6 or above installed however this is yet to be tested he recommended minimum and desired hardware configurations for BGM applicatio
8. automatically retrieve the names of all string text fields from the selected dataset and then populate them to the dropdown menu Normally the first item of the dropdown menu is Please select which is selected by default The list of field names will be updated whenever the input AO dataset is changed However if there is no string text field in the AOI dataset selected the dropdown menu will contain only one item Please select This dropdown menu box is an optional widget which implies the user may either select a desired field name from the menu or just keep the default value Please select c The Name of AOI dropdown menu box defines the extent of AOI over which target datasets are to be processed The extent depends on the field name selected in the Field Defining AOls menu box It may be empty or contain only one item of Whole Region when the Field Defining AO s dropdown menu box is empty or displays Please select respectively If a valid field name is selected in the Field Defining AO s menu box the system automatically retrieve all distinct values of that field from the input AOI dataset and then populates them to this menu box If this menu box contains only one AO value then that value will be selected by default if it consists of more than one value an item of All AOIs will be added to the menu box as the first item This menu box is a mandatory one The user must select Whole Region All AOls or a s
9. extents and heights from LIDAR data The Title panel is on the top of the interface It displays the full name of the application on a background city skyline image and the BGM version number 3 3 SELECT AREA OF INTEREST PANEL The Select Area of Interest panel is used to select the area of interest AOI over which all target pixels are to be processed by the system This panel consists of four Ul widgets a AO Shapefile text entry field b file folder browse button Al c Field Defining AOls dropdown menu box and d Name of AOI dropdown menu box Select rea of Interest AQI denotes mandatory fields ADI Shapefile al Field Defining AOIS i Mame of AOI il a The AO Shapefile text entry field is used to enter a polygon shapefile that defines one or multiple AOls The dataset to be selected must be a shapefile of polygon geometry type The user may either manually enter a file path into the text field or alternatively click the browse button Al on the right side to select a desired dataset A valid file pathname to the AOI dataset is required for the model to run b The Field Defining AOls dropdown menu box is used to select a field name from the input AOI dataset selected entered in the AO Dataset Path text field If there is no dataset selected or entered in the AO Dataset Path text field or the entry is not valid the dropdown menu will be empty Once a valid dataset is selected or entered the system will
10. missing Tile 5171606 DOSODIIT 969 Step 2 Mosaic DEM and DSM tiles within AOI Mosaic 20 DEM raster tiles to 2 dem mosaic done Mosaic 20 DSM raster tiles to s2 dsm mosaic done 00 00 45 608 Step 3 Generate a new raster with height difference between DSM and DEM mosaics 00 00 16 953 Step 4 Mosaic 20 vegetation masks Mosaic of 20 NDVI tiles to s4 ndvi masac done Mosaic of 20 vegetation masks to s4 veg mask done 00312259209 Step 5 Prepare other masks water roads 00 00 09 188 Step 6 Combine all masks into a single final mask Masks s4 veg mask s5 watr rolss s5 road rclss 00 00 05 078 Step 7 Filter grid cells with final mask DOSOUSISS 219 Step 8 Filter noise and isolated pixels 00 00 19 828 Step 9 Plus DEM and Height Mask models Plus s2 dem mosaic and s8 ht 1000div to form s9 dem ht msk done 00 00 14 859 Step 10 Add Building Height DEM to DEM Mosaic Mosaic s9 dem ht msk and s2 dem mosaic to form s10 dem bldg done 00100712297 Step 11 Calculate hill shade for the DEM Plus Buildings data R n Hillshade of s10 dem bldg to generate sll bidht shd done 00 00709 390 Step 12 Calculate statistics for pixels within each landuse category 12 I Copy input landuse shapefile to s12 BGM landuse statistics shp done 12 II Add a new field OIDL to siz BGM landuse statistics shp done 12 111 Assign FID values to OID1 done 12 IV Load 21 distinct landuses from input shapefile 12 V Loop through to process all lan
11. or without modification are permitted provided that the following conditions are met Redistributions of source code must retain the above copyright notice this list of conditions and the following disclaimer Redistributions in binary form must reproduce the above copyright notice this list of conditions and the following disclaimer in the documentation and or other materials provided with the distribution Neither Geoscience Australia nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS ASIS AND ANY EXPRESS OR IMPLIED WARRANTIES INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED IM NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT INDIRECT INCIDEMTAL SPECIAL EXEMPLARY OR CONSEQUENTIAL DAMAGES INCLUDING BUT MOT LIMITED TO PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AMD OM ANY THEORY OF LIABILITY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE c 4 Run Processes To run a process you may generally follow the steps of procedures outlined be
12. window and then the BGM GUI pops out This window should be kept open whenever the tool is open Closing this window will cause the GUI automatically closed without any warning or confirmation Run time information as well as some testing and debugging messages will also be printed out in this window Therefore this window can be used to monitor the progress of the processes wa CATemp test BGM exe Start to run BGM GUI Please wait while loading data EGM GUI has been successfully created 2 6 INPUT DATASET REQUIREMENTS There are six mandatory input datasets required to run the application and three optional input datasets See Section 5 1 for more details on input data specifications Mandatory input datasets include Area of Interest Shapefile A vector polygon dataset of the extent of the area of interest AOI with an optional finer field defining AOls e g country AOI extent with Local Government Areas field defining finer polygon extents within the country extent Digital Elevation Model Path A directory containing a series of raster DEM tiles Digital Surface Model Path A directory containing a series of raster DSM tiles Tile Index Shapefile A vector polygon dataset defining tile index associated with DEM and DSM datasets and these tile indexes are to be used for creating vegetation masks from input GeoTIFF images Land Use Shapefile A vector polygon dataset defining the horizontal extent of current land uses
13. 0 Final outputs The final outputs of processing sample inputs should include two shapefiles and seven raster datasets as shown below Refer to Section 5 2 Outputs for the description of each output data zi bgm outputs zl Sample Area BH s10 dem bldg S s11 bldht shd Ed lt 1 BGM landuse statistics sl BGM landuse storeys 288 12 lu mosaic 48 s3 height ext 29 s ndvi mosai ga sd veg mask s amp ht 100 0drv
14. AQ Shapefile E C_Compilation Pasig_City Administrative_Boundaries Pasig City Admin Boundaries 201210 shp al Field Defining AOIS BARAMGAY Name of AO All AOI A All AOI BAGONG ILOG BAGONG KATIPUNAN BAMBANG BL ELIT In this example if CITY MUNIC is selected as the AOI field PASIG CITY will appear in the Name of AOI menu box as it is the only value from the CITY MUNIC field Select Area of Interest AOI denotes mandatory fields AOI Shapefile E C Compilation Pasig City Adrministratize Boundaries Pasig City Admin Boundaries 201210 s5hp Field Defining AOIS CITY MUNIC Mame of AOI PASIG CITY 4 2 DEFINE EDIT THE FORMATS FOR TILE FILENAMES Before selecting input paths it is good practice to check whether the formats of tiled filenames have been defined or are consistent with the up to date inputs Click the Edit Tiled Filename Formats button to open the dialog window for viewing and editing the formats of tiled filenames If all filename formats loaded from previously saved system file are correct simply click the Cancel button to close the dialog window Otherwise fill in or modify the text in the prefix and suffix columns for each type of files and check the composite formats that are automatically shown on the corresponding Format of Filename column When completed click the Save button to save all new filename formats defined modified and close the dialog window Alternatively the user m
15. Heights Excel File Path C Temp BGM _v1 0 samples lookup table Inter Storey Heights vO l xls Output directory C Temp bgm outputs Processing Sample Area Step 1 Select raster tile indexes within Sample Area Only 1 tile found in Sample Area 00 00 43 368 Step 2 Mosaic DEM and DSM tiles within AOI Copy the only input DEM raster tile to s2 dem mosaic done Copy the only input DSM raster tile to s2 dsm mosaic done 00 00 01 419 Step 3 Generate a new raster with height difference between DSM and DEM mosaics 00 00 01 498 Step 4 Mosaic 1 vegetation masks Mosaic of 1 NDVI tile to s4 ndvi masac done Mosaic of 1 vegetation tile to s4 veg mask done 00 00 21 465 Step 5 Prepare other masks water amp roads Create mask road mask shp done Create mask water mask shp done Create mask s5 watr mask done Create mask s5 road mask done 00 00 04 056 Step 6 Combine all masks into a single final mask Available masks s4 veg mask s5 watr rclss s5 road relss Combine all available masks to s6 final mask done 00 00 01 061 Step 7 Filter grid cells with final mask 00 00 02 013 Step 8 Filter noise and isolated pixels 00 00 02 480 Step 9 Plus DEM and Height Mask models Plus s2 dem mosaic and s8 ht 1000div to form s9 dem ht msk done 00 00 00 702 Step 10 Add Building Height DEM to DEM Mosaic Mosaic s9 dem ht msk and s2 dem mosaic to form s10 dem bldg done 00 00 01 373 Step 11 Calculate hill shade for the DEM Plus Buildings data Run Hilis
16. M ERES SIME a o E E E A E O 29 Dao Raster and vector output MDI rai T UU T MET 29 Dak IGS MEO PP m 34 SS OO IIA Sion NN d La RO A EN ER M 36 6 MIAINTENANGE AND FEED BAG Ge O m 38 So Q 38 Oil anno start BON GUON PC Or Fat picada dd rA REGROUPE v 38 Ne od T Es 38 O ho Updale or Arca Tod TIOGWVOT SIDE teri qivbep tissu david vix ru dat ELA EB ZEE V 38 0 01 CT 39 AFPFENDIXI SABBREVIATIONS USED IN THIS DOCUMENT so ar 40 APPENDIX T WORKFLOW CHAR TOF BGM SYS TEN nisciiaaaaacica nani 41 APPENDIX III STEPS FOR TESTING BGM APPLICATION USING SAMPLE INPUTS eene 42 1 Introduction It has been widely recognised that Light Detection And Ranging LIDAR data is a valuable resource for estimating the geometry of natural and artificial features While the LIDAR point cloud data can be extremely detailed and difficult to use for the recognition and extraction of three dimensional objects the Digital Elevation Model and Digital Surface Model are useful for rapidly estimating the horizontal extent of features and the height variations across those features This has utility in describing the characteristics of buildings or other artificial structures LIDAR is an optical remote sensing technology that can measure the distance from the sensor to
17. NDVI values indicate greater vegetation health or vigour In this version of the BGM the GUI includes this variable to allow the user to control the threshold for vegetation from the NDVI calculation Values greater than or equal to this number will be regarded as vegetation and reclassified to form the Vegetation Mask The default value is 0 3 Image Band Numbers Imagery Band Numbers Band Green Band Blue Band Infra Red Band i These dropdowns allow the user to associate the bands numbers and colours for the aerial imagery being used for the Area s of Interest The default values are Red Band 1 Green Band 2 Blue Band 3 and Infra Red Band 4 3 6 RUNTIME INFORMATION WINDOW Runtime Information This scroll window is used to display runtime information during a process providing users with a tool to monitor the progress of processes In most cases the formatted information printed on the window is the same as those written to the log file Please note that there is a Hide button next to the header Runtime Information Clicking on the button the scroll window will be hidden and the button s name changes to Show By clicking the Show button the window will reappear and button s name will be changed to Hide again The Hide Show button may be helpful when the screen resolution is too low to display the whole GUI window and the Control button panel may be out of the screen Hiding the scrol
18. Remember to save any changes made to the file before closing it SET PYTHON HOME C Python26 ArcGIS10 0 SET ARCGIS HOME C Program Files x86 ArcGIS REM 6 1 2 Change of inputs Make sure that all input files follow a predefined internal folder structure and consistent naming convention oee Section 5 1 1 and Section 5 1 2 for details 6 1 3 Update of ArcGIS to a new version In the event of upgrading ArcGIS software package to a newer version some of the ArcGIS geoprocessing tools functions used by the BGM application may need to be updated accordingly Consult the ArcGIS online help website for any changes to ArcGIS geoprocessing tools or functionality or request Geoscience Australia to provide the latest version of the BGM application 6 2 FEEDBACK As the BGM application and its GUI v1 1 have not been systemically and intensively tested the user may encounter bugs on both the code and runtime computation The BGM will undergo development and improvement following its release Feedback and or suggestions on usability functionality computational algorithms improvements and any other aspects are welcome Heports of bugs and any questions or comments should be sent to Geoscience Australia Cnr Jerrabomberra Ave and Hindmarsh Drive Symonston ACT 2609 GPO Box 378 Canberra ACT 2601 Australia Sales Centre product information 1800 800 173 owitchboard 61 2 6249 9111 Fax 61 2 6249 9999 Sales Centre clientserv
19. Residential 1 features 12 V 20 b CopyFeatures to s12 20b RuralResidential shp done 12 V 20 c ExtractByMask s12 20c extmk done 12 V 20 d Reclassify s12 20d story done 12 V 20 e Apply MajorityFilter three times s12 20e majf3 12 V 20 f RegionGroup s12 20f reggp done 12 V 20 g Reclassify s12 20g relss done 12 V 20 h RegionGroup s12 20h reggp done 4 20 1 MajorityFilter s12 201 m jft done 20 ExtractByAttributes siz 20 extat done 20 k ExtractByMask s12 20k bld done 20 1 ZonalStatistics s12 201 Ruralhesidential BGM stats dbf 20 m 21 Market Gardening RasterToPolygon s12 20m bld poly shp done V 21 a SelectLayerByAttribute L4 USE Market Gardening 1 features V 21 b CopyFeatures to s12 215 MarketGardening shp done V 21 c ExtractByMask s12 21c extmk done 12 V 21 d Reclassify s12 21d story done Skip as s12 21e maj l after MajorityFilter is empty Update landuse Shapefile s12 BGM landuse statistics shp 12 VI Add 10 new fields to siz BGM landuse statistics stop 12 VII 511 data loaded from 19 tables 12 VIII Populate all statistics data into s12 BGM landuse statistics shp 12 IX Mosaic 19 rasters over landuses to s12 lu mosaic done OA LO 053 Process of ANGONO completed successfully CPU time 00 27 57 650 5 3 CAPABILITIES AND LIMITATIONS Deriving vector building data from data captured by active sensors Such as LIDAR can be time consuming and computationally challengi
20. Run the process Click the Run button to start the process of sample data Within a few seconds the user will see a dialog window informing that the land use category of Vacant Areas defined by the L 4 USE field of the input Land Use shapefile does not match any land uses defined in the inter storey height lookup tables All other land uses are matched As there may be no buildings over Vacant Areas click the Yes button to close the dialog window to continue the processing of the six matching land uses EN 74 Mismacthed landuse classification Ei The following landuse from the landuse shapefile do not match with those from the inter storey height lookup table 1 Vacant Areas Please make sure that the values of L4 USE from the input landuse shapefile match those from the inter storey height lookup table Ihe matched landuses defined in the L4 USE field of the input landuse shapefile include 1 Leisure 2 Education 3 Cultural 4 Formal Settlements 5 Informal Settlements 6 Agriculture Do you want to proceed the process of the matched landuses Yes No Ni It is expected that the process will take less than 3 minutes to complete The screenshot of the Runtime information window and the Status Bar at the end of the process is shown below Runtime Information Hide Update landuse Shapefile 512 BGM landuse statistics shp 12 VI Add 10 new fields to s12 BGM
21. Storey Heights stored in the lookup table are realistic e All buildings within a specified land use conform to the corresponding Inter Storey Heights for that land use At the completion of processing of an AOI the user may encounter some data anomalies or unexpected outputs e Variations in the illumination of aerial imagery may result in e Some vegetation areas being excluded from masking and hence being registered as buildings e Some buildings with dark green roof cladding may be detected as vegetation and hence included in the vegetation mask e Large structures and items that have not been masked such as large transmission towers and others may be detected as buildings and contribute to the floor are statistics e Some structures attached to buildings but not actually part of the building e g awnings verandahs covered walkways may be detected as buildings e Some mobile features such as shipping containers aircraft railway rolling stock may be detected as buildings unless a mask is specifically prepared for these features and used when running the application e Variations in height across the top of buildings may be experienced due to roof top furniture e g air conditioning units antennae awnings e Variations in building types within a land use polygon may result in differences between the estimated and actual floor area totals Users are able to modify some of the parameters used in the analysis processes a
22. Su WM Australian Government GSP RUE ART se oe i r segs Geoscience Australia Building Geometry Model USER GUIDE Version 1 1 Matthew Jakab Mark A Dunford and Frank Fu September 2014 Department of Industry Minister for Industry The Hon lan Macfarlane MP Parliamentary Secretary The Hon Bob Baldwin MP oecretary Ms Glenys Beauchamp PSM Geoscience Australia Chief Executive Officer Dr Chris Pigram This user guide is published with the permission of the CEO Geoscience Australia Commonwealth of Australia Geoscience Australia 2014 With the exception of the Commonwealth Coat of Arms and where otherwise noted all material in this publication is provided under a Creative Commons Attribution 3 0 Australia Licence http www creativecommons org licenses by 3 0 au deed en Geoscience Australia has tried to make the information in this product as accurate as possible However it does not guarantee that the information is totally accurate or complete Therefore you should not solely rely on this information when making a commercial decision Geoscience Australia is committed to providing web accessible content wherever possible If you are having difficulties with accessing this document please contact clientservices ga gov au GeoCat 82091 ISBN 978 1 925124 40 85 PDF Bibliographic reference Jakab M Dunford M and Fu F 2014 Building Geometry Model user guide Version 1 1 Geoscience Australia Canberra C
23. a threshold to the NDVI and removal of the effect of blue coloured objects to estimate vegetation at any height above ground All cell values are set to 9999 E mU t A v i ql n a s8 ht 1000div S10 dem bldg s11 bldht shd Result of combining all masks into a single raster mask black areas Result of eliminating cells that fall within the mask Cells now represent heights in metres across tops of buildings Result of fusion of buildings extraction s8 ht 1000div and the DEM mosaic The resultant dataset shows the elevation above Mean Sea Level of either the terrain or top surface of buildings Calculation of hillshade effect on fusion of buildings and DEM s10 dem bldg Example shows area illuminated at an azimuth of 90 and zenith angle of 45 to simulate mid morning shadows n a s12_lu_mosaic Land uses defined as polygon features prior to running of model Conversion of cell heights m to number of storeys The integer number of storeys for each cell from s8_ht_1000div is calculated based on the cell s membership to a land use class and the reclassification of the cell value based on a corresponding range in the Inter Storey Heights Look Up Table 5 2 4 Runtime information log The Runtime information log contains detailed information on the processing of datasets It contains start up information input parameters detailed processing steps completed and summary of completi
24. and contains land use classifications at various levels of detail which can be specified in separate fields in the attribute table Inter Storey Heights Excel File An Excel file containing inter storey height ranges specific to a defined land use Optional input datasets are used to create masks that define areas not expected to contain building features or areas not required for analysis These include Aerial Imagery Path A directory containing a series of GeoTIFF image tiles that contain at least four bands one each for the visible bands of red green and blue and one for infra red Note ECW or other compressed image formats are not recommended Road Mask Shapefile A vector polygon dataset of road reserves or corridors but can include rail or other corridors if needed Water Mask Shapefile A vector polygon dataset of the natural and artificial waterways in the drainage network and significant water bodies Other Mask Shapefiles One or more additional polygon datasets that represent the horizontal extent of other elevated features can be specified Those features will be incorporated into the masking process 3 Main Components of BGM GUI BGM v1 1 0 has a simple but user friendly graphic user interface GUI As shown below its main frame consists from the top to the bottom of 3 2 Title panel 3 3 AOI selection panel 3 4 I O Parameters selection panel 3 5 System settings selection panel 3 6 Runtime inf
25. ate file names have also been made his document is a user guide to the BGM GUI It describes the main User Interface Ul components functionality and procedures for running the BGM processes via GUI Development of the BGM was a collaborative initiative by Matthew Jakab Regional Development Section Community Safety Group Community Safety and Earth Monitoring Division Mark A Dunford Built Environment and Exposure Section National Location Information Group Environmental Geoscience Division Frank Fu Software Development Section ICT Innovation and Services 2 Quick Start up of BGM Application 2 1 MAIN FEATURES Easy to run The application can either be run as a batch command line program supporting automation or be started through the GUI The easiest way to start the GUI is to double click BGM exe represented by an icon image ixl User friendly GUI The application provides a full functional user interface including informative text labels for all entry fields displaying hints on mouse over most Ul components grouped Ul components runtime information and status reminders etc Portability The application is a self contained software package which can be run from any location on any Microsoft Windows PCs or laptops as long as ArcGIS 10 0 software by Esri and Python 2 6 or above are both installed on the device There is no need to install the Building Geometry Model tool onto the device as it will run
26. atively the user may choose to keep the final products and delete all other unwanted outputs at the production stage Adequate computer disk space is required if the user intends to keep all temporary and intermediate data as their total size may be up to tens or hundreds of gigabytes By default this checkbox is checked Write runtime information to log file v Write runtime information to log file This is a checkbox for users to decide whether or not to write out runtime information to the specified log file when processing an AOI By default this checkbox is checked The log files are stored in the log directory with a name convention of Runtime info yyyymmad n log where yyyymmatnd is the process start date and n is the number of processes that run on that date For details of the format and contents of a log file please refer to Section 5 2 4 Save settings on successful validation W Save settings on successful validation This checkbox is used to indicate if the application will save all input parameters upon successful validation of all inputs entered to the GUI When the user clicks the Run button the BGM application will first validate all inputs entered to the GUI before starting the processing If validation fails the processing will be stopped and error messages will be printed out If this checkbox is checked and validation passes all input parameters entered in both Select Area s of Interests and Select O Pa
27. ay However as mentioned in Section 2 2 the application requires ArcGIS 10 0 and Python 2 6 or above It is assumed that for Microsoft Windows XP and NT the home path for ArcGIS 10 0 is C Program Files VArcGIS and the home path for Python 2 6 is C Python26 ArcG S 10 0 For Microsoft Windows7 the ArcGIS 10 0 home path is C Program Files x86 ArcGIS and the Python home the same The user may need to check the validity of the two paths on the user s PC or laptop If both paths are valid the BGM GUI can be opened from this point onwards Otherwise the two paths will need to be changed in the batch settings file at HOMENBGM_v1 1 config BGM BATCH STARTUP CONFIG bat For details on how to change the paths please see Section 6 1 1 2 5 START BGM GUI There are two alternative ways to start the BGM GUI e Run as a Microsoft Windows application BGM exe is an executable application for starting BGM GUI on Windows platform which is shown as an icon image s Double clicking on this icon will automatically start the BGM GUI e Start from the MS DOS batch file The start BGM bat is a MB DOS batch file Double clicking on the file on Windows explorer window will also start the BGM GUI When starting the BGM GUI the user will see a MS DOS Command Prompt window appearing with text Start to run BGM GUI Please wait while loading data on it In a few seconds text of BGM GUI has been successfully created will be printed out on the
28. ay conduct this step after Step 4 3 Select input paths 4 3 SELECT INPUT PATHS e Select directories containing DEM and DSM data Enter full paths or click the browse button yj to select directories containing DEM and DSM data over the AOls selected entered for both the Digital Elevation Model Path and Digital Surface Model Path text fields e Select the Tile Index Shapefile Enter or click the browse button amp j to select a shapefile containing tile indexes for DEM and DSM raster datasets e Select Land Use Shapefile Enter or click the browse button amp y to select a shapefile containing the definition of land uses at various levels e Select a path for the Inter Storey Height Excel file Enter the full path or click the browse button qj to select an Excel file containing Inter Storey Height worksheets for all possible land uses e Select shapefiles or directory path for optional masks As these masks are optional inputs to the system these text fields can remain empty or select enter one or more paths for each If a vegetation mask is to be calculated from aerial imagery enter a full path or click the browse button y to select a directory containing the tiles of aerial imagery for the Aerial Imagery Path text field If both the road and water masks are available enter full paths or select the desired shapefiles for Road Mask Shapefile and or Water Mask Shapefile text fields respectively If both road and water masks have been merge
29. d into a single mask dataset then select enter it to one of the text fields and leave the other one empty If additional mask files are to be used click the Add More Masks button to specify the mask names and file paths for each mask 4 4 SELECT OUTPUT DIRECTORY Either click the browse button amp x to select an existing directory or enter a new one to the Output Directory text field for the system to create it The output directory not only stores the temporary and final outputs of the process but also is used as a workspace for ArcGIS geoprocessing tools and functions 4 5 SELECT SYSTEM SETTINGS AND THRESHOLDS Land Use Field Name Please select NAME COMMENTS SOURCE L5 USE L4 USE Toggle on off any checkboxes on the left part of the Select System Settings panel depending on requirements Select the cell size as 1 or 2 metres for the output rasters and change values for the Minimum Roof Height Maximum Tree Height and other text fields if needed Select the name of a field that defines the land use classification at a specific level Click the Land Use Field Name dropdown menu and select a desired value For example after clicking on the dropdown menu box a list of fields will drop down as shown in the figure on the right side Field names such as NAME COMMENTS and SOURCE are irrelevant to land use classification If NAME is selected when clicking the Run button to start a process an informa
30. duses 12 V 1 Formal Settlements 12 V 1 a SelectLayerByAttribute L4 USE Formal Settlements 393 features 12 V 1 b CopyFeatures to s12 lb FormalSettlements shp done 12 V 1 c ExtractByMask s12 le extmk done 12 V 1 d Reclassify s12 Id story done 12 V 1 e Apply MajorityFilter three times s12 le majf3 12 V 1 f RegionGroup s12 lf reggp done 12 V 1 g Reclassify s12 lg rclss done 12 V 1 h RegionGroup s12 lh reggp done 12 V 1 i MajorityFilter s12 11 majft done 12 V 1 jJ ExtractByAttributes s12 1j extat done 12 V 1 k ExtractByMask s12 1k bld done 12 V 1 1l ZonalStatistics s12 LL FormalSettlements BGM stats dbf done 12 V 1 m RasterToPolygon siz im bld poly shp done 12 V 2 Health and Welfare 12 V 2 a SelectLayerByAttribute ld Usa Health and Welfare 6 features 12 V 2 b CopyFeatures to s12 2b HealthandWelfare shp done 12 V 2 c ExtractByMask s12 2c extmk done 12 V 2 d Reclassify s12 2d story done 12 V 2 e Apply MajorityFilter three times s12 Ze majf3 12 V 2 f RegionGroup s12 2f reggp done 12 V 2 9 Beclassify s12 2g rclss done 12 V 2 h h RegionGroup s12 2h reggp done 12 V 2 i MajorityFilter s12 2i majft done 12 V 2 jJ ExtractByAttributes s12 2j extat done 12 V 2 k ExtractByMask s12 2k bld done 12 V 2 1 ZonalStatistics s12 21 Healthandwelfare BGM stats dbf done 12 V 2 m RasterToPolygon s12 2m bld poly shp done 12 V 20 Rural Residential 12 V 20 a SelectLayerByAttribute L4 USE Rural
31. efile The Shape geometry defines the outline of the Area of Interest s while the fields C T Y MUNIC and BARANGAY describe the AOI names of different levels Table 5 1 Schema of the example AOI shapefile rib Object ID Shape Geometry Polygon BARANGAY Text 254 0 0 CITY MUNIC Text 254 0 0 AREA SQM Double 8 0 0 Tile Index Shapefile The Tile Index shapefile is a mandatory input and consists of multiple gridded polygons over a district e g the AOI The tile index shapefile may contain many fields but only the first three fields are used by BGM application which are shown in Table 5 2 The Shape geometry defines the grid tiles rectangles while the field NAME is the unique ID for the tile For instance a tile has a name of e503161501001 where 5031618 is its tile number and e and 01001 are the prefix and suffix respectively Table 5 2 Schema of the tile index shapefile Field Name Data Type Geographical Display of Tiles Object ID Shape Geometr Polygon a 3 pe pore SEI i i i CEE Hake NAME Text 254 0 O ri in PATH Text 25A 0 FORMAT Text 25A O O Land Use Shapefile An example schema for a land use shapefile is defined in Table 5 3 In the example shown there are eight fields although only four of them L2_USE L3 USE L4 USE and L5 USE are used to describe the land uses at different levels In these examples only the L4 USE categories are defined in the Inter storey height Excel tables and thu
32. es should match the land use classifications at the specific level defined in the input Land Use shapefile Each worksheet defines the lower and upper height limits of all possible storeys for a specific land use class The snapshot below shows an example of an Excel file containing 27 spreadsheets defining 27 land uses at L4 Use level including Agriculture Aquaculture Communications Cultural Education Emergency and Defense Energy Production Flood Control Food Security Formal Settlements Forestry Government Health and Welfare Heavy Industry Horticulture Informal Settlements Leisure Livestock Major Commercial Market Gardening Mixed Farming Poultry Reserved Areas Rural Residential Transportation Water Supply and Waste Management The spreadsheet shown below contains a lookup table defining the number of storeys based on the heights of buildings over areas of Formal Settlements land use The units for both LOWER_LIMIT and UPPER LIMIT columns are in metres The structure of the table is equivalent to the examples of Inter Storey Heights illustrated in Section 3 4 ey VA O A A 1 LOWER LIMIT UPPER LIMIT NO STOREYS 2 2 6 6 9 9 12 12 15 15 18 18 21 21 24 24 27 27 30 30 33 33 36 36 39 39 42 42 45 45 48 d 48 51 18 51 54 49 54 57 M gt H Formal Settlements 3 0 informal Settlements 2 2 l 2 3 4 x 6 7 3 3 popa pa pa pa ps mo La M A 5 1 5 Initialising set
33. file do not match those defined in the input inter storey height lookup tables So the user has to click the OK button to abort the process T Mismatched Landuse classification EX The landuse values from the field L5 USE of the input landuse shapefile do not match with those from the inter storey height lookup table Please check whether the landuse field L5 USE selected from the input landuse shapefile is the nght one and its landuse classification is consistent with that in the inter storey height lookup table OK If the user selects L4_ USE and clicks the Run button to start the process a conformation dialog window will pop out listing all unmatched and matched land uses and asking the user whether or not to continue the process If the user clicks the Yes button the system will go ahead to process all matched land uses Otherwise if the user chooses to click the No button the process will be aborted Mismacthed landuse classification i The following landuse from the landuse shapefile do not match with Po thase farm the nter storey height lookup Lable 1 Vacant Areas Please make sure that the values of L4 USE from the input landuse shapefile match those from the inter storey height lookup table landuze shapefile include l Formal Settlements 2 Major Commercial The matched landures defined in the L4 USE field of the input 3 Cultural 4 Education
34. hade of s10 dem bldg to generate sll bldht shd done 00 00 00 983 Step 12 Conduct statistics analysis over pixels within each landuse category 12 1 Copy input landuse shapefile to s12 BGM landuse statistics shp done 12 11 Add a new held OID1 to s12 BGM la duse statistics shp done 12 111 Assign FID values to OID1 done 12 1V Load 7 distinct landuses from input shapefile 12 V Loop through to process all landuses 12 V 1 Leisure 12 V 1 a SelectLayerByAttribute L4 USE Leisure 1 features 12 V 1 b CopyFeatures to s12 lb Leisure shp done 12 V 1 c ExtractByMask s12 lc extmk done 12 V 1 d Reclassify s12 ld story done 12 V 1 e Apply MajorityFilter three times s12 le majf3 12 V 1 f RegionGroup s12 lf reggp done 12 V 1 g Reclassify s12 lg relss done 12 V 1 h RegionGroup s12 lh reggp done 12 V 1 i MajorityFilter s12 la majft done 12 V 1 7 ExtractByAttributes s12 1j extat done 12 V 1 k ExtractByMask s12 lik bld done 12 V 1 1l ZonalStatistics s12 ll Leisure BGM stats dbf done 12 V 1 m RasterToPolygon s12 im bld poly shp done 12 V 2 Education 12 V 2 a SelectLayerByAttribute L4 USE Education 2 features 12 V 2 b CopyFeatures to s12 2b Education shp done 12 V 2 c ExtractByMask s12 2c extmk done 12 V 2 d Reclassify s12 2d story done 12 V 2 e Apply MajorityFilter three times s12 Ze majf3 12 V 2 f RegionGroup s12 2f reggp done 12 V 2 g Reclassify s12 2g rclss done Ll Vez Reg
35. icesOga gov au Appendix Abbreviations used in this document Abbreviation Full Text AOI Area of Interest BGM Building Geometry Model DEM Digital Elevation Model DSM Digital Surface Model GDB Geodatabase GUI Graphic User Interface LIDAR Light Detection And Ranging NDVI Normalised Difference Vegetation Index NGIG National Geographical Information Group QA QC Quality Assurance and Quality Control Appendix ll Workflow chart of BGM system The workflow chart visually describes the key components of the BGM system GeoTIFF rasters within the AOI are used to create a vegetation mask A final mask containing vegetation road and water areas is created For the same AOI building height is derived from the DSM and DEM excluding masked areas Land use is combined with building heights to derive building statistics on the number of storeys and area by land use For each GeoTIFF over AOI For each raster over AOI IR Red Blue Red DSM DEM IR Red gt Min Value Blue Roof Unmask Vegetation Mask Final n Building 2m DEM Land Use Shapefile Convert For each land use over AOI height to storeys Filter noise amp isolated pixels Run Zonal Statistics Inter Storey Height Tables Building Statistics Shapefile Building Height Shapefile Appendix Ill Steps for testing BGM application using sample inputs 1 Setup BGM application Obtain a z
36. ich reminds the user to select a value from the list of Land Use field names retrieved from the Land Use shapefile Jse Field Name has not been defined Please select one from the dropdown list The running status located on the right most side of the status bar is a small circular image representing the current status of the system Table 3 2 lists all possible status and its corresponding images Table 3 2 List of system status indicators and corresponding images Idle E Y No process has started yet The system is in waiting status Running ub A process is running after clicking on the Run button Paused aun A running process is suspended at a break point after the Pause button is clicked and may be resumed by clicking on the Run button again Stopped c A running process has been stopped after the Stop button is clicked The process cannot be resumed although some intermediate outputs may be kept in the output directory Succeeded A process has successfully completed Failed ES A process either failed at a middle stage or completed unsuccessfully The causes of the failure may be printed on the runtime window 3 9 FOOTER PANEL The Footer panel is located at the bottom of the GUI It consists of four parts Creative Commons icon button c9 077 This button is represented by the Creative Commons icon which is linked to the official website of Creative Commons organisation Clicking the button will pop
37. ignore the missing tile image s and continue the process As shown in the snapshot above there are there are two tile images of the same tile 5121630 missing If the user clicks the Yes button on the dialog window the two missing images will be ignore and the process will proceed Otherwise the process will stop if the user clicks the No button The warning dialog window may appear more than once if tile images are missed from the input directories The user needs to response to each of them If any GeoTIFF image tiles are missing the system will display an information dialog window listing all missing tiles at the completion of the validation The user is prompted to click the OK button to ignore them because that the vegetation mask derived from GeoTIFF tiles is one of the optional inputs To proceed with processing correct any errors based on the information returned in the error messages if any At the end click the Run button to restart the process if all known errors have been fixed Process datasets If there are no more error messages the system will proceed to process all tiled rasters over the AOl s one by one The running status image at the rightmost side of the Status bar will change from to V both the Run and Close buttons will be disabled and the Pause and Stop buttons will be enabled Meanwhile the runtime processing information will be printed out to the Runtime Information window Ti What to do with e
38. including blue roof cladding were being included in the vegetation mask and were subsequently being excluded from the building geometry calculations In this version of the BGM the geoprocessing calculates the difference between the blue cell value and the red cell value Blue minus Red for each cell location in the available imagery The result is a raster dataset that indicates the intensity of the blue colouring of the feature at each location Values may be between O and 255 The output of this calculation is stored in the raster dataset s with s4 tile reference br at the end of the file name and the dataset s can be inspected if temporary intermediate files are not deleted This text entry allows the user to define the lower limit of the Blue minus Red calculation The default value is 30 Cells with a value equal to or greater than that specified here will be used to unmask areas that would otherwise be included in the vegetation mask If this text box is empty or the value entered is invalid e g O or negative values no blue roof masks will be created This threshold value will be ignored if the Aerial Imagery Path is empty or does not contain GeoTIFF images Output Pixel Cell Size Output Pixel Cell Size opm 02m These two radio checkboxes define the horizontal resolution of output raster datasets The default value is 1 metre Select Land Use Field Land Use Field Name Please select This dropdown menu box i
39. ing hillshade from s10_dem_bldg DEM DSM S12 lu mosaic 12 Same as input Raster over the whole AOI with pixel value as the number of storeys DEM DSM 5 2 3 Raster and vector output examples The graphical display below is an example of the intermediate and final outputs generated during the BGM process The final outputs are identified in the stored output field in the table below The description and usage field explains the result of each step in the process Table 5 9 Examples of intermediate and final outputs generated during a BGM process y y n a n a n a Mosaic of tiled 4 band aerial imagery in GeoTIFF format Mosaic of tiled raster datasets derived from LIDAR point cloud first return surface Mosaic of tiled raster datasets derived from LIDAR point cloud bare earth model Subtraction of DEM mosaic from DSM mosaic s3 height ext Result of applying minimum height threshold on sa ndvi mosai S4 veg mask subtraction of DEM from DSM Definition of Non Developable Land Areas orange and Water Areas blue These areas are pre defined polygon features and are converted to raster during processing and set to 9999 Calculation of Normalised Difference Vegetation Index NDVI derived from Red and Infra Red bands of aerial imagery In this example green represents areas of strong vegetation health and red areas represent poor vegetation health or no vegetation Result of applying
40. inter storey heights for a specific project and can be adjusted by the user to suit local building standards The diagrams below illustrate how the Inter Storey Height values vary for buildings of different uses _ 5 storeys 2 NH d 3 5 m A storeys 7 oS 3 5 m b 3 storeys 2 3 storeys E 2 8m 7 1 storey 3 5m 2 storeys ya a 3 5m ae 1 storey 3 5m LOWER LIMIT UPPER LIMIT NO STOREYS i edj 2 A df 112 3 The user can modify the Inter Storey Height Lookup Table by 1 Creating column 2 Modifying the values of the cells under the headers LOWER LIMIT UPPER LIMIT and NO STOREYS to suit the Inter Storey Heights for the specified land use 3 Repeating Steps 1 to 3 for all applicable land uses In the examples above the Inter Storey Height value i e the difference between the Upper and Lower Limits is 3 metres For Storey 1 the Lower Limit is set to 2 metres equal to the Minimum Roof Height set in the GUI and the Upper Limit for the first storey is double the value of higher floors This allows for one storey buildings that have roof structures that should not be counted as a second storey Aerial Imagery Path Aerial Imagery Path al Is an input textbox defining the path of a directory containing a series of tiled GeoTIFF images that can be used to derive vegetation masks The value for this textbox can be either direc
41. ionGroup s12 2h reggp done 12 V 2 i MajorityFilter s12 2i majft done l2 V 24 ExtractByAttributes s12 2j extat done 12 V 2 k ExtractByMask s12 2k bld done 12 V 2 1l ZonalStatistics s12 21 Education BGM stats dbf done 12 V 2 m RasterToPolygon s12 2m bld poly shp done L2 V 5 Cultural 12 V 3 a SelectbhbayetByAttribute L4 USE Cultural 2 features 12 V 3 b CopyFeatures to s12 5b Cultural shp done 12 V 3 c ExtractByMask s12 3c extmk done 12 V 3 d hBeclassify s12 3d Story done 12 V 3 e Apply MajorityFilter three times s12 3e majf3 12 V 3 f RegionGroup s12 3f reggp done 12 V 3 g Reclassify s12 od relss done 12 V 3 h RegionGroup s12 3h reggp done 12 V 3 i MajorityFilter s12 3i majft done 124 V 947 ExtractByAttributes s12 3j extat done 12 V 3 k ExtractByMask s12 3k bld done 12 V 9 1 ZonalStatistics s12 31 Cultural BGM stats dbf done 12 V 3 m RasterToPolygon s12 3m bld poly shp done 12 V 4 Formal Settlements 12 V 4 a SelectLayerByAttribute L4 USE Formal Settlements 50 features 12 V 4 b CopyFeatures to s12 4b FormalSettlements shp done 12 V 4 c ExtractByMask s12 4c extmk done 12 V 4 d Reclassify s12 4d story done 12 V 4 e Apply MajorityFilter three times s12 4e majf3 12 V 4 f RegionGroup s12 4f reggp done 12 V 4 g Reclassify s12 4g rclss done 12 V 4 h RegionGroup s12 4h reggp done 12 V 4 i Majorityrilter s12 41 majft done 12 V 4 ExtractByAttributes s12 4j extat done 12 V 4 k Extrac
42. ipped copy of BGM v1 1 and unzip it to anywhere in a local drive on a PC or laptop For the convenience of this testing it is suggested that the user place the unzipped BGM v1 1 to C Temp directory If the user saves the BGM v1 1 to a different location such as C Workspace then the user needs to replace the C 7emp directory with C Workspace in the following examples The internal folder structure of the BGM application should be the same as the screenshot shown below BGM v1 1 El Ez samples E lookup_table Name Inter Storey Heights v0 1 ts E raster data config El El DEM Eu HH e5261616 clip DE 2 DSM d ima i EB s5261616 clip di nb El El Vegetation 4i log EH 15261616 clip m python El vector_data MEOS i EA Sample Area of interest poa aa a Sample Land Use 4 bGM exe xl Sample Road Areas Ed Sample Tile Grid d Sample Water Areas start BGM bat Please note that there is a samples subdirectory within BGM v1 1 This subdirectory contains sample inputs required for a quick testing There are three subdirectories in that directory lookup table raster data and vector data Browse through each to become familiar with the formats and contents of these input datasets 2 Startup the BGM GUI Double click on the BGM exe icon y BGM exe a MS DOS Command Prompt window will pop out and within a few seconds the BGM GUI will appear ie CATemp test BGM exe IMstart to run BGM GUI Please wait while l
43. l window will make the control buttons more accessible 3 7 CONTROL BUTTONS PANEL Run Pause Stop Close This panel comprises four buttons Run Pause Stop and Close buttons that are used to manipulate processes The button statuses may change in response to the running statuses of the application Table 3 1 Table 3 1 Changes in button status in response to changes of system running status Run Button Pause Button Stop Button Close Button Idle Enabled Disabled Disabled Enabled Running Disabled Enabled Enabled Disabled Paused Enabled Disabled Enabled Disabled Stopped Enabled Disabled Disabled Enabled Run Button This button is used to run a process Click on the Run button the system will first valid all input parameters define in the Area of Interests Shapefile and Select I O Parameters panels If the validation is successful it then starts the process By default this button is enabled but once a process is running it will be disabled When the process has completed regardless of whether it succeeded or failed or is paused or stopped this button will be enabled again refer to Table 3 1 Pause Button This button is used to suspend a running process It may take a while for the system to suspend a process as it has to wait until a break point in the process is reached Clicking the Run button will resume the process from that break point Its initial status is disabled and will change to enabled once a process is
44. landuse statistics shp 12 VII 58 data loaded from 5 tables 12 VIII Populate all statistics data into s12 BGM landuse statistics shp 12 12 Mosaic 5 rasters over landuses to 312 lu mosaic done 00 01 02 911 Process of Sample Area completed successfully CPU time 00 02 23 345 Run Pause Stop Close o0 Pmemsmgcmphedsucestuy 9 Runtime information or log file The user may check the detailed processing information on the Runtime Information window or the log file from C Temp BGM_v1 1 log subdirectory Please note that Step 12 V 6 was skipped due to no valid building pixels available for Agriculture land use over the example AOI 18 20 53 25 03 2013 by u43894 on PC 62968 Start processes for the Building Geometry Model Program Directory C Workspace dev BGM Input parameters AOI Shapefile Path C Temp BGM v1 0 samples vector data Sample Area of interest shp Input DEM Directory C Temp BGM v1 0 samples raster data DEM Input DSM Directory C Temp BGM v1 0 samples raster data DSM Input Tile Index Shapefile Path C Temp BGM v1 0 samples vector data Sample Tile Grid shp Vegetation Mask Directory C Temp BGM v1 0 samples raster data Vegetation Land Use Mask Shapefile Path C Temp BGM vl 0 samples vector data Sample Land Use shp Road Mask Shapefile Path C Temp BGM v1 0 samples vector data Sample Road Areas shp Water Mask Shapefile Path C Temp BGM vl 0 samples vector data Sample Water Areas shp Inter Storey
45. ll give an error message if the process is run If the parent path exists but there is no such a directory bgm outputs under the parent directory a new directory called bgm outputs will be created by the system 3 5 SYSTEM SETTINGS PANEL This panel comprises three columns of widgets the left column consists of three checkboxes to control the conduct of specific actions during or after each process the middle column contains three text entry fields for defining specific threshold values for the process the right one is a mix of a text entry field a radio checkbox group and a dropdown menu box All the checkboxes are optional as default values choices are provided but the text entry fields are mandatory and default values are provided in most cases Select System Settings denotes mandatory fields Iv Delete temporary intermediate files Minimum Roof H eight 2 m Blue Feature Index 30 v Write runtime information to log file Maximum Tree Height 40 m OutputPielCellSize 1m 2m v Save settings on successful validation Minimum Footprint 8 me Land Use Field Name Please select Delete temporary and intermediate files v Delete temporary intermediate files This checkbox enables a user to control the storage of temporary and intermediate raster image files after the completion of a process Raster dataset generated throughout the processing may be kept for examination during testing and validation stages Altern
46. low 4 1 SELECT AREA S OF INTEREST Select or enter a file path for the AOI shapefile This step is to select a shapefile that defines the Area s of Interest AOls over which tiled rasters are to be processed The user may enter or copy a path to the AOI Shapefile textbox or click the browse button Elto open a dialog box and select the desired shapefile Select Area of Interest AOI denotes mandatory fields AOI Shapefile E C Compilation Pasig City Administrative Boundaries Pasig City Admin Boundaries 201210 shp Field Defining AOIS Please select Name of AD Whole Region Initially the Field Defining AOls menu box is empty if the AOI Shapefile textbox is empty or the path entered to it is not exist or invalid Once the AOI Shapefile textbox is filled with a valid shapefile path the Field Defining AOls and Name of AOI dropdown menu boxes will display initial values of Please select and Whole Region respectively The user can process the whole region delimited by the AOI shapefile selected entered by skipping the next two steps and go to oection 4 2 Select the name of a field that defines Area s Of Interest AOls Click the Field Defining AOls dropdown menu box a list of text field names retrieved from the AOI shapefile selected will drop out Click the menu box to select a desired field name In the example below the dropdown menu box contains two potential AOI fields BARANGAY and CITY MUNIC Select
47. n and the GUI are listed in Table 2 1 Table 2 1 Minimum and desired hardware requirements for the BGM application and its GUI rc ONE COGN RAM 1 Gs 4 GB Hard Disk 2068 50GB Screen Resolution 1024x768 pixels 1400x1050 pixels Colour Te cont 32 bil 2 3 DOWNLOAD A COPY OF BGM APPLICATION Download a copy of the zipped BGM file locally or on a network drive The application runs as an executable and does not need to be installed Storing datasets locally and running locally is more efficient but not essential for large datasets Please note that the first two digits in the version number represent a major release which has significant changes in either the code algorithm or inputs while the third digit refers to a minor release version in response to some minor changes For simplicity minor releases are ignored and only the major versions such as Version 1 1 are discussed in this document z de BGM v1 0 Mame Date modified Type confi 4 di config oc Je doc 26 03 2013 2 39 PM File folder 23 04 2013 3 03 PM File folder LITE e A lll im 2 04 2013 1 50 PM Filefolder gt B ib 22 03 2013 12 03 File folder oO x T lll tog 22 04 2013 3 09 PM File folder ad on i li python 22 04 2013 3 09 PM File folder gis ae 26 03 2013 236 PM File folder ul 3 4 BGM exe 8 11 2012 210 PM Application IG il a start BGM bat 8 04 2013 6 31 PM Windows Batch File dar b de samples As shown in the sc
48. nd are encouraged to re run the process over a given AOI with modified input parameters if unexpected results occur The speed at which the BGM will process data for an AOI is dependent on the specifications of the user s device and the size of the AOI Users are encouraged to experiment with the size of the AOI if difficulties are encountered in completing the data processing 6 Maintenance and Feedback 6 1 MAINTENANCE 6 1 1 Cannot start BGM GUI on PC or laptop Ensure the ArcGIS 10 0 and Python 2 6 paths defined in the system file are valid and exist on the users PC If running on an IT managed PC or Laptop check with your IT service provider if the equipment requires user permissions privileges to run this software application Some IT providers may restrict permissions on entire PCs or Laptops or selected folders Both ArcGIS and Python paths are defined in the configuration batch file config BGM BATCH STARTUP CONFIG bat If the user wishes to change any of the paths open this file in Notepad WordPad or any other text editors Below is part of the file opened and shows where the two paths are defined The user can only change the path s on the right side of equals marks leaving others untouched For example if the path of Python home on the user s PC is C Python26 the user may change C Python26 ArcGIS10 0 to C Python26 so that the whole line will be SET PYTHON_HOME C Python26
49. nerates a series of raster images either over a single tile a land use polygon or the whole AOI most of which are temporary or intermediate outputs and therefore can be discarded to reduce disk space i e by checking the Delete temporary intermediate files box in the Select System Settings panel of the GUI Table 5 8 lists the final raster images that are kept in the output directory For those removed please refer to the runtime log file described in oection 5 2 3 for details and Section 5 2 4 for a graphical display example of the intermediate and final outputs stored by default during the running of the application Table 5 8 L ist of raster datasets generated during processing and preserved as outputs s3 height ext Same as input Height difference DEM DSM raster over the whole AOI after applying the Minimum Roof DEM DSM Height filter s4 ndvi mask 4 Same as aerial NDVI values over the whole AO after applying the IR Red IR Red calculation imagery S4 veg mask 4 Same as aerial Vegetation mask over the whole AO after extracting values between 0 3 1 0 from s4_ imagery ndvi mask and excluding blue roofs s8 ht 1000div 8 Same as input Building roof heights above ground after removal of noise and isolated pixels from s7 ht DEM DSM mask O s10 dem bldg 10 Same as input Raster over the whole AOI after mosaic of s9 dem ht msk and s2 dem mosaic DEM DSM s11 bldht shd 11 Same as input Raster over the whole AO after calculat
50. ng The primary advantage of the Building Geometry Model is the ability to rapidly estimate the floor area of buildings from derivatives of digital terrain and surface data The application also generates numerous intermediate datasets that may be useful for a variety of spatial analysis projects or activities In designing the processes in the BGM application the quality of the outputs is dependent on a number of factors The accuracy of the outputs will be maximised if the following criteria are satisfied e All inputs are available in the same projected coordinate system e DEM and DSM data have been generated with sufficient vertical accuracy e 4 band aerial imagery is available for the same spatial extents as DEM and DSM data and is at the same resolution or higher resolution than the DEM and DSM data e Aerial imagery is cloud free and minimal variations in contrast and illumination e Input polygon data accurately defines the extent of developable land and the extent of land uses e g buildings are not bisected by land use boundaries e Actual land use has been accurately classified e The horizontal extent of the land use has been accurately captured e The slope of the DEM within building extents is equal or close to O as per the slope of a building s foundation e Detected buildings are all constructed on the ground i e there is little or no elevation of the building s ground floor from the underlying terrain e nter
51. oading data BEGM GUI has been successfully created 3 Select or enter input output paths For the convenience of users the system has packaged with a previously saved GUI configuration file When starting up the GUI most of the path entry fields on the GUI will be filled with values loaded from the configuration file If the BGM v1 1 is located on a path rather than C 7emp the user needs to replace C Temp with the path where BGM v1 1 resides for all the path fields on the GUI However the output directory does not necessarily need to be in the same directory as the input paths Either click the browse button Al to select an existing directory or enter a new one to the Output Directory text field for the system to create it accordingly y pm 7 7 Building Geometry Model LIDAR rum cs Building Geometry Model Derive building extents and heights from LIDAR data Select Area of Interest AOI denotes mandatory fields AOI Shapefile C temp samples vector data sample Area of interest shp Field Defining AOls CITY Mame of AO Sample Area Select V O Parameters denotes mandatory fields Edit Tiled Filename Formats Add More Masks Digital Elevation Model Path IC temp samples raster data DEM Digital Surface Model Path C temp samples raster data DSM Tile Index Shapefile C Temp samples vector data Sample Tile Gridlshp Land Use Shapefile C temp samples vector data Sample Land Use shp
52. on status A CPU processing time duration for each main step and the total CPU time for the whole process are printed in the log file In addition this log is a source for checking the names of final and temporary output files Table 5 10 is an example of the content of a log file in which some of repeated loop steps have been omitted for simplicity Table 5 10 Example of a runtime log file generated by BGM application 10 47 29 10 12 2012 by u43894 on PC 62968 Start processes for the Building Geometry Model Program Directory C Workspace dev BGM Input Parameters AOI Shapefile Path X PRS92 v2011 Angono Municipality Admin Boundaries 201212 shp Input DEM Directory X PRS92 v2011 Digital Elevation Model Input DSM Directory X PRS92 v2011 Digital Surface Model Input Tile Index Shapefile Path X PRS92 v2011 Digital Elevation Model DEM Index DEM _ Index shp Vegetation Mask Directory X PRS92 vol20110905 Imagery geotiff Land Use Mask Shapefile Path X PRS92 v2011NLand UselAngono Municipality Land Use 201212 shp Road Mask Shapefile Path X 1PRS92 v2011NLand UselAngono Municipality Road Areas 201212 shp Water Mask Shapefile Path X 1PRS92 v20111Land UselAngono Municipality Water Areas 201212 shp Inter Storey Heights Excel File Path I Feature Location documents Inter Storey Heights _ v0 1 xls Output directory C Temp bgm outputs Processing ANGONO Step 1 Select raster tile indexes within ANGONO Number of tiles found 21 Ignore
53. ontents CONTENT sat III DX a seRbqije 1 L IG LIEN SezcuP BTE 3 A NR mer d 2 2 OY EM TE QUISISTE sica s Ren Ru vid un A M d it o Na d 2 9 Download copy or BONESDDIIOEUODE areeni UR bl nci dd ua dd iii 4 AS BOM appo AAA X asa Rn RR RD eu viu uni DA ESE onu d da i nut bv a aM E ceu 5 e EEE Rer PS 3 20 eoru cu VSIA RUE liado 6 2 MAIN COMPONEN TS OF BO ic iia SANI E E a E TEES ETC N 7 ey APA o e oO An E CO UE PUE E a ee ee 8 Sa Selectarea ol mlorot Panelen aiian eniak dd AN cda 8 BAe oec O parameters PANE MR di 9 ces le Es P DINE PENNE LU T o OO unen 13 220 cibus LTO FM ARO ines A 16 ss febo jo E T I T Uu E ono rn lt A 16 E A e E E UE E PES oe M Soo maceria ERN 18 A RON nig M rcs e ree o o PER 20 ARMES esi zs NS MIT cUm SETAE EAN AEE 20 4 2 Define edit the formats Tor tile TIMES eiii 2 GNO S sueiqe i m CRIT ETT 2 LR NE salua Poit A e POP OOO o m 22 Zo Select system setings anc Tre SOI Sarna io A A AA RR reais 22 A PUNTOD e m oO ono US ez 23 2 INPUTS ANDO OOPS toos 20 PP A a 25 eS qee ea IN AP OE 25 SPAN eA EP R E OTTENUTO 2 5ta Med Geor IFF ite cmm 27 5 14 Excel spreadsheet IEEE E me Zi ESO ale ases CU PEE o o ooo 28 S AN UI IS RO PAU uo Ann OA H 28 seo dosis na ta 0 MAA O ES EE 0 EE E N 28 SA
54. ormation window 3 7 Control buttons panel 3 8 Status bar and 3 9 Footer 76 Building Geometry Model LIDAR Building Geometry Model 3 2 Pari j ES DESEE e ses etd pea nore pul ERE PO EN pcb Calls PA Jafa L enve DUNOMO extents and Aegis from LIDAR data Version 7 7 0 Select Area of Interest AOI denotes mandatory fields dad AOI Shapefile al Field Defining ADIs Mame af AOI Select I O Parameters denotes mandatory fields Edit Tiled Filename Formats Add More Masks Digital Elevation Model Path al Digital Surface Model Path al Tile Index Shapefile al Land Use Shapefile al Inter Storey Height Excel File al 3 4 Aerial Imagery Path al Road Mask Shapefile Sl Water Mask Shapefile Sl Output Directory al Select System Settings denotes mandatory fields v Delete temporary intermediate files Minimum Roof Height 2 z Blue Feature Index 30 v Write runtime information to log file Maximum Tree Height 40 m Output PixelCell Size Y 1m f 2m 3 5 W Save settings on successful validation Minimum Footprint 3 mz Land Use Field Name Please select NDVI Threshold 0 3 Imagery Band Numbers Red Band Green Band Blue Band Infra Red Band Runtime Information Hide 3 6 Run Close 3 7 Please enter VO paths and parameters 3 8 q c Commonwealth af Australia Geoscience Australia 2014 About BGM Disclaimer a 3 9 3 2 TITLE PANEL Building Geometry Model Derive building
55. out a webpage showing the Creative Commons license webpage C ESMMONS Attribution 3 0 Australia CREATIVE COMMONS CORPORATION ES NOT A LAW FIRM AND DOES NOT PROVIDE LEGAL SERVICES DISTRIBUTION OF THIS LICENCE DOES NOT CREATE AN ATTORNEY CLIENT RELATIONSHIP CREATIVE COMMONS PROVIDES THIS INFORMATION ON AN AS IS BASIS CREATIVE COMMONS MAKES NO WARRANTIES REGARDING THE INFORMATION PROVIDED AND DISCLAIMS LIABILITY FOR DAMAGES RESULTING FROM ITS USE Licence THE WORK AS DEFINED BELOW I PROVIDED UNDER THE TERMS OF THIS CREATIVE COMMONS PUBLIC LICENCE LICENCE THE WORK IS PROTECTED BY COPYRIGHT ANCUOR OTHER APPLICABLE LAW ANY USE OF THE WORK OTHER THAN AS AUTHORISED UNDER THIS LICENCE OR COPYRIGHT LAW I8 PROHIBITED HY EXERCISING ANY RIGHTS TO THE WORK PRONMIDED HERE YOU ACCEPT AND AGREE TO BE BOUND BY THE TERMS OF THIS LICENCE THE LICENSOR GRANTS YOU THE RIGHTS CONTAINED HERE IN CONSIDERATION OF YOUR ACCEPTANCE OF SUCH TERMS AND CONDITIONS Geoscience Australia copyright button ir Commonwealth of Australia GSeoscience Australia 201 Is a button linked to Geoscience Australia s copyright webpage Cares Cents Sknin Came A oa ae E Applying gececience to Australia s most important challenges ag y Ausiralian dioverarmeni God amni valida P Abal Us Scientific Tapes Education Data Publications News amp Evenls Horse Cieri Aliribulin Maleral Sourced hom Dore Arda Wabe EN Copyright Attrib
56. pecific AOI value from the menu box The difference between Whole Region All AOls or a specific AOI value will be explained in Section 4 1 3 4 SELECT I O PARAMETERS PANEL This panel consists of nine text entry fields for selecting or entering input file paths and output directory six of which are mandatory fields denoted with asterisk marks A mandatory field requires a valid path to be provided The system will not start to run if any of the mandatory fields are empty or do not exist but will run if any of the optional fields is empty However if any of the optional fields specify a path that is not valid or does not exist an error message will be displayed in the Status bar preventing the system from running Select I O Parameters denotes mandatory fields Edit Tiled Filename Formats Add More Masks Digital Elevation Model Path S Digital Surface ModelPath o Eg Tile Index Shapefile D al Land Use Shapefile A al Inter Storey Height Exa Aerial Imagery Path l RoadMaskShapefle Water Mask Shapefile A al Output A Eg Edit Tiled Filename Formats button The BGM application consumes a series of raster datasets and GeoTIFF images as the main inputs These input datasets and images should follow a consistent naming convention for each input type The BGM application provides a facility for viewing defining and editing the filename formats through the Edit Tiled Filename Formats button next to the
57. ppines However the BGM application has been designed to process data regardless of its geographic location The object oriented programming techniques and design patterns were used in the software design and development In order to provide users with a convenient interface to run the application on Microsoft Windows a Python based Graphical User Interface GUI was implemented in March 2012 and significantly improved in the subsequent months The application can be either run as a command line program or start via the GUI The original Version 1 0 of the BGM has been replaced by Version 1 1 which incorporates changes to both the geoprocessing methods and the GUI In the geoprocessing methods for Version 1 1 the method for calculating the extent of blue roof areas has been improved which ultimately improves the estimation of vegetation extents In this version the user now also has the ability to specify additional datasets that can be used to mask out features from the calculations such as elevated structures that are not buildings As a result of changes to the GUI in Version 1 1 the user can now e Specify the new threshold for the blue roof values in the new Blue Roof Unmask e Designate band numbers and colours specific to the aerial imagery being used e Control the NDVI threshold used for determining vegetation extents from aerial imagery e Specify one or more additional masking datasets Minor changes to the temporary intermedi
58. rameters panels will be saved to a system configuration file Next time when a user starts the BGM GUI the system will automatically retrieve all saved parameters and populates them in the corresponding fields This is one of the mechanisms for a system to remember previous settings and users choices It may be helpful for users to save time in entering or selecting input paths By default this checkbox is checked Minimum Roof Height Minimum Roof Height 2 m This text entry field defines the minimum height for building roofs Any building height cell with a value less than this threshold will not be considered as a building and therefore will be excluded from further processing The default value Is 2 metres Maximum Tree Height Maximum Tree Height 140 m This text entry field defines the maximum height of trees Any cell in the vegetation mask with a height greater than this threshold will not be considered as part of vegetation and therefore will be excluded from the mask The default value is 40 metres Minimum Footprint Minimum Footprint p m This text entry field defines the minimum footprint area Any area assumed to form part of the building extent with a footprint area smaller than this threshold will be excluded from statistics calculation The default value is 9 square metres Blue Feature Index Blue Feature Index 30 This variable was added following observations that in some instances blue coloured objects
59. reenshot above the BGM home directory contains seven subdirectories and two files Table 2 2 lists these subdirectories and files and their usage Table 2 2 Folders and files within the home folder of BGM application File Folder Contains all configuration files for the system Ji config li d File Folder Contains readme txt release note txt and this manual document DE n bn File Folder Contains icons and system status images de lib File Folder Contains two third party libraries for the system Pmw 1 3 2 a toolkit for building high level GUI compound widgets in Python and xIrd 0 7 9 a Python library for extracting data from Microsoft Excel spread sheet files de log File Folder Store all runtime log and system log files n maion File Folder Contains all Python source code and compiled binary files n samples File Folder Contains sample inputs for a quick testing of the BGM application E MS DOS Batch File A MS DOS batch file double clicking on which will start the BGM GUI 4 BGM exe ec Executable exe File An icon representing BGM exe double clicking of which will start the BGM GUI Start_ ba It is recommended the user creates a shortcut of the BGM exe shown as an icon image 53 on the desktop of the user s computer To start the BGM GUI on Windows by double clicking on the shortcut icon 2 4 SETUP BGM APPLICATION The application downloaded does not require installation and can be run straight aw
60. rocessing and preserved in final outputs s12 BGM landuse statistics shp 12 Polygon shapefile of building statistics for each land use area s12_BGM_landuse_ storeys shp 12 Shapefile equivalent of final raster output The shapefile named s12_BGM_landuse_statistics shp preserves the input attribute fields and records the statistical information derived from the building geometry calculations Table 5 7 describes the additional fields and their characteristics Table 5 7 List of additional fields included with output s12 BGM landuse statistics shp OID1 Long Integer Unique identifier of the polygon FOOTPRINT Double Sum of building footprint area in polygon FOOIPRIPC Double Percentage of polygon area occupied by building s FLAREA SUM Long Integer 9 Sum of floor area of buildings within polygon SIOR MAX Long Integer 4 Maximum number of storeys of buildings in polygon STOR_MIN Long Integer 4 Minimum number of storeys of buildings in polygon STOR_RANGE Long Integer 4 Range of storeys of buildings in polygon STOR_MED Long Integer 4 Median number of storeys of buildings in polygon STOR_MAJ Long Integer 4 The storey value that occurs most often for buildings in polygon STOR_MNR Long Integer 4 The storey value that occurs least often for buildings in polygon STOR_MEAN Double Mean number of storeys of buildings in polygon STORESTD Double Standard deviation of number of storeys 5 2 2 Raster data outputs The system ge
61. running Stop Button The Stop button is used to immediately stop any running processes Its initial status is disabled It will be automatically enabled whenever the Run button is clicked and the system is running a process Close Button F Confirm exit This button provides a convenient way to close the main frame of the BGM GUI Another way to close the GUI is to click the button on the top right corner of the GUI frame However the GUI cannot be closed while there is a process running The initial status of the Close button is enabled but will change to disabled if a process is running Therefore the user may need to stop the process running before being able to close the GUI When the Close button is enabled clicking on it will pop out a conformation dialog asking Do you really want to quit the application Clicking the OK button in the dialog window closes the GUI or Cancel button keeps the GUI open 3 8 STATUS BAR The Status bar consists of a Message Board and a running status indicator The Message Board is a non editable textbox for displaying reminders the current processing status or instant messages about an operation being performed It also shows error and warning messages on illegal operations and invalid inputs Whenever an error warning message is displayed the Message Board will be highlighted in red colour The example below shows an error message highlighted in red colour in the Message Board wh
62. s L4_ USE is the only choice of selection Table 5 3 Schema of the Land Use shapefile Object ID Shape Geometry Polygon NAME Text 254 0 0 SOURCE Text 254 0 0 COMMENTS Text 254 0 0 5 USE Text 254 0 0 E MUSS Text 254 0 0 AREA SQM Double 8 0 0 Road Mask and Water Mask Shapefiles Both shapefiles are optional inputs They share the same schema as shown in the example in Table 5 4 Table 5 4 Schema of the road mask and water mask shapefiles Object ID Shape Geometry Polygon SUSE Text 254 0 0 L2 USE Text 254 0 0 AREA SQM Double 8 0 0 5 1 2 Tiled raster datasets Both tiled DEM and DSM raster images are stored in directories with internal structure as shown in Table 5 5 Table 5 5 Internal folder structures of the input DEM and DSM datasets a DEM Datasets b DSM Datasets E Digital Elevation Model El Digital_Surface_Model Ez DEM Index Ez DSM Index e2011 Mosaiclm s2011 Mosaiclm E E Tileslkm 1km E E Tilesikm 1km Has e155157201001 8 2455157201001 ES e155157301001 Has 455157301001 REB 455157401001 Hig 5455157401001 EB e455157501001 Hee 5455157501001 5 1 3 Tiled GeoTIFF images The GeoTIFF images are used to derive vegetation masks It is assumed that all tiled GeoTIFF images are stored in the same directory defined in the Aerial Imagery Path text field and their filenames are in and indexed format 5 1 4 Excel spreadsheet file The input Excel file consists of multiple worksheets whose nam
63. s a mandatory field The value to this field can be either entered directly or selected through the browse button Sl Land Use Shapefile Land Use Shapefile Sal Is an input textbox defining the full path of a polygon shapefile that contains land use extents and classes defined at one or many levels of detail It is a mandatory field The examples used in this manual are L USE where L5_USE is the most detailed level Inter Storey Heights Excel File Inter Storey Height Excel File Sl Is an input textbox defining the full path for an Excel file consisting of multiple spreadsheets each of which defines the height ranges and storey numbers for a specific land uses lt is a mandatory field The Inter Storey Height Lookup Table defines the Lower Limit lowest elevation above ground in metres and Upper Limit highest elevation above ground in metres for each storey of a building These are needed to covert height values of cells into the number of storeys of a building It is based on the assumption that buildings are constructed with standard ceiling heights The Inter Storey Height is a sum of the ceiling height and the height of supports between a ceiling and the next highest floor such as beams and floorboards The application is able to apply land use specific height limits The height limits and storeys can be changed to suit area specific conditions The series of tables included in the sample data are examples of building
64. s used to select a field name from the input Land Use Shapefile defined in Section 3 4 The field name to be selected can be any text but it is expected that the field should contain a category of land uses at a certain level of classification and all these land uses defined by that field must be defined in the nter Storey Heights Excel File This is a mandatory field By default this menu box is empty displaying a text message of Please select Once a valid shapefile path is entered to the Land Use Shapefile textbox all TEXT field names from the input Land Use shapefile will be populated to the Land Use Field Name menu box If there is more than one land use classification defined in the input Land Use shapefile the user should choose the correct field whose land use classification is consistent with that defined in the Inter Storey Heights Excel File To prevent possible errors caused by the selection of incorrect field names the system will automatically validate the field name selected against the input nter Storey Heights Excel File before starting to process For details refer to oection 4 5 NDVI Threshold NDVI Threshold 0 3 The calculation of the vegetation mask is performed from calculating the Normalised Difference Vegetation Index NDVI from the 4 band imagery NDVI is an indicator of the presence and health of vegetation and the calculation of NDVI results in a raster dataset where the values are between 1 and 1 Higher
65. subtitle of Select I O Parameters panel Clicking on this button will display a dialog window for editing the formats of tiled filenames T View Edit the Formats of File Names with Tile Numbers Type of File Name Prefix of File Name Suffix of File Name Format of File Name DEM Raster File Name DSM Raster File Name Aerial Imagery Tile File Mame Cancel As shown above the dialog window comprises a table with four columns The first column Type of Filename lists three file types the Prefix of Filename and Suffix of Filename columns are used to define the parts of a filename before or after the tile number respectively Format of Filename column displays the corresponding filename formats composed from the prefix and suffix if defined If both the prefix and suffix of a file type are empty the corresponding Format of Filename column will be empty as well Initially all the latter three columns are empty Below image shows an example of the table after having filled with valid inputs The EEENNN in the Format of Filename column represents the tile numbers which could be a digit number of any length F View Edit the Formats of File Names with Tile Numbers Type of File Name Prefix of File Name Suffix of File Name Format of File Name DEM Raster File Name le 01011 eEEENNNNO1011 DSM Raster File Mame ls 01011 SEEEHNNHO101 1
66. tByMask s12 4k bld done 12 V 4 1 ZonalStatistics s12 4l FormalSettlements BGM stats dbf done 12 V 4 m RasterToPolygon s12 4m bld poly shp done 12 V 5 Informal Settlements 2 V 5 a gDelecthayerByAttribute hd USE Informal Settlements 4 features 12 V 5 b CopyFeatures to s12 5b InformalSettlements shp done 12 V 5 6 ExtractByMask s12 Sc extmk done 12 V b5 d Reclassity s12 5d story done 12 V 5 e Apply Magjoritybsilter three times s12 5e majr3 12 V 5 f RegionGroup s12 5f reggp done ll Veosg Reclassify s12 5g rolss done 12 V 5 h ReglionGroup 12 5h reggp done 12 V 5 i MayorityPilter s12 5i majrtt done 12 V 5 3 BXtractByALtriDutes s12 5J extat done 12 V 5 k bxtractByMask s12 Sk bla done 12 V 9 1 A4onalStatisties s12 5l InformalSettlements BGM stats dbf done 12 V 5 m RasterToPolygon s12 5m bld poly shp done 12 V 6 Agriculture 12 V 6 a 5electbayerByAttribute L4 USE Agriculture 1 features 12 V 6 b Copyreatures to s12 7b Agricouiture shp done 12 V 6 c BxtrdctByMask s12 7c extmk done Warning raster s12 7c extmk is empty Skip Update landuse Shapefile siz BGM landuse statistics shp 12 VI Add 10 new fields to s12 BGM landuse statistics shp 12 VII 58 data loaded from 5 tables 12 VIII Populate all statistics data into s12 BGM landuse statistics shp 12 IX Mosaic 5 rasters over landuses to s12 lu mosaic done 00701702911 Process of Sample Area completed successfully CPU time 00 02 23 345 1
67. tings The BGM Application v1 1 initialises its system parameter values through three input methods a load from a configuration setting input file b select parameters via the GUI setting panel and c batch command line parameters In either case default initial parameter values e g input paths output directory etc are provided These parameters can be modified and edited through text fields on the GUI Upon successful completion of a process all system settings will be saved in a system file and can be retrieved next time 5 2 OUTPUTS The outputs available after each successful process include a shapefiles b raster images mosaic over AOI containing building extends and height information and c a detailed runtime information log 5 2 1 Vector data outputs The system produces a few intermediate shapefiles that can be preserved or removed during processing The shapefiles that are always preserved by the application are s12 BGM landuse statistics shp and s12 BGM landuse storeys shp both of which are generated at the end of Step 12 The land use statistics shapefile is a copy of the input land use shapefile with detailed statistical information on building storeys for all features over a variety of land use types The land use storey shapefile is a vector version of the s8 ht 1000div raster where the raster height values are grouped and converted to the number of storeys Table 5 6 List of vector datasets generated during p
68. tion dialog will pop out prompting the user with a message that the NAME field contains no land use classification matching with that of input inter storey height lookup table After clicking on the Ok button on the dialog window the process will be aborted e Mismatched Landuze classification si j PE The landuse values from the field MAME of the input landuse shapetile do not match with those trom the mter storey height lookup lable Please check whether the landuse field NAME selected from the input landuze shapefile iz the right one and its landuze classification iz consistent with that in the inter storey height lookup table UK L4 USE and L5 USE are examples of valid field names as they define the classifications of land uses at different levels If the user selects one of the valid field names and all land uses defined by the field selected from the input land use shapefile match with those defined in the lookup table the process will proceed quietly However if any land uses defined by the field selected do not match with those defined in the lookup tables either an information or confirmation dialog windows will pop out informing the user of any mismatching land uses For instance if the user selects L 5 USE and clicks the Run button to start the process the same dialog will pop out again This is because that land uses defined by the L 5 USE field in the input Land Use shape
69. tly entered or selected via the browse button al It is an optional field It is expected that the name of each GeoTIFF image follows the similar format as those for DEM and DSM to ensure the correct GeoTIFF is processed with the same DEM and DSM tile extent Each GeoTIFF image must be a composite four band image and bands must be specified as Band 1 Band 2 Band 3 and Band 4 The colour assignment for each band can be specified in the System Settings Panel please refer to the description of that panel for further details Road Mask Shapefile Road Mask Shapefile al Is an input textbox defining the full path for a road mask shapefile It is an optional field Water Mask Shapefile Water Mask Shapefile Is an input textbox defining the full path for a water mask shapefile It is an optional field Output Directory Output Directory j Is an input textbox defining the main output directory that is used to store all temporary intermediate and final results It is also used as default workspace for ArcGIS geoprocessing tools and functions The value to this field can be either directly entered or selected through the browse button Al It isa mandatory field If the output directory entered does not exist the system will create it automatically provided that its parent path is valid and exists For example a full path C femp bgm_outputs is entered to the textbox If the parent path C temp does not exist the system wi
70. ts button to open the dialog window for viewing and editing the formats of tiled filenames T View Edit the Formats of Filenames with Tile Numbers Type of Filename Prefix of Filename Suffix of Filename Format of Filename DEM Raster Image Filename le clip eEEENNNN clip DSM Raster Image Filename ls _clip SEEENNNN_ clip Vegetation GeoTIFF Filename i elip EEENNNN_clip Save Cancel As shown above all filename formats filled with values loaded from previously saved system file The user may click the Cancel button to close the dialog window Select system settings and thresholds By default most checkboxes are checked and text entry fields are filled with predefined values on the Select System Settings panel The exception is the Land Use Field Name dropdown menu which the user must define Select System Settings denotes mandatory fields v Delete temporary intermediate files eee b Blue Feature Index 30 v Write runtime information to log file Maximum Tree Height 40 m OutputPixeUCelSize 1m C 2m Save settings on successful validation Minimum Footprint 9 m Land Use Field Name Please select Click the Land Use Field Name dropdown menu box and select L4_USE from the dropdown menu The Inter Storey Heights Lookup Table Excel file provided in the sample data only defines land use classifications at L4_USF level Land Use Field Name Please select MAME L5 USE LUSE
71. un button will resume the paused process or clicking the Stop button will stop the process completely Stop a running process By clicking the Stop button a running or paused process will be stopped immediately Both the Pause and Stop buttons will be disabled and the Run and Close buttons will be enabled in readiness for another run The running status image will change to 8 Close the GUI Upon clicking the Close button the GUI will be closed after clicking OK on the Confirm exit dialog box Please note that the GUI cannot be closed while a process is running or paused The user may need to stop any running or paused processes before closing the GUI window 5 Inputs and Outputs 5 1 INPUTS Data inputs to the BGM application include shapefiles tiled raster datasets tiled GeoTIFF images Excel spreadsheet file and initial system settings Throughout Section 5 1 there are references to inputs that were prepared during the development of the BGM The application does not require the user to prepare inputs with exactly the same schema or file names 5 1 1 Shapefiles There are five shapefiles of polygon geometry type that are either as mandatory or optional inputs to the system AOI Shapefile The AOI shapefile is a mandatory input dataset and consists of one or more polygons each of which defines an Area of Interest AOI over which tiled raster images to be processed Table 5 1 shows an example of the schema of an AOI shap
72. uting Material Sourced from i EEEE Geoscience Australia s Website Australia Sources of Infarmalien Copyright Altribuling Malena E Dute Mam E oim d m Australia s Website Cantents Goosclence Acstralla products Jobi precucts Gling Genscience Australia sources About BGM button Is a button used to display the current version and licence information about and a brief introduction to the Building Geometry Model BGM application in a separate window as shown below TA About Building Geometry Model Application Building Geometry Model Application F Version 1 1 0 Building Geometry Model BGM Application is a Python based software system used to execute ArcGIS geoprocessing routines developed by Geoscience Australia aiming to extract building and other elevated features and geometry information from LIDAR data The system implements algorithms developed by Matthew Jakab and Mark Dunford 2012 for utilising the LIDAR derivatives to estimate building footprint areas inter storey heights across areas occupied by buildings and eventually an estimate of gross floor area of different types of buildings Disclaimer button Is a button used to displaying the contents of the disclaimer for the use of BGM application in a separate window 6 Disclaimer Copyright c 2014 Commonwealth of Australia Geoscience Australia All rights reserved Redistribution and use in source and binary forms with
73. vector data Sample Road Areas shp 3 Water Mask Sha pefile C Tem p sam ples vector data Sampl e Water Areas shp I For item 4 the user can specify the name of an additional masking dataset in the Name of Mask field and can specify the file path to that dataset in the Path of Mask field The file path can be entered manually or selected through the browse button Sal Once details have been entered press Save to record these details If additional masks are to be specified press the More button to add a new line where the next Name of Mask and Path of Mask can be entered and or selected Press Save again to record the new entry Hepeat this as many times as needed When all the mask names and paths have been specified press the Close button Digital Elevation Model Path Digital Elevation Model Path j al Is an input textbox to define the path of a directory containing Digital Elevation Model DEM raster data 1he value to this field can be either entered directly or selected through the browse button Sal Clicking the browse button Al will open a folder selection dialog box for selecting the desired directory It is a mandatory field The internal folder structure of DEM path is predefined It is assumed that the DEM directory contains a list of sub directories each of which contains the actual DEM raster data over a single tile The tile names are in a format of eEEENNNNO 1001 where e stands for elevation the seven digit number
74. xisting directory HS The directory Sample Ares named by the Mame of AOT exists in the oe output directory Da you want te override it Yes the existens directory will be removed and a mew one wall be created so that the process can preceed No the existing directory wall be kept and the process aborted ve Ma If the output directory does not exist a new directory will be created by the system Before starting to process each AOI a subdirectory named by the AOI name to be processed will be created in the output directory and all final outputs for that AOI will be stored in that subdirectory If the subdirectory exists a confirmation window will pop out asking the user whether or not to override the existing directory Click the Yes button to continue the process if the user allow the contents of the subdirectory to be overridden otherwise click the No button to keep the contents of the subdirectory however the process will be aborted Pause a running process Click the Pause button a pause request will be sent to the system and it may take a while for the system to actually pause a running process The system needs to wait until the running process completes the current sub step and reaches a break point When the running process is finally paused the running status image will change to dl The Pause and Close buttons will be disabled and both the Run and Stop buttons will be enabled Clicking the R

Geoscience Australia Building Geometry Model User Guide

Contents

Download Pdf Manuals

Related Search

Related Contents