Working with Gisaf » History » Version 5
Giulio Di Anastasio, 08/05/2021 14:59
| 1 | 1 | Giulio Di Anastasio | h1. Working with Gisaf |
|---|---|---|---|
| 2 | 1 | Giulio Di Anastasio | |
| 3 | 1 | Giulio Di Anastasio | |
| 4 | 1 | Giulio Di Anastasio | |
| 5 | 1 | Giulio Di Anastasio | h3. Survey data |
| 6 | 1 | Giulio Di Anastasio | |
| 7 | 1 | Giulio Di Anastasio | Raw survey data are contained in CSV files, typically downloaded from surveying instruments. |
| 8 | 1 | Giulio Di Anastasio | |
| 9 | 2 | Giulio Di Anastasio | See more information of the process for the survey data (including a flow diagram) at [[Gisaf workflow]] |
| 10 | 1 | Giulio Di Anastasio | |
| 11 | 1 | Giulio Di Anastasio | h1. Survey data |
| 12 | 1 | Giulio Di Anastasio | |
| 13 | 1 | Giulio Di Anastasio | |
| 14 | 3 | Giulio Di Anastasio | h1. Importing point data (TS and RTK) to GISAF - %{color:RED} TO BE CHECKED% |
| 15 | 3 | Giulio Di Anastasio | |
| 16 | 3 | Giulio Di Anastasio | # *Gisaf Admin > Basket > Survey data > "Project" > "surveyor" > TS/ RTK > upload > import.* |
| 17 | 3 | Giulio Di Anastasio | # *Auto import of Raw points data* (changes from Raw to Shapefiles, the point files) |
| 18 | 3 | Giulio Di Anastasio | In GISAF Admin > Other> Project > select the project for which you want to import the data > with selected > Auto import to GIS... |
| 19 | 3 | Giulio Di Anastasio | |
| 20 | 3 | Giulio Di Anastasio | |
| 21 | 1 | Giulio Di Anastasio | h2. Import basket |
| 22 | 1 | Giulio Di Anastasio | |
| 23 | 1 | Giulio Di Anastasio | Gisaf provides an "import basket" dedicated for raw survey data, which is generated by land survey equipment (Leica's Total Station and RTK). |
| 24 | 1 | Giulio Di Anastasio | |
| 25 | 1 | Giulio Di Anastasio | These are CSV files, like: |
| 26 | 1 | Giulio Di Anastasio | <pre> |
| 27 | 1 | Giulio Di Anastasio | 100081,370633.969,1327742.157,51.187,,, |
| 28 | 1 | Giulio Di Anastasio | 100083,370628.876,1327702.913,51.565,T52,, |
| 29 | 1 | Giulio Di Anastasio | 100082,370628.729,1327720.019,51.261,T52,, |
| 30 | 1 | Giulio Di Anastasio | 100081,370633.969,1327742.154,51.179,,, |
| 31 | 1 | Giulio Di Anastasio | 100083,370628.876,1327702.913,51.565,T52,, |
| 32 | 1 | Giulio Di Anastasio | 20800,370633.969,1327742.154,51.180,,, |
| 33 | 1 | Giulio Di Anastasio | 20801,370618.795,1327713.172,52.817,E30,, |
| 34 | 1 | Giulio Di Anastasio | 20802,370623.674,1327711.436,51.283,B35,, |
| 35 | 1 | Giulio Di Anastasio | 20803,370619.314,1327713.407,51.383,B35,, |
| 36 | 1 | Giulio Di Anastasio | </pre> |
| 37 | 1 | Giulio Di Anastasio | |
| 38 | 1 | Giulio Di Anastasio | Each category (5th column) must be defined in the Category table (see [[Categories]]). |
| 39 | 1 | Giulio Di Anastasio | |
| 40 | 1 | Giulio Di Anastasio | |
| 41 | 1 | Giulio Di Anastasio | h2. Organization of the raw survey data basket |
| 42 | 1 | Giulio Di Anastasio | |
| 43 | 1 | Giulio Di Anastasio | The basket should be organized in a directory structure: |
| 44 | 1 | Giulio Di Anastasio | |
| 45 | 1 | Giulio Di Anastasio | - Project name (these can be themselves put in a hierarchy of (sub)directories) |
| 46 | 1 | Giulio Di Anastasio | |
| 47 | 1 | Giulio Di Anastasio | - Surveyor's organization |
| 48 | 1 | Giulio Di Anastasio | |
| 49 | 1 | Giulio Di Anastasio | - Equipment (eg. TS, RTK) |
| 50 | 1 | Giulio Di Anastasio | |
| 51 | 1 | Giulio Di Anastasio | - Survey files (eg. @Our_project-Some_comment-2018-02-23.txt@) |
| 52 | 1 | Giulio Di Anastasio | |
| 53 | 1 | Giulio Di Anastasio | h3. Format of the survey file names |
| 54 | 1 | Giulio Di Anastasio | |
| 55 | 1 | Giulio Di Anastasio | <pre> |
| 56 | 1 | Giulio Di Anastasio | Our_project-Some_comment-2018-02-23.txt |
| 57 | 1 | Giulio Di Anastasio | </pre> |
| 58 | 1 | Giulio Di Anastasio | |
| 59 | 1 | Giulio Di Anastasio | The date of the survey follows the ISO date standard: @YYYY-MM-DD@. |
| 60 | 1 | Giulio Di Anastasio | |
| 61 | 1 | Giulio Di Anastasio | |
| 62 | 1 | Giulio Di Anastasio | h2. Import to the database |
| 63 | 1 | Giulio Di Anastasio | |
| 64 | 1 | Giulio Di Anastasio | When importing raw survey data files to the database, Gisaf does 2 steps as described below. |
| 65 | 1 | Giulio Di Anastasio | It's worth noting that, in this process, no reprojection is done. |
| 66 | 1 | Giulio Di Anastasio | |
| 67 | 1 | Giulio Di Anastasio | |
| 68 | 1 | Giulio Di Anastasio | h3. Feed the raw_survey table |
| 69 | 1 | Giulio Di Anastasio | |
| 70 | 1 | Giulio Di Anastasio | Each point of the imported raw survey data file is inserted to the raw_survey table: |
| 71 | 1 | Giulio Di Anastasio | |
| 72 | 1 | Giulio Di Anastasio | # Creation of a Point geometry: the raw_survey table has a geometry column for a single point (@geom@) with x,y and z coordinates |
| 73 | 1 | Giulio Di Anastasio | # Save the @id@ of the original point *to the @orig_id@ column* |
| 74 | 1 | Giulio Di Anastasio | # *A unique @id@ is computed* from the following fields: @id@, @project@, @equipment@, @date@ |
| 75 | 1 | Giulio Di Anastasio | # The project is saved in the @project_id@ column |
| 76 | 1 | Giulio Di Anastasio | # The surveyor identification in @srvyr_id@ |
| 77 | 1 | Giulio Di Anastasio | # The date of survey is saved in the @date@ column |
| 78 | 1 | Giulio Di Anastasio | # The accuracy is tagged in the @accur_id@, according to a mapping defined in the @accuracyequimentsurveyormapping@ table, which depends on the surveyor and equipment |
| 79 | 1 | Giulio Di Anastasio | # The category of the point |
| 80 | 1 | Giulio Di Anastasio | |
| 81 | 1 | Giulio Di Anastasio | |
| 82 | 1 | Giulio Di Anastasio | h3. Feed the @RAW_V_*@ tables |
| 83 | 1 | Giulio Di Anastasio | |
| 84 | 1 | Giulio Di Anastasio | From the @raw_survey@ table, each point is then copied to its respective @RAW_V_@ table, with basically the same information. |
| 85 | 1 | Giulio Di Anastasio | |
| 86 | 1 | Giulio Di Anastasio | These tables (which should be created manually or with the admin notebook called @create_tables@, as of today's writing), only contain points. |
| 87 | 1 | Giulio Di Anastasio | |
| 88 | 1 | Giulio Di Anastasio | The project is saved along: see below. |
| 89 | 1 | Giulio Di Anastasio | |
| 90 | 1 | Giulio Di Anastasio | |
| 91 | 1 | Giulio Di Anastasio | h2. Import the points |
| 92 | 1 | Giulio Di Anastasio | |
| 93 | 1 | Giulio Di Anastasio | For categories that define points (opposite to lines and polygons, which require _line work_ carried over in CAD or in a GIS software, see [[Line work]]), the points can be imported automatically to their final destination: the @V_*@ tables. |
| 94 | 1 | Giulio Di Anastasio | |
| 95 | 1 | Giulio Di Anastasio | Note: in this process, the geometries are reprojected. |
| 96 | 1 | Giulio Di Anastasio | |
| 97 | 1 | Giulio Di Anastasio | h2. Auto import of the points |
| 98 | 1 | Giulio Di Anastasio | |
| 99 | 1 | Giulio Di Anastasio | The points found in the @RAW_V_*@ tables can be imported automatically, project per project, the project page of the admin interface. |
| 100 | 1 | Giulio Di Anastasio | |
| 101 | 1 | Giulio Di Anastasio | h2. Import of the line work (lines and polygons) |
| 102 | 1 | Giulio Di Anastasio | |
| 103 | 1 | Giulio Di Anastasio | h2. See [[Line work]] - *%{color:RED} to be written%* |
| 104 | 1 | Giulio Di Anastasio | |
| 105 | 1 | Giulio Di Anastasio | The shapefiles generated manually (line work) should be put in the project's basket, and imported from it. |
| 106 | 4 | Giulio Di Anastasio | |
| 107 | 4 | Giulio Di Anastasio | |
| 108 | 4 | Giulio Di Anastasio | h1. Documentation - Tags retained after re-import of same geometry |
| 109 | 4 | Giulio Di Anastasio | |
| 110 | 4 | Giulio Di Anastasio | Documentation - Tags retained after re-import of same geometry |
| 111 | 4 | Giulio Di Anastasio | The linework for infrastructure survey carried out by Eric Chacra in May 2020 was originally imported with a problem of ambiguity in the "Accuracy" table and in the "Accuracy" table. |
| 112 | 4 | Giulio Di Anastasio | The result was that lines did not inherit the attributes survey date, accuracy, equipment, surveyor. |
| 113 | 4 | Giulio Di Anastasio | Nevertheless lines were displayed on the Gisaf map, without these attributes, and tags were given to some of these lines. |
| 114 | 4 | Giulio Di Anastasio | |
| 115 | 4 | Giulio Di Anastasio | The values for the two tables ("Accuracy", "Accuracy") have been corrected, ambiguity resolved. |
| 116 | 4 | Giulio Di Anastasio | The lines in the layers V-ELEC-UGND------E and V-COMM-CABL------E have been then reimported, the attributes have been properly assigned, and the tags have been retained. |
| 117 | 4 | Giulio Di Anastasio | |
| 118 | 4 | Giulio Di Anastasio | 4 August 2020 |
| 119 | 4 | Giulio Di Anastasio | |
| 120 | 4 | Giulio Di Anastasio | h1. Access to data |
| 121 | 4 | Giulio Di Anastasio | |
| 122 | 4 | Giulio Di Anastasio | h2. Connection to server directly from CSR |
| 123 | 4 | Giulio Di Anastasio | |
| 124 | 4 | Giulio Di Anastasio | To connect to the server directly without going through Aurinoco server, the correct url is |
| 125 | 4 | Giulio Di Anastasio | http://gis.csr.av |
| 126 | 5 | Giulio Di Anastasio | |
| 127 | 5 | Giulio Di Anastasio | h1. URL for showing information of a feature |
| 128 | 5 | Giulio Di Anastasio | |
| 129 | 5 | Giulio Di Anastasio | Gisaf can show information about a feature when it loads. This allows other softwares (Redmine, etc) to create links that bring their users to the feature on the map, and display the information related to it. |
| 130 | 5 | Giulio Di Anastasio | |
| 131 | 5 | Giulio Di Anastasio | When Gisaf finds that the URL matches a certain pattern, it tries to load the layer of that feature, find the feature, zoom to it and open the information panel. |
| 132 | 5 | Giulio Di Anastasio | |
| 133 | 5 | Giulio Di Anastasio | URLs can be crafted according to this template: |
| 134 | 5 | Giulio Di Anastasio | |
| 135 | 5 | Giulio Di Anastasio | <pre> |
| 136 | 5 | Giulio Di Anastasio | https://gis.auroville.org.in/map?show=<layerName>:<field>:<value> |
| 137 | 5 | Giulio Di Anastasio | </pre> |
| 138 | 5 | Giulio Di Anastasio | |
| 139 | 5 | Giulio Di Anastasio | where: |
| 140 | 5 | Giulio Di Anastasio | |
| 141 | 5 | Giulio Di Anastasio | * <layerName>: name of the layer (store). Example: |
| 142 | 5 | Giulio Di Anastasio | |
| 143 | 5 | Giulio Di Anastasio | * buildings from the "old" TDC building layer: @other_tdc.building@ |
| 144 | 5 | Giulio Di Anastasio | |
| 145 | 5 | Giulio Di Anastasio | * cadastral plots: @other_avf.cadastral_avf@ |
| 146 | 5 | Giulio Di Anastasio | |
| 147 | 5 | Giulio Di Anastasio | * <field>: field name. Example: |
| 148 | 5 | Giulio Di Anastasio | |
| 149 | 5 | Giulio Di Anastasio | * id |
| 150 | 5 | Giulio Di Anastasio | |
| 151 | 5 | Giulio Di Anastasio | * plot |
| 152 | 5 | Giulio Di Anastasio | |
| 153 | 5 | Giulio Di Anastasio | * <value>: value of that field |
| 154 | 5 | Giulio Di Anastasio | |
| 155 | 5 | Giulio Di Anastasio | Full examples: |
| 156 | 5 | Giulio Di Anastasio | |
| 157 | 5 | Giulio Di Anastasio | * <notextile>https://gis.auroville.org.in/map?show=other_tdc.building:id:1370</notextile> |
| 158 | 5 | Giulio Di Anastasio | |
| 159 | 5 | Giulio Di Anastasio | * <notextile>https://gis.auroville.org.in/map?show=other_avf.cadastral_avf:plot:IR216</notextile> |