Project

General

Profile

Working with Gisaf » History » Version 5

Giulio Di Anastasio, 08/05/2021 14:59

1 1 Giulio Di Anastasio
h1. Working with Gisaf
2 1 Giulio Di Anastasio
3 1 Giulio Di Anastasio
4 1 Giulio Di Anastasio
5 1 Giulio Di Anastasio
h3. Survey data
6 1 Giulio Di Anastasio
7 1 Giulio Di Anastasio
Raw survey data are contained in CSV files, typically downloaded from surveying instruments.
8 1 Giulio Di Anastasio
9 2 Giulio Di Anastasio
See more information of the process for the survey data (including a flow diagram) at [[Gisaf workflow]]
10 1 Giulio Di Anastasio
11 1 Giulio Di Anastasio
h1. Survey data
12 1 Giulio Di Anastasio
13 1 Giulio Di Anastasio
14 3 Giulio Di Anastasio
h1. Importing point data (TS and RTK) to GISAF - %{color:RED}  TO BE CHECKED%
15 3 Giulio Di Anastasio
16 3 Giulio Di Anastasio
# *Gisaf Admin > Basket > Survey data > "Project" > "surveyor" > TS/ RTK > upload > import.*
17 3 Giulio Di Anastasio
# *Auto import of Raw points data* (changes from Raw to Shapefiles, the point files)
18 3 Giulio Di Anastasio
  In GISAF Admin > Other> Project > select the project for which you want to import the data > with selected > Auto import to GIS...
19 3 Giulio Di Anastasio
20 3 Giulio Di Anastasio
21 1 Giulio Di Anastasio
h2. Import basket
22 1 Giulio Di Anastasio
23 1 Giulio Di Anastasio
Gisaf provides an "import basket" dedicated for raw survey data, which is generated by land survey equipment (Leica's Total Station and RTK). 
24 1 Giulio Di Anastasio
25 1 Giulio Di Anastasio
These are CSV files, like:
26 1 Giulio Di Anastasio
<pre>
27 1 Giulio Di Anastasio
100081,370633.969,1327742.157,51.187,,,
28 1 Giulio Di Anastasio
100083,370628.876,1327702.913,51.565,T52,,
29 1 Giulio Di Anastasio
100082,370628.729,1327720.019,51.261,T52,,
30 1 Giulio Di Anastasio
100081,370633.969,1327742.154,51.179,,,
31 1 Giulio Di Anastasio
100083,370628.876,1327702.913,51.565,T52,,
32 1 Giulio Di Anastasio
20800,370633.969,1327742.154,51.180,,,
33 1 Giulio Di Anastasio
20801,370618.795,1327713.172,52.817,E30,,
34 1 Giulio Di Anastasio
20802,370623.674,1327711.436,51.283,B35,,
35 1 Giulio Di Anastasio
20803,370619.314,1327713.407,51.383,B35,,
36 1 Giulio Di Anastasio
</pre>
37 1 Giulio Di Anastasio
38 1 Giulio Di Anastasio
Each category (5th column) must be defined in the Category table (see [[Categories]]).
39 1 Giulio Di Anastasio
40 1 Giulio Di Anastasio
41 1 Giulio Di Anastasio
h2. Organization of the raw survey data basket
42 1 Giulio Di Anastasio
43 1 Giulio Di Anastasio
The basket should be organized in a directory structure:
44 1 Giulio Di Anastasio
45 1 Giulio Di Anastasio
- Project name (these can be themselves put in a hierarchy of (sub)directories)
46 1 Giulio Di Anastasio
47 1 Giulio Di Anastasio
- Surveyor's organization
48 1 Giulio Di Anastasio
49 1 Giulio Di Anastasio
- Equipment (eg. TS, RTK)
50 1 Giulio Di Anastasio
51 1 Giulio Di Anastasio
- Survey files (eg. @Our_project-Some_comment-2018-02-23.txt@)
52 1 Giulio Di Anastasio
53 1 Giulio Di Anastasio
h3. Format of the survey file names
54 1 Giulio Di Anastasio
55 1 Giulio Di Anastasio
<pre>
56 1 Giulio Di Anastasio
Our_project-Some_comment-2018-02-23.txt
57 1 Giulio Di Anastasio
</pre>
58 1 Giulio Di Anastasio
59 1 Giulio Di Anastasio
The date of the survey follows the ISO date standard: @YYYY-MM-DD@.
60 1 Giulio Di Anastasio
61 1 Giulio Di Anastasio
62 1 Giulio Di Anastasio
h2. Import to the database
63 1 Giulio Di Anastasio
64 1 Giulio Di Anastasio
When importing raw survey data files to the database, Gisaf does 2 steps as described below.
65 1 Giulio Di Anastasio
It's worth noting that, in this process, no reprojection is done.
66 1 Giulio Di Anastasio
67 1 Giulio Di Anastasio
68 1 Giulio Di Anastasio
h3. Feed the raw_survey table
69 1 Giulio Di Anastasio
70 1 Giulio Di Anastasio
Each point of the imported raw survey data file is inserted to the raw_survey table:
71 1 Giulio Di Anastasio
72 1 Giulio Di Anastasio
# Creation of a Point geometry: the raw_survey table has a geometry column for a single point (@geom@) with x,y and z coordinates
73 1 Giulio Di Anastasio
# Save the @id@ of the original point *to the @orig_id@ column*
74 1 Giulio Di Anastasio
# *A unique @id@ is computed* from the following fields: @id@, @project@, @equipment@, @date@
75 1 Giulio Di Anastasio
# The project is saved in the @project_id@ column
76 1 Giulio Di Anastasio
# The surveyor identification in @srvyr_id@
77 1 Giulio Di Anastasio
# The date of survey is saved in the @date@ column
78 1 Giulio Di Anastasio
# The accuracy is tagged in the @accur_id@, according to a mapping defined in the @accuracyequimentsurveyormapping@ table, which depends on the surveyor and equipment
79 1 Giulio Di Anastasio
# The category of the point
80 1 Giulio Di Anastasio
81 1 Giulio Di Anastasio
82 1 Giulio Di Anastasio
h3. Feed the @RAW_V_*@ tables
83 1 Giulio Di Anastasio
84 1 Giulio Di Anastasio
From the @raw_survey@ table, each point is then copied to its respective @RAW_V_@ table, with basically the same information.
85 1 Giulio Di Anastasio
86 1 Giulio Di Anastasio
These tables (which should be created manually or with the admin notebook called @create_tables@, as of today's writing), only contain points.
87 1 Giulio Di Anastasio
88 1 Giulio Di Anastasio
The project is saved along: see below.
89 1 Giulio Di Anastasio
90 1 Giulio Di Anastasio
91 1 Giulio Di Anastasio
h2. Import the points
92 1 Giulio Di Anastasio
93 1 Giulio Di Anastasio
For categories that define points (opposite to lines and polygons, which require _line work_ carried over in CAD or in a GIS software, see [[Line work]]), the points can be imported automatically to their final destination: the @V_*@ tables.
94 1 Giulio Di Anastasio
95 1 Giulio Di Anastasio
Note: in this process, the geometries are reprojected.
96 1 Giulio Di Anastasio
97 1 Giulio Di Anastasio
h2. Auto import of the points
98 1 Giulio Di Anastasio
99 1 Giulio Di Anastasio
The points found in the @RAW_V_*@ tables can be imported automatically, project per project, the project page of the admin interface.
100 1 Giulio Di Anastasio
101 1 Giulio Di Anastasio
h2. Import of the line work (lines and polygons)
102 1 Giulio Di Anastasio
103 1 Giulio Di Anastasio
h2. See [[Line work]] - *%{color:RED} to be written%*
104 1 Giulio Di Anastasio
105 1 Giulio Di Anastasio
The shapefiles generated manually (line work) should be put in the project's basket, and imported from it.
106 4 Giulio Di Anastasio
107 4 Giulio Di Anastasio
108 4 Giulio Di Anastasio
h1. Documentation - Tags retained after re-import of same geometry
109 4 Giulio Di Anastasio
110 4 Giulio Di Anastasio
Documentation - Tags retained after re-import of same geometry
111 4 Giulio Di Anastasio
The linework for infrastructure survey carried out by Eric Chacra in May 2020 was originally imported with a problem of ambiguity in the "Accuracy" table and in the "Accuracy" table.
112 4 Giulio Di Anastasio
The result was that lines did not inherit the attributes survey date, accuracy, equipment, surveyor.
113 4 Giulio Di Anastasio
Nevertheless lines were displayed on the Gisaf map, without these attributes, and tags were given to some of these lines.
114 4 Giulio Di Anastasio
115 4 Giulio Di Anastasio
The values for the two tables ("Accuracy", "Accuracy") have been corrected, ambiguity resolved.
116 4 Giulio Di Anastasio
The lines in the layers V-ELEC-UGND------E and V-COMM-CABL------E have been then reimported, the attributes have been properly assigned, and the tags have been retained.
117 4 Giulio Di Anastasio
118 4 Giulio Di Anastasio
4 August 2020
119 4 Giulio Di Anastasio
120 4 Giulio Di Anastasio
h1. Access to data
121 4 Giulio Di Anastasio
122 4 Giulio Di Anastasio
h2. Connection to server directly from CSR
123 4 Giulio Di Anastasio
124 4 Giulio Di Anastasio
To connect to the server directly without going through Aurinoco server, the correct url is
125 4 Giulio Di Anastasio
http://gis.csr.av
126 5 Giulio Di Anastasio
127 5 Giulio Di Anastasio
h1. URL for showing information of a feature
128 5 Giulio Di Anastasio
129 5 Giulio Di Anastasio
Gisaf can show information about a feature when it loads. This allows other softwares (Redmine, etc) to create links that bring their users to the feature on the map, and display the information related to it.
130 5 Giulio Di Anastasio
131 5 Giulio Di Anastasio
When Gisaf finds that the URL matches a certain pattern, it tries to load the layer of that feature, find the feature, zoom to it and open the information panel.
132 5 Giulio Di Anastasio
133 5 Giulio Di Anastasio
URLs can be crafted according to this template:
134 5 Giulio Di Anastasio
135 5 Giulio Di Anastasio
<pre>
136 5 Giulio Di Anastasio
https://gis.auroville.org.in/map?show=<layerName>:<field>:<value>
137 5 Giulio Di Anastasio
</pre>
138 5 Giulio Di Anastasio
139 5 Giulio Di Anastasio
where:
140 5 Giulio Di Anastasio
141 5 Giulio Di Anastasio
* <layerName>: name of the layer (store). Example:
142 5 Giulio Di Anastasio
143 5 Giulio Di Anastasio
  * buildings from the "old" TDC building layer: @other_tdc.building@
144 5 Giulio Di Anastasio
145 5 Giulio Di Anastasio
  * cadastral plots: @other_avf.cadastral_avf@
146 5 Giulio Di Anastasio
147 5 Giulio Di Anastasio
* <field>: field name. Example:
148 5 Giulio Di Anastasio
149 5 Giulio Di Anastasio
 * id
150 5 Giulio Di Anastasio
151 5 Giulio Di Anastasio
 * plot
152 5 Giulio Di Anastasio
 
153 5 Giulio Di Anastasio
* <value>: value of that field
154 5 Giulio Di Anastasio
155 5 Giulio Di Anastasio
Full examples:
156 5 Giulio Di Anastasio
157 5 Giulio Di Anastasio
  * <notextile>https://gis.auroville.org.in/map?show=other_tdc.building:id:1370</notextile>
158 5 Giulio Di Anastasio
159 5 Giulio Di Anastasio
  * <notextile>https://gis.auroville.org.in/map?show=other_avf.cadastral_avf:plot:IR216</notextile>