Project

General

Profile

Working with Gisaf » History » Version 3

Giulio Di Anastasio, 06/05/2021 12:04

1 1 Giulio Di Anastasio
h1. Working with Gisaf
2 1 Giulio Di Anastasio
3 1 Giulio Di Anastasio
4 1 Giulio Di Anastasio
5 1 Giulio Di Anastasio
h3. Survey data
6 1 Giulio Di Anastasio
7 1 Giulio Di Anastasio
Raw survey data are contained in CSV files, typically downloaded from surveying instruments.
8 1 Giulio Di Anastasio
9 2 Giulio Di Anastasio
See more information of the process for the survey data (including a flow diagram) at [[Gisaf workflow]]
10 1 Giulio Di Anastasio
11 1 Giulio Di Anastasio
h1. Survey data
12 1 Giulio Di Anastasio
13 1 Giulio Di Anastasio
14 3 Giulio Di Anastasio
h1. Importing point data (TS and RTK) to GISAF - %{color:RED}  TO BE CHECKED%
15 3 Giulio Di Anastasio
16 3 Giulio Di Anastasio
# *Gisaf Admin > Basket > Survey data > "Project" > "surveyor" > TS/ RTK > upload > import.*
17 3 Giulio Di Anastasio
# *Auto import of Raw points data* (changes from Raw to Shapefiles, the point files)
18 3 Giulio Di Anastasio
  In GISAF Admin > Other> Project > select the project for which you want to import the data > with selected > Auto import to GIS...
19 3 Giulio Di Anastasio
20 3 Giulio Di Anastasio
21 1 Giulio Di Anastasio
h2. Import basket
22 1 Giulio Di Anastasio
23 1 Giulio Di Anastasio
Gisaf provides an "import basket" dedicated for raw survey data, which is generated by land survey equipment (Leica's Total Station and RTK). 
24 1 Giulio Di Anastasio
25 1 Giulio Di Anastasio
These are CSV files, like:
26 1 Giulio Di Anastasio
<pre>
27 1 Giulio Di Anastasio
100081,370633.969,1327742.157,51.187,,,
28 1 Giulio Di Anastasio
100083,370628.876,1327702.913,51.565,T52,,
29 1 Giulio Di Anastasio
100082,370628.729,1327720.019,51.261,T52,,
30 1 Giulio Di Anastasio
100081,370633.969,1327742.154,51.179,,,
31 1 Giulio Di Anastasio
100083,370628.876,1327702.913,51.565,T52,,
32 1 Giulio Di Anastasio
20800,370633.969,1327742.154,51.180,,,
33 1 Giulio Di Anastasio
20801,370618.795,1327713.172,52.817,E30,,
34 1 Giulio Di Anastasio
20802,370623.674,1327711.436,51.283,B35,,
35 1 Giulio Di Anastasio
20803,370619.314,1327713.407,51.383,B35,,
36 1 Giulio Di Anastasio
</pre>
37 1 Giulio Di Anastasio
38 1 Giulio Di Anastasio
Each category (5th column) must be defined in the Category table (see [[Categories]]).
39 1 Giulio Di Anastasio
40 1 Giulio Di Anastasio
41 1 Giulio Di Anastasio
h2. Organization of the raw survey data basket
42 1 Giulio Di Anastasio
43 1 Giulio Di Anastasio
The basket should be organized in a directory structure:
44 1 Giulio Di Anastasio
45 1 Giulio Di Anastasio
- Project name (these can be themselves put in a hierarchy of (sub)directories)
46 1 Giulio Di Anastasio
47 1 Giulio Di Anastasio
- Surveyor's organization
48 1 Giulio Di Anastasio
49 1 Giulio Di Anastasio
- Equipment (eg. TS, RTK)
50 1 Giulio Di Anastasio
51 1 Giulio Di Anastasio
- Survey files (eg. @Our_project-Some_comment-2018-02-23.txt@)
52 1 Giulio Di Anastasio
53 1 Giulio Di Anastasio
h3. Format of the survey file names
54 1 Giulio Di Anastasio
55 1 Giulio Di Anastasio
<pre>
56 1 Giulio Di Anastasio
Our_project-Some_comment-2018-02-23.txt
57 1 Giulio Di Anastasio
</pre>
58 1 Giulio Di Anastasio
59 1 Giulio Di Anastasio
The date of the survey follows the ISO date standard: @YYYY-MM-DD@.
60 1 Giulio Di Anastasio
61 1 Giulio Di Anastasio
62 1 Giulio Di Anastasio
h2. Import to the database
63 1 Giulio Di Anastasio
64 1 Giulio Di Anastasio
When importing raw survey data files to the database, Gisaf does 2 steps as described below.
65 1 Giulio Di Anastasio
It's worth noting that, in this process, no reprojection is done.
66 1 Giulio Di Anastasio
67 1 Giulio Di Anastasio
68 1 Giulio Di Anastasio
h3. Feed the raw_survey table
69 1 Giulio Di Anastasio
70 1 Giulio Di Anastasio
Each point of the imported raw survey data file is inserted to the raw_survey table:
71 1 Giulio Di Anastasio
72 1 Giulio Di Anastasio
# Creation of a Point geometry: the raw_survey table has a geometry column for a single point (@geom@) with x,y and z coordinates
73 1 Giulio Di Anastasio
# Save the @id@ of the original point *to the @orig_id@ column*
74 1 Giulio Di Anastasio
# *A unique @id@ is computed* from the following fields: @id@, @project@, @equipment@, @date@
75 1 Giulio Di Anastasio
# The project is saved in the @project_id@ column
76 1 Giulio Di Anastasio
# The surveyor identification in @srvyr_id@
77 1 Giulio Di Anastasio
# The date of survey is saved in the @date@ column
78 1 Giulio Di Anastasio
# The accuracy is tagged in the @accur_id@, according to a mapping defined in the @accuracyequimentsurveyormapping@ table, which depends on the surveyor and equipment
79 1 Giulio Di Anastasio
# The category of the point
80 1 Giulio Di Anastasio
81 1 Giulio Di Anastasio
82 1 Giulio Di Anastasio
h3. Feed the @RAW_V_*@ tables
83 1 Giulio Di Anastasio
84 1 Giulio Di Anastasio
From the @raw_survey@ table, each point is then copied to its respective @RAW_V_@ table, with basically the same information.
85 1 Giulio Di Anastasio
86 1 Giulio Di Anastasio
These tables (which should be created manually or with the admin notebook called @create_tables@, as of today's writing), only contain points.
87 1 Giulio Di Anastasio
88 1 Giulio Di Anastasio
The project is saved along: see below.
89 1 Giulio Di Anastasio
90 1 Giulio Di Anastasio
91 1 Giulio Di Anastasio
h2. Import the points
92 1 Giulio Di Anastasio
93 1 Giulio Di Anastasio
For categories that define points (opposite to lines and polygons, which require _line work_ carried over in CAD or in a GIS software, see [[Line work]]), the points can be imported automatically to their final destination: the @V_*@ tables.
94 1 Giulio Di Anastasio
95 1 Giulio Di Anastasio
Note: in this process, the geometries are reprojected.
96 1 Giulio Di Anastasio
97 1 Giulio Di Anastasio
h2. Auto import of the points
98 1 Giulio Di Anastasio
99 1 Giulio Di Anastasio
The points found in the @RAW_V_*@ tables can be imported automatically, project per project, the project page of the admin interface.
100 1 Giulio Di Anastasio
101 1 Giulio Di Anastasio
h2. Import of the line work (lines and polygons)
102 1 Giulio Di Anastasio
103 1 Giulio Di Anastasio
h2. See [[Line work]] - *%{color:RED} to be written%*
104 1 Giulio Di Anastasio
105 1 Giulio Di Anastasio
The shapefiles generated manually (line work) should be put in the project's basket, and imported from it.