https://redmine.auroville.org.in/https://redmine.auroville.org.in/favicon.ico2021-10-29T12:53:23ZRedmineGIS - Bug #13132: CSR Weather station missing data 28 nd 29 Otober 2021https://redmine.auroville.org.in/issues/13132?journal_id=976812021-10-29T12:53:23ZPhilippe May
<ul></ul><p>Right, i also noticed it.</p>
<p>I have done a major system upgrade last Saturday and Sunday of all the system with its virtual machines (Debian 10 -> 11). There were some minor issues with data collection that i fixed later on up till Wednesday.</p>
<p>Yesterday's issue with the server (power down) and current heavy rainfall and more power cut add up to the confusion, but hopefully the WS sent data during through all these events to AmbientWeather, that can be retrieved.</p>
<p>So it's a bit firefighting mode <img alt="fire" height="20" src="https://redmine.auroville.org.in/images/emoji/fire.png" style="vertical-align:middle" width="20" title=":fire:" class="emoji" /> with rain <img alt="droplet" height="20" src="https://redmine.auroville.org.in/images/emoji/droplet.png" style="vertical-align:middle" width="20" title=":droplet:" class="emoji" /></p> GIS - Bug #13132: CSR Weather station missing data 28 nd 29 Otober 2021https://redmine.auroville.org.in/issues/13132?journal_id=978202021-11-01T13:52:53ZPhilippe May
<ul><li><strong>% Done</strong> changed from <i>0</i> to <i>90</i></li><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li></ul><p>I imported the data from ambientweather.net using the script developed for that purpose, eg:</p>
<pre>
~/../avgs_device_interfaces/fix_missing_ws_data.py --wsid 4 --start-date 20211030 --end-date 20211101
</pre>
<p>~~~</p>
<p>Some more technical details:</p>
<p>I noticed that the job (gisaf-sched) that gathers data for these WS got disconnected from ambientweather, without reason. It shouldn't be a problem since the script auto-reconnects (the protocol is called "socket.io", <a class="external" href="https://ambientweather.docs.apiary.io/#reference/ambient-realtime-api">https://ambientweather.docs.apiary.io/#reference/ambient-realtime-api</a>). But in this case, it seems that the reconnections failed.</p>
<p>I restarted it in debug mode (identical, but adds logging information about incoming data, misc. signals... for inspection).</p>
<p>But, there's no problem reconnecting in debug mode: such a difference of behaviour is very strange. The easiest explanation at this point is a temporary issue in ambientweather.net.</p>
<p>So, i just restarted gisaf-sched without debug mode, and i'll check tomorrow.</p> GIS - Bug #13132: CSR Weather station missing data 28 nd 29 Otober 2021https://redmine.auroville.org.in/issues/13132?journal_id=980802021-11-06T06:50:17ZPhilippe May
<ul><li><strong>% Done</strong> changed from <i>90</i> to <i>100</i></li><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li></ul><p>The data acquisition job worked flawlessly in the last few days, closing the issue.</p>
<p>By the way, i updated the dashboard page for weather stations at <a class="external" href="https://gis.auroville.org.in/dashboard/Water/Weather%20stations">https://gis.auroville.org.in/dashboard/Water/Weather%20stations</a> . Previously, it used to show only the WS at CSR, it displays on the same graph all the weather stations (3 as of today). There's an exception for Aurogreen (it doesn't send data at night, and thus the rainfall of the night all stacks up when the WS is reconnected in the morning.)</p>