This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
app-notes:ein-mqtt-server-fuer-iot-telemetry-sensoren [2023/11/09 13:22] – [2.1 Collect telemetry data with the help of SDK scripts] gray | app-notes:ein-mqtt-server-fuer-iot-telemetry-sensoren [2024/03/21 14:00] – [2.1 Collect telemetry data with the help of SDK scripts] gray | ||
---|---|---|---|
Line 19: | Line 19: | ||
Grafana is used for display and analysis. Here short term and long term evaluations are well visualized for the user. | Grafana is used for display and analysis. Here short term and long term evaluations are well visualized for the user. | ||
- | |||
- | For signaling information an XMPP server is used. Over this messages are sent to a cell phone or computer. | ||
---- | ---- | ||
Line 69: | Line 67: | ||
/* publish the message to mqtt broker Temperature */ | /* publish the message to mqtt broker Temperature */ | ||
ret = nb_mqtt_publish(HOST, | ret = nb_mqtt_publish(HOST, | ||
+ | | ||
if (ret<0){ | if (ret<0){ | ||
| | ||
Line 77: | Line 76: | ||
/* publish the message to mqtt broker Humidity */ | /* publish the message to mqtt broker Humidity */ | ||
ret = nb_mqtt_publish(HOST, | ret = nb_mqtt_publish(HOST, | ||
+ | | ||
if (ret<0){ | if (ret<0){ | ||
| | ||
Line 85: | Line 85: | ||
/* publish the message to mqtt broker DevicePower */ | /* publish the message to mqtt broker DevicePower */ | ||
ret = nb_mqtt_publish(HOST, | ret = nb_mqtt_publish(HOST, | ||
+ | | ||
if (ret<0){ | if (ret<0){ | ||
| | ||
Line 93: | Line 94: | ||
/* publish the message to mqtt broker Sys */ | /* publish the message to mqtt broker Sys */ | ||
ret = nb_mqtt_publish(HOST, | ret = nb_mqtt_publish(HOST, | ||
+ | | ||
if (ret<0){ | if (ret<0){ | ||
| | ||
Line 115: | Line 117: | ||
- | ==== - Telemetry | + | ==== - Make telemetry |
- | For this function we use " | + | The sensor then retrieves the requests from the broker and passes the information block back to the broker with a publish. This would then be displayed in the console. |
+ | |||
+ | < | ||
+ | {“id”: | ||
+ | </ | ||
+ | |||
+ | ---- | ||
+ | |||
+ | If you want to be able to easily | ||
+ | |||
+ | However, only the required information must first be extracted from the data block. The SDK script "'' | ||
- | The SDK script first fetches the unformatted values from the data string and then stores these values in memory cells. | ||
- | Under this script, values from the memory cells are used to calculate the absolute humidity. | + | In this script, |
<code c shellyplusht subscribe_SDK.are> | <code c shellyplusht subscribe_SDK.are> | ||
Line 324: | Line 335: | ||
---- | ---- | ||
- | Output of the unformatted data receive | + | Below this example you can see how the script takes the temperature value from the data block. |
< | < | ||
Line 342: | Line 353: | ||
</ | </ | ||
- | When all the information is extracted from the unformatted data, a data block of memory cells is obtained. In addition, the absolute humidity is calculated from the data and also stored in the memory cell. | ||
- | < | ||
- | Ausgabe unforamtierten Daten | ||
- | {" | ||
- | Batteryspannungswert battery ist entalten | ||
- | Hier wird die laenge des Daten String bestimmt: 162 Zeichen | ||
- | Neuer Daten String verkleinert: | ||
- | battery": | ||
- | Bestimmen des batteryblock: | ||
- | Ausgabe des batteryblock | ||
- | battery": | ||
- | Nur der Battery Wert 8 Zeichen | ||
- | Der Shelly wird über USB-Netzteil versorgt: 0.43 Volt nur. | ||
- | Ausgabe von custom Speicherzelle_1 Temperatur: 22.5 | ||
- | Ausgabe von custom Speicherzelle_2 Datum Zeit: 30/ | ||
- | Ausgabe von custom Speicherzelle_3 Luftfeuchtewert: | ||
- | Ausgabe von custom Speicherzelle_4 Batteryspannungswert: | ||
- | Ausgabe von custom Speicherzelle_5 Prozentsatz: | ||
- | Ausgabe von I1: und I2: | ||
- | float: 22.5 | ||
- | float: 49.3 | ||
- | 9.847469223 | ||
- | Absolutendluftfeuchtigkeit Berechnung: 9.847469223 g/m³ | ||
- | Ausgabe von custom Speicherzelle_result Absolutendluftfeuchtigkeit: | ||
- | </ | ||
---- | ---- | ||
- | ===== - Further telemetry data via other ways ===== | ||
- | |||
- | Here are further descriptions how telemetry data can be transferred directly to the MQTT broker | ||
- | |||
- | * [[configuration: | ||
- | |||
- | ---- | ||
- | |||
- | A further description how a smart meter can send its data to a MQTT broker via the program tool Node-RED. The whole thing was implemented under a LXC container. | ||
- | |||
- | |||
- | * [[configuration: | ||
- | |||
- | ---- | ||
===== - Bring data from the MQTT broker structured into a database ===== | ===== - Bring data from the MQTT broker structured into a database ===== | ||
- | Create an influx | + | An Influx |
- | + | ||
- | The structure in the database is then created with a Python script, using a Json format. | + | |
- | + | ||
- | <code c > | + | |
- | | + | |
- | { | + | |
- | ' | + | |
- | ' | + | |
- | ' | + | |
- | }, | + | |
- | ' | + | |
- | ' | + | |
- | } | + | |
- | } | + | |
- | ] | + | |
- | influxdb_client.write_points(json_body) | + | |
- | </ | + | |
- | + | ||
---- | ---- | ||
- | |||
- | |||
- | With the help of the Python script, you can specifically query data from the broker and store it in the database in a structured way. | ||
<code c shellyplusht subscribe_datenbank.py> | <code c shellyplusht subscribe_datenbank.py> | ||
Line 548: | Line 499: | ||
---- | ---- | ||
- | The Python | + | A cronjob starts the Python |
- | + | ||
- | < | + | |
- | + | ||
- | # Das Skript wird alle 1 Minuten plus 20 sekunden gestartet | + | |
- | * * * * * sleep 20; / | + | |
- | + | ||
- | </ | + | |
- | + | ||
- | The script checks if the process is still running. If it is, it does nothing. If the process was terminated it is started again. The Python scripts run endlessly. The cronjob only checks if they are still running. | + | |
< | < | ||
Line 592: | Line 534: | ||
From now on you have access to the data that is already in the database and that will be added over time. | From now on you have access to the data that is already in the database and that will be added over time. | ||
- | Which measurements have been deposited in the database: | ||
- | |||
- | < | ||
- | :~ $ influx | ||
- | Connected to http:// | ||
- | InfluxDB shell version: 1.8.10 | ||
- | :> use Shelly | ||
- | Using database Shelly | ||
- | :> show series | ||
- | key | ||
- | --- | ||
- | power, | ||
- | rh, | ||
- | tC, | ||
- | tC, | ||
- | tC, | ||
- | temperatur, | ||
- | temperatur, | ||
- | temperatur, | ||
- | temperatur, | ||
- | value, | ||
- | value, | ||
- | voltage, | ||
- | voltage, | ||
- | </ | ||
==== - The first visualization under Grafana ==== | ==== - The first visualization under Grafana ==== | ||
Line 640: | Line 557: | ||
With this function Grafana Discover I would try more function under the programs. One comes here quickly on solutions that are helpful in the implementation in the dashboard. | With this function Grafana Discover I would try more function under the programs. One comes here quickly on solutions that are helpful in the implementation in the dashboard. | ||
- | |||
- | If one is then with the conversion for a dashboard, one can fall back on information here. | ||
- | |||
- | {{: | ||
- | |||
- | ---- | ||
- | |||
- | ===== - Pass on information from the MQTT network to a free messenger. ===== | ||
- | |||
- | An XMPP server is used as the messenger. Because a standardized open protocol is used. There is an XMPP client for almost everything. | ||
- | |||
- | On the LXC container a XMPP Cleint is used under the command line. With it you can send messages over the XMPP protocol. | ||
- | |||
- | [[https:// | ||
- | |||
- | |||
- | If the command line program is installed on the container you can test it with these commands. It is important that the user of '' | ||
- | |||
- | < | ||
- | echo 'Hello World' | sendxmpp -n -t -u " | ||
- | -p Passwort_vom_Benutzer_Sender Benutzer_Empfänger@xmpp_Server_Adresse | ||
- | </ | ||
- | |||
- | The LXC container runs a TCP server under a Python script. | ||
- | |||
- | <code py tcp_server tcp-server.py> | ||
- | # a simple tcp server | ||
- | import socket,os | ||
- | sock = socket.socket(socket.AF_INET, | ||
- | sock.bind((' | ||
- | sock.listen(5) | ||
- | while True: | ||
- | connection, | ||
- | buf = connection.recv(1024) | ||
- | if (str(buf)) != " | ||
- | # print(" | ||
- | file = open(' | ||
- | temp = str(buf, ' | ||
- | file.write(str(temp)) | ||
- | # print(file.write(str(buf))) | ||
- | file.close() | ||
- | # else: | ||
- | # | ||
- | connection.send(buf) | ||
- | connection.close() | ||
- | </ | ||
- | |||
- | ---- | ||
- | |||
- | This waits for messages generated by SDK script on the router. New messages are then stored in a file " | ||
- | |||
- | About a cronjob every 10 seconds a script is started. This checks whether a new message is available. If so, this message is sent via xmpp. | ||
- | |||
- | < | ||
- | :~# crontab -e | ||
- | |||
- | # Das Skript wird alle 10 Sekunden gestartet | ||
- | * * * * * / | ||
- | * * * * * sleep 10; / | ||
- | * * * * * sleep 20; / | ||
- | * * * * * sleep 30; / | ||
- | * * * * * sleep 40; / | ||
- | * * * * * sleep 50; / | ||
- | </ | ||
- | |||
- | The cronjob script: | ||
- | |||
- | <code sh xmpp-nachricht xmpp_skript.sh> | ||
- | #!/bin/bash | ||
- | if [ -r / | ||
- | then | ||
- | sendxmpp -m / | ||
- | sleep 1s | ||
- | rm / | ||
- | fi | ||
- | </ | ||
---- | ---- | ||