Telemetry
Table of contents
Description
The telemetry software section of the project comprised such tasks
- creating software for relaying CANBUS messages through MQTT via 4G using a Raspberry pi
- creating software for reading CANBUS messages from main CANBUS loop using STM32 chip and sending via serial to raspberry
- lowering boot time of Raspberry pi
- writing script to be launched at boot to connect to the internet via modem
- making the SD used by the pi read-only; this is needed as micro-sd cards are failure prone, especially on Rpi hardware
Remaining work
here is listed what remains to be done by order of importance
- stm32 board code for canbus reading
- 4g modem script
- try lowering boot time by profiling
- make cmake script to compile everything at once, until now ran gcc command with manual linking
- if changes to the location of the json config file are made act accordingly and refer to the section about message relay via rpi
- maybe make build system to create directly the whole image with the necessary software; this way is storage device fails it is easier to rebuild the whole system
Architecture description
Canbus message reader STM32
Most of it is still not implemented, but shouldn't take long to implement.
A simple loop reading the canbus port and relaying it to the serial interface will be more than enough; depending on board used package filtering could be done either on the STM board or raspberry pi
Message Relay via raspberry pi
This is the meaty boy of the project; the file to refer to is mqtt_usb_sender.c.
Most of the C code created is commented using doxygen, so
- if modification are made, comment using the same system (i'm seeing you not writing comments 🙂)
- for specific function description look at the code; there will be a comment explaining it
Typical flow of the app
- it loads the config found at MQTTUsbSenderConfig.json; this json file will have to be in the same folder level as the main C compiled object.
- will create the connect with the MQTT broker
- will either enter normal or test operating mode
- normal mode will run until killed
- test mode will force join all active thread and print the number of messages each one of them sent
- will launch a thread per serial connection
- such thread will
- setup the serial port (which in linux is simply a file descriptor) by what specified in MQTTUsbSenderConfig.json
- open a reading loop in which will read up to 256 chars, format it into an MQTT message and send it asynchronouslyù
Libraries used (and why)
- PahoMQTT
- simple, has C and python implementations
- well documented
- CJson
- more complete libraries exist, but here we need to read just a small config file
- can be linked very simply as it is a single file
JSON config file format
this is the typical format for the description of serial ports and the broker used by the application
"ADDRESS": "tcp://192.168.204.107:1883",
"CLIENTID": "racingpi",
"TESTTIMEOUT": 20,
"INPUT": [
{
"PORT": "/dev/ttyUSB0",
"TOPIC": "testTopic",
"IN_SPEED": 115200,
"OUT_SPEED": 115200,
"comment": "hello there,general kenobi"
}
]
}
each single serial port is an element of the list INPUT of this format, comments can be omitted
"PORT": "/dev/ttyUSB0",
"TOPIC": "programmingSocks",
"IN_SPEED": 115200,
"OUT_SPEED": 115200,
"comment": "eat past go fasta"
}
Test mode
Mostly used for performance evaluation over a short test; the duration of such test is specified in MQTTUsbSenderConfig.json.
If modifications are needed remember to take into consideration pthread_setcanceltype as this will make sure it will wait for a system call to join the thread when a cancellation was asked; this way you should avoid most errors/lost messages.
Connecting the pi to the internet
Still not implemented; just a bash script to be added to the startup script referenced in the next section.
reference material can be found here:
- reference here https://www.jeffgeerling.com/blog/2022/using-4g-lte-wireless-modems-on-raspberry-pi/
- for more info about modem etc refer to Electrical
Boot script
While looking around the github page you might find a .sh script called mqtt_boot.sh; this bash script is run by systemD at boot.
It can be modified to include also the commands to connect via 4g in the future.
If the underling OS is wiped/changed drastically remember to re-setup such script to launched at boot; asking any LLM how to do it should be enough.
Boot time optimization
For now it is simply an headless (IE no desktop interface software like x11, gnome, Etc..) installation of Raspberry OS; this setup starts in around 15-20s.
Further optimization can be done by profiling the boot to strip not needed functionality; reference to how here
- https://forums.raspberrypi.com/viewtopic.php?t=277010
- https://forums.raspberrypi.com/viewtopic.php?t=373140
- Another option could be using an nvme/usb3 storage sistem
How to compile the project
for now gcc is used
FAQ
the setup is the one of the original creator, how do i access the pi?
until now work was done via ssh (credential are user: racingpi , password: 1234) using my personal wi.fi hotspot; the simpler way is to use the physical Lan port of the py, then if needed change the wifi config to the new user.
I see some errors in the log from the a serial interface, what is wrong?
It is mostly a matter of flags used when reading the serial port, refer to the documentation of the attached serial device.
Also remember that most Linux distros could have some serial issues because of braille devices driver (IE BRLTTY); disabling them could help.