Generative AI Vision with MQTT
Materials
AMB82-mini x 1
Example
In this example, we will be connecting AMB82-mini to a MQTT-Broker that could display images, i.e. broker.mqttgo.io.
Open Generative AI Vision with MQTT example in “File” -> “Examples” -> “AmebaMQTTClient” -> “MQTT_GenAIVision”.
Please modify “ssid” and “pass” according to your WiFi network SSID and password.
Create your API key and paste it in the following section. Please refer to GenAIVision Example for more details on creating API.
Uncomment the vision prompt function according to your model.
Compile and upload the firmware to AMB82-mini.
Go to MQTTGO.io, and connect to server.
Subscribe to the topics to receive the message, image and response published by AMB82-mini. Publish your prompt to a topic where AMB82-mini has subscribed to.
Note
Only message that starts with p/ will be recognized as a prompt message, please insert “p/” before your prompt to trigger image capture and sending to Gen AI server.
You may refer to the snapshot below for prompt sending and response receiving over MQTT broker. Kindly define your own topics to publish and subscribe.
