Posts with «field notes» label

B.L.O.O.M.: the field cyberdeck for nature observation

B.L.O.O.M. (Bridging Local Observations, Openly Mapped) is a field cyberdeck designed to capture nature notes offline. Photos, sketches, annotations and bird songs identified with an AI model all end up in a local SQLite database. When you are back online, a sync button sends the data to the cloud and feeds an open, crowd-sourced archive of local flora and fauna. The project is described in detail on the project page on Hackster.io, which also covers the assembly and software choices.

The brain of the cyberdeck is an Arduino Uno Q, powerful enough to host small AI models locally. All the peripherals connect to the board by cable or Bluetooth. In particular, the 5-inch HDMI screen, the Bluetooth keyboard and mouse, the USB microphone and the USB camera let you capture notes, photos, sketches and bird songs. Connecting the display requires a 6-inch HDMI cable, so a short one, suitable for fitting inside the case without taking up space.

The B.L.O.O.M. cyberdeck out in nature.

The kiosk-mode web app and the Edge Impulse audio model

A local web app in kiosk mode, with Chromium in kiosk mode, shows a minimal landscape interface. From there you can take photos, draw, chat with an LLM and record notes on the spot. The audio AI model is custom and trained through Edge Impulse Studio: it identifies the bird songs picked up by the USB microphone. For each bird species (Blue Jays, Mourning Doves, Cardinal) at least 20 audio examples were downloaded from the xeno-canto dataset. The LLM downloaded onto the Uno via App Lab is Gemma, so the chat also works without a network.

The notes are saved in a local SQLite database. Pressing ‘Sync to Cloud’ sends the data to a Netlify function that converts it into markdown files for the website, built with Astro.js. The version of Arduino App Lab used is 0.9.0. For portable power in the field, a compact power bank for Raspberry Pi covers the same role.

The enclosure, the recycled foam and the components to connect

The enclosure is a reused Lancôme train case, with a hole in the side for the camera and modular shelves made of recycled foam and fabric. Creative reuse here is not an aesthetic detail: it is the structure that holds the screen, the board and the battery together. Rebuilding it takes only a few parts, listed below.

  • Arduino UNO Q as the brain of the cyberdeck
  • 6-inch HDMI cable for the display
  • 5-inch HDMI screen
  • USB microphone for the bird songs
  • USB camera for photos and sketches
  • 5-in-1 USB hub to connect the peripherals
  • power bank for power in the field
  • USB-A to Micro-USB cable
  • Bluetooth keyboard and mouse

On the software side the chain is long but linear: Arduino App Lab for the environment, Edge Impulse Studio for the audio model, SQLite for the database, Chromium in kiosk mode for the interface, Astro.js for the site, a Netlify function for the markdown conversion and Gemma as the local LLM. To replicate the project the basis is the 4 GB Arduino UNO Q in a complete kit, while to record bird songs a USB microphone is all you need.

B.L.O.O.M. in action, ready to capture images.

The interesting point of B.L.O.O.M. is that everything works without a network: recognition, chat, saving. Syncing is a voluntary action, not a requirement. That way the field cyberdeck stays useful even in the middle of a wood, and the data opens up to the world only when you decide.

Source: https://www.hackster.io/agent-hawking-1/b-l-o-o-m-a-community-cyberdeck-for-your-field-notes-8dba4c

Related products

The post B.L.O.O.M.: the field cyberdeck for nature observation appeared first on Open Electronics.