GlanceScribe
AI MEDICAL SCRIBEA four-person hackathon prototype pairing a live Meta-glasses video feed with browser-microphone transcription. ElevenLabs transcribes the audio; Gemini turns the committed transcript into draft SOAP notes. FFmpeg assembles recordings and selected highlights.
Hack Brooklyn ’26
for review
From live streams to draft notes
Microphone → 16 kHz PCM → ElevenLabs WebSocket → transcript → SSE dashboard + Gemini SOAP
My work in the team build. I contributed the initial backend and recording integration; the final app combines that work with teammates’ interface and note-generation changes. The glasses stream arrives through an external client and an HTTP proxy, while browser microphone audio follows a separate path.
Implementation. The browser resamples audio to mono PCM and uses a short-lived transcription token. Committed text is appended on the server and sent to dashboards over SSE. Recording chunks are assembled with FFmpeg; transcript and body-focus intervals help select highlights.
Tradeoff. Simple in-memory session state made the hackathon integration quick, but does not isolate multiple clinical users. Gemini receives text for note generation, not video. JSON parsing is not clinical validation; this is a demonstration, not a deployed medical system.