Get the latest tech news
The Unofficial Guide to OpenAI Realtime WebRTC API
Walkthrough on how to use the OpenAI Realtime API with WebRTC including tips on WebRTC, overall flow, data channel messaging, and functions
This app is just an iFrame hosted from the webrtcHacks/aiy-chatgpt-webrtc, but if you are not comfortable entering your credentials here, then clone the repo or copy & paste the code from the source into a HTML file and open it.. ", "system-message"); return; } toggleSessionButtons(false); // cancel any in-progress response - not needed for speech input due to turn detection dc.send(JSON.stringify({type: "response.cancel"})); await endSession(); }); I could have possibly used a browser-API solution like Puppeteer or Playwright – or Python clones of those (i.e. playwright-python) – to load a headless browser and avoid the heavy overhead of the Raspbian X11 desktop environment.
Or read this on Hacker News