A start-up developed AR glasses with AI assistants

Brillant Labs Framework

February 11, 2024 2:51 p.m. Robert Klatt

Brillant Labs’ Frame AR glasses can perform various tasks, including translation and real-time information retrieval, using different AI models. Pre-ordering is now possible.

San Francisco (United States). The start-up Brilliant Laboratories has developed conceptual glasses with augmented reality (AR) and artificial intelligence (AI). Frame glasses use a multi-modal AI system that combines different AIs, including Whisper, GPT-4 and Stable Diffusion. The glasses also have a microphone, headphones and various sensors that record the environment. The content is displayed in the user’s field of vision, similar to a heads-up display.

According to Brillant Labs, Frame’s various AI models can include linguistic, visual and contextual information. The AI ​​assistant is designed to recognize objects, analyze facial expressions and capture spoken dictation, which undoubtedly raises a number of privacy concerns. For those who wear glasses, this system allows users to use text summaries, real-time translations, structured notes and other functions on demand, including camera integration.

AR glasses have many uses

In a demo video, the company shows how the AI ​​performs various tasks following the user’s voice commands. This includes identifying places of interest, searching for specific products on the Internet, such as a specific pair of sneakers, or obtaining nutritional information on foods consumed.

The Micro-OLED technology used for image reproduction offers a resolution of 640 x 400 pixels, while the integrated camera produces images with a resolution of 1280 x 720 pixels. Brillant Labs has not yet released any information on battery life. What is particularly notable is that Frame is based on an open source model, which allows developers to customize hardware, software and AI models according to their own ideas.

To use the functions, the glasses must be connected to a smartphone. According to Brillant Labs, individually cut prescription lenses can also be inserted into the frame. Frame is available for pre-order for $349 and is expected to begin shipping to customers in April 2024.