Pioneers Insight Method Research Author
Bee AI: The Wearable Ambient Agent
Back to Episodes

Bee AI: The Wearable Ambient Agent

Summary

  • Bee’s central bet is that personal AI becomes valuable when it passively accumulates first-person context, not when users repeatedly explain themselves to another chatbot. Memory is only “the base kind of use case”: the larger ambition is an assistant that understands relationships, attitudes and preferences well enough to “already know” what its user wants. Ethan estimates a person can produce roughly 200,000 tokens daily and says his own personal corpus is about 50 million tokens.

  • The $49.99 wearable exists because tiny interaction costs undermine an always-on experience. A phone monopolizes its microphone and gets interrupted by calls; Apple Watch users must restart Bee after calls and charging, and some consequently buy the dedicated device within days. Bee gets up to seven days of battery life while complementing the phone, which Ethan expects to remain dominant for perhaps five years until something like affordable, lightweight Orion-type glasses arrives.

  • Bee’s core product layer is its context engine and ability to act, not merely its bracelet or transcription. It performs speaker identification, semantic conversation endpointing, summaries, tone and action-item extraction, then connects speech with Gmail, Google Calendar, location and web search. A WhatsApp beta can notice an actionable message, propose help and operate an Android cloud phone, while the API currently offers read-only and real-time socket access with external actions promised “very soon.”

  • Professional users have emerged as the clearest early wedge even though Bee was not designed as a vertical work product. The company says daily shipments exceed 100, with Texas—Maria thinks—its biggest state and Florida also prominent; users include white-collar professionals reviewing conversations, job candidates asking how interviews went and restaurant operators checking performance. Bee intends to provide the general “understanding kind of engine” and let third parties build specialist coaches because “no startup could do all those verticals” well.

  • Privacy is a central adoption concern, an unsettled legal question and a product-design constraint. Ethan distinguishes one-party-consent Nevada from two-party-consent California, while Maria—explicitly noting she is not a lawyer—says processed, unpersisted audio and user-focused summaries may not be equivalent to retaining a recording, an explicitly “gray area and untested in law.” Bee is adding location and context-based disabling, because users may like the product yet say, “I cannot wear this at work.”

  • The hardware roadmap prioritizes unobtrusiveness and battery life over technically impressive spectacle. Community rejection of a bulky pendant led to a modular bracelet or clip, while vision was deferred because image capture and radio transmission consume too much power, chest cameras miss the relevant field of view and anything worn on the face “has to look cool.” Moving from a prototype to production remains an “enormous jump” involving suppliers, tooling, regulations and four-to-six-week tooling lead times.

  • Falling token prices undermine the original razor-and-blades thesis, but speech processing and personal memory remain hard technical problems. Voice-activity detection avoids transcribing silent hours; small models can summarize, while Sonnet-level agent execution may justify a subscription and R1 had not yet been evaluated. The team self-hosts models, fine-tunes ASR and uses custom massively parallel retrieval because “there’s no general way to do RAG that works” across a growing, noisy corpus whose facts decay or contradict one another.

  • The long upside case is a permissioned network of personal agents coordinating on their users’ behalf. Bee agents already demonstrated choosing a French restaurant from two users’ locations, calendars and preferences, although an experiment that delivered roughly 20 candles illustrates why authorization and spending controls matter. Ethan’s highest-conviction forecast is that “always-on AI is really going to explode,” with startups and incumbents discovering how it changes daily behavior.

Deep dive

1. Personal context—not recall alone—is Bee’s product

  • Maria defines Bee as “AI living alongside you in first person,” capturing real-life context so it can recall, reflect and eventually help without repeatedly asking about the user’s preferences. Memory is “really just the base kind of use case”; the intended model includes attitudes, desires, relationships and changing circumstances.

  • Maria says the most visible behavior currently clusters around companionship and professional assistance. Her preferred analogy is a best friend who knows the user extremely well, while the hosts argue that reducing this ambition to a list of “use cases” makes the product sound drier than the envisioned experience.

  • Ethan now informally measures “what is my token output of the day?” and arrives at roughly 200,000 tokens; his accumulated personal context may be around 50 million. Even a single-day summary surprised him as a non-journaler, while a “Spotify Wrapped for my 2024” surfaced metrics such as three countries visited and beta devices shipped.

2. A failed 2016 chatbot made passive learning non-negotiable

  • Ethan’s first personal-AI attempt began in 2016, “before transformers—no BERT even—just RNNs,” during the brief post-F8 belief that bots would replace apps. Convincing dialogue was impossible, but he and his previous co-founder were already trying to model a dynamic person through an app that asked questions and returned feedback.

  • The company joined Betaworks’ Botcamp alongside the original Hugging Face, then a teenage chat app saying things like, “Hey friend, how was school? Let’s trade selfies.” Ethan believes Hugging Face built the Transformers library to improve that product, then open-sourced it, after which the library became the larger opportunity.

  • Teenagers sometimes enjoyed answering endless questions about themselves, but most users would not do the labor required to teach an AI manually. Ethan’s team pivoted through YC into viral consumer video, created Squad, sold it to Twitter and helped launch Twitter Spaces; they started working on Bee again shortly before ChatGPT appeared, after app experiments exposed the limitations of the earlier approach.

3. Dedicated hardware wins by deleting tiny daily frictions

  • Ethan’s test for any wearable is, “Why isn’t this an app?” Continuous phone capture would monopolize the microphone, stop during calls and require users to remember to restart it. That “little bit of friction” materially breaks the feeling of an intelligence simply living alongside its user.

  • Bee therefore supports Apple Watch as an immediate, hardware-free trial, with background operation engineered to limit battery drain. Yet calls interrupt capture, and daily charging creates another reminder and friction to reopen Bee; Maria says users experience the value, tire of reopening the app and sometimes buy Bee after only a couple of days.

  • Owning the hardware gives Bee control over gain, sample rate and other audio parameters unavailable through Apple’s limited framework. The challenge is not studio audio but a system flexible enough to work at dinner in a noisy restaurant without tuning one environment so aggressively that another becomes unusable.

  • The device is meant to work with the phone, not recreate the Rabbit or Humane strategy of establishing a new hardware platform. Ethan calls the wearable “the ears of the AI” and expects phones to remain dominant until a cheap, light next-generation interface—perhaps Orion-type glasses—arrives years from now.

4. Capture becomes valuable only when it can act elsewhere

  • Bee’s app continuously shows what is happening now, then converts the day into readable conversation segments. Speaker identification prevents another person’s statement from becoming a fact about the user, while voice teaching helps identify close contacts and semantic endpointing separates conversations whose boundaries are naturally fuzzy.

  • Once a conversation ends, larger models analyze and summarize it, extracting key points, atmosphere, tone and possible actions; an end-of-day view combines those pieces with location. User facts remain visible and editable, creating a human-in-the-loop layer before uncertain observations become trusted personal context.

  • The recall interface can search memories, Gmail, Google Calendar and the web, then link its synthesis back to source conversations. Ethan demonstrated asking about a Taiwan manufacturing trip and receiving its details, production issues and relevant discussions rather than an ungrounded recollection.

  • In the WhatsApp beta, Bee watches notifications and asks two questions: is this important enough to surface, and can it help? A restaurant request triggered a suggestion, accepted through chat or push-to-talk; an Android cloud phone then found the WhatsApp thread and sent the answer. “Hey Alfred” supplies wake-word access when the phone is inactive.

5. An API turns personal context into infrastructure

  • Alessio’s developer case was blunt: no single consumer app can anticipate all his needs, so users must be able to own, correct and reprocess their data. He contrasted Bee with other wearables that lacked APIs, while swyx declared, “We are API enjoyers in this house.”

  • Bee does not store audio by default, but its API can expose processed context and provide real-time socket access. Access was read-only during the conversation; Ethan said write support and external actions would become fully available alongside the broader action system “very soon.”

  • The larger product vision is “not just a tool”: Bee should proactively suggest useful actions at an appropriate moment. Ethan acknowledges that the threshold is difficult—an assistant that constantly interjects is intolerable, while one that misses every meaningful opening contributes little—and believes strong reasoning plus personal context is necessary to find the balance.

6. Privacy remains both a legal gray zone and a social transition

  • Asked whether instant replay could settle arguments or expose lies, Maria emphasized AI as an “objective point of view” on what happened and on the emotions in a conversation. She is more interested in support for a user distorted by anger or sadness than in creating a machine that prosecutes every contradiction.

  • The discussion also distinguishes legitimate change from deception: humans say different things in different contexts and evolve over time. Bee currently lets users approve, reject or edit asserted facts; the team wants eventual automation but does not pretend that noisy speech alone establishes durable truth.

  • Ethan distinguishes single-party-consent Nevada from two-party-consent California and notes that public settings have different privacy expectations. Maria, explicitly noting she is not a lawyer, says that because Bee processes audio without persisting it and stores user-centered summaries rather than voices, whether it legally constitutes a recording remains “a gray area and untested.”

  • Ethics still matter where recording is legal. Maria reports no requests to disable Bee after disclosure, including in privacy-conscious Italy, but users cite uncomfortable partners and confidential workplaces. Planned safeguards include geofencing and “context fencing,” while Maria expects norms to shift over roughly the present-to-five-year transition, as they did around doorbell cameras.

7. Professional users emerged without a vertical go-to-market

  • Maria says Bee ships more than 100 devices daily, not chiefly to an early-adopter enclave in San Francisco. She thinks Texas is its largest state, with Florida also prominent, and sees strong demand from white-collar professionals “who talk for a living.”

  • One user used Bee during job interviews and then asked, “How do you think my interview went? What should I do better?” Other possibilities include restaurant professionals examining performance and people checking whether they performed well—an ambient version of personal coaching rather than only meeting transcription.

  • When the hosts compared this wedge with vertical tools such as Gong, Maria resisted turning Bee into every specialist application. The company wants to build the underlying understanding engine and enable third parties through its API; consumer behavior is too unpredictable to declare the eventual killer feature in advance.

8. Battery and wearability outrank cameras and spectacle

  • Bee moved from a bulky circular pendant after community members—particularly women already wearing necklaces—said they would not use it. The resulting module can become a bracelet or clip, currently comes in yellow or black and leaves room for other colors and possibly a future pendant design.

  • Maria believes an earlier version had roughly 35 hours of battery life, while the current device offers seven days. She emphasizes the desired reaction: “I like to wear it and forget about it”; the discussion accordingly prioritizes smaller, lighter and power-efficient hardware over an Apple-like pursuit of thinness for its own sake.

  • swyx admires Humane’s engineering but argues that its weight, heat, swappable batteries and laser interface did not solve a problem better than a phone. MagSafe recorders such as Plaud can carry large batteries, but a microphone attached to a phone inside a pocket creates a different capture problem.

  • Vision was deferred because even low-frame-rate capture and radio transmission consume much of the power budget, while chest placement often misses what the wearer sees. swyx contrasted conspicuous Snap Spectacles with nearly ordinary Meta Ray-Bans; Ethan added that current startup glasses still face short battery life and are not yet something people would wear every day.

9. Manufacturing makes hardware iteration fundamentally slower

  • Ethan calls the jump from prototype to manufactured product “enormous.” Firmware and electronics are increasingly approachable—even with Claude Sonnet helping someone get started on unfamiliar firmware—but production adds procurement, regulation, bill-of-materials sourcing, cost control and enclosure tooling that can take four to six weeks before a flaw becomes visible.

  • Maria recommends choosing suppliers through other founders, matching specialists to plastics, PCBs or other needs, and visiting them to establish relationships. Alessio described using costly domestic Los Angeles production for rapid early boards and said Chinese prototyping is increasingly competitive on time and price; Bee ultimately performed fabrication and assembly in Taiwan.

  • Bee attended CES for three planned days without buying a booth, using the roughly 80,000–90,000-person gathering for media, partners and suppliers. A 10-by-10 space costs about $5,000 before presentation costs, while standing out may require six figures; supplier meetings nevertheless surfaced body-heat capture, solar and kinetic options, with solar appearing more realistic for Bee’s power needs.

10. Falling inference costs push the hard problem into memory

  • Ethan argues that roughly 250,000 input tokens are no longer inherently expensive because token prices keep falling. Speech-to-text remains harder: it needs real-time processing and later processing by a larger model, so cheap voice-activity detection first removes the majority of a day in which nobody is speaking.

  • Summaries do not require a Sonnet-level model, whereas reliable agent execution may—and Bee expects to charge a subscription for those expensive capabilities. The team self-hosts models and fine-tunes ASR; R1 had not yet been evaluated.

  • Alessio acknowledged getting the business model wrong: he expected cheap hardware subsidized by recurring “razors and blades” revenue, yet cited Friend and Limitless at one-time prices of $99 and Bee at $49.99. Rapidly declining inference costs make that consumer-hardware economics question materially different from when he formed the thesis.

  • Ethan expects “all ASR, all speech to text” to become obsolete relatively soon as end-to-end models absorb today’s tedious pipeline, though they may initially require more compute before distillation. Bee likewise found generic RAG inadequate: memories decay, traditional embeddings and RAG underperform on a growing personal corpus, and “there’s no general way to do RAG that works” independently of the data.

11. Permissioned agent exchange is the long upside case

  • Bee built custom, small-model, massively parallel retrieval and separates user-confirmed ground truth from fuzzier inferences. Knowledge graphs may be the right way to store the data, Ethan says, but retrieving and formatting graph data for an LLM without overwhelming or confusing it remains difficult.

  • The desired system must infer behaviors never spoken aloud—for example, noticing receipts and repeated orders so “order something from this place” means buying the user’s usual meal. That requires reasoning across conversations, emails, calendars and actions rather than appending explicit preferences to a memory list.

  • Two Bee agents already combined calendars, locations and shared preference for French food to choose a new restaurant near Pacific Heights. Future ideas included social exchanges, family updates, personality inference and dating applications, but an agent experiment that sent Maria about 20 candles illustrates why explicit control is necessary over what an agent may disclose or purchase.