Apple Tests AI That Records and Summarizes Genius Bar Conversations

Apple has begun testing a new AI-powered tool that automatically records, transcribes, and summarizes conversations at the Genius Bar. The system, called Live Notes, is designed to free service staff from taking manual notes during customer visits, according to Mark Gurman of Bloomberg.

The mechanism is simple. When a customer arrives for a Genius Bar appointment, the employee can turn on Live Notes once both parties agree. The system listens to the conversation, converts it to text, and then generates a condensed summary that gets added to the internal service record on the employee's iPad.

How Live Notes works

According to Apple's description, the transcript and summary are not entered into the system automatically or without review. The employee can first edit and correct them before they are saved as part of the customer's service history. Only after that review does the entry get added to Apple's internal database.

The company stresses that raw audio files from the conversations are not stored anywhere once processing is complete. Only the text remains, meaning the transcript and the AI-generated summary. Apple also says individual store managers have no visibility into these records.

Apple's stated purpose

The declared goal is to free employees from manual note-taking during customer visits, so they can devote more attention to the conversation and solving the problem rather than entering data into the system.

The goal is to take work off employees' plates and let them focus more on the customer rather than on taking notes during the visit - Mark Gurman, Bloomberg

Concerns among Apple Store employees

Despite Apple's assurances, store employees have voiced concerns that the recordings and transcripts could eventually be used to evaluate their performance during periodic reviews. Apple says no such scenario is planned, but the company has not confirmed any binding policy on the matter, nor ruled out changing its approach in the future.

It also remains unclear whether participation in the Live Notes program will stay fully voluntary for employees and customers long-term, or whether Apple plans to expand the tests to more locations. The company has not officially commented on the scope of the pilot or on any timeline for a wider rollout.

Broader context

Live Notes is another piece of Apple's strategy of weaving artificial intelligence into everyday customer service, alongside the previously tested generative AI support chat in the Apple Support app. The company, long cautious about disclosing its AI plans, is increasingly testing tools that automate the work of frontline customer-facing staff.

For Polish Apple customers, the direct impact of this change is limited for now, since the tests are confined to select stores in the United States. Still, it signals a possible direction for Apple Store customer service in Europe as well, where the company will also have to account for EU data protection rules governing the recording of conversations.