Revamping Apple’s Notification Summaries: A Path to Greater Accuracy

How Apple Could Improve Notification Summaries

Current State:

• Notification Summaries: Aimed at helping users read through notifications faster by summarizing them on-device.
• Flaws:
  • Summaries are based solely on the brief content of notifications, leading to a lack of context and inaccuracies.
  • Inaccurate summaries for group chats and news stories can merge differing details into one inaccurate summary.
• Consequences: Apple has disabled notification summaries for news apps due to significant misrepresentations, such as an inaccurate summary of a BBC News story about Luigi Mangione.

Proposed Solution:

• Developer Context: Allow developers to provide additional background context to Apple’s on-device model.
  • For example, in iMessage, developers could give the model context of what a new text is in response to.
  • News apps could provide the lead paragraph of a story, giving Apple Intelligence more information to work with for accurate summaries.
• Benefits:
  • Improved accuracy and quality of notification summaries.
  • Re-enablement of news app summaries without the risk of significant misrepresentations.

Challenges:

• Model Limitations: Large language models need to be small enough to run on a smartphone with limited RAM, which can affect performance.
• User Privacy: Ensuring that additional context provided by developers does not compromise user privacy.

Conclusion:

Apple needs a solution to its notification summaries problem. Allowing developers to provide background context could significantly improve the accuracy and reliability of these summaries.