A new research paper reveals that Apple has been quietly working on a LLM solution of its own, and it already beats ChatGPT.
      • TheFriar@lemm.eeEnglish
        7·
        9 months ago

        OpenAI needs to watch out because Apple may finally be jumping on the AI bandwagon, and the news doesn’t bode well for ChatGPT. Apple is reportedly working on a large language model (LLM) referred to as ReALM, which stands for Reference Resolution As Language Modeling. Made to give Siri a boost and help it understand context, the model comes in four variants, and Apple claims that even its smallest model performs on a similar level to OpenAI’s ChatGPT.

        This tantalizing bit of information comes from an Apple research paper, first shared by Windows Central, and it appears to be an early peek into what Apple has been cooking for a while now. ReALM is Apple’s own LLM that was reportedly made to enhance Siri’s capabilities; these improvements include a greater ability to understand context in a conversation.

        The model is also said to be capable of processing onscreen content and more. That’d give it an edge over ChatGPT, which, although capable of processing image files and PDFs, can’t read your entire screen and react based on the contents.

        Apple’s take on LLMs is said to be launching in four different sizes, referred to as ReALM-80M, ReALM-250M, ReALM-1B, and lastly, ReALM-3B. The letters at the end of each model name refer to millions and billions, respectively.

        The researchers benchmarked ReALM and compared it to OpenAI’s GPT-3.5 and GPT-4. The worrying news for the Microsoft-backed OpenAI is that even Apple’s smallest ReALM-80M model is said to be all caught up to GPT-4, while all the ones above it are much, much better.

        The paper remarks that ReALM shows large improvements over systems with similar functionalities, and the smallest model is up to 5% better when it comes to processing onscreen information.

        While companies like Microsoft embraced the trend nearly as soon as it blew up, and, in Microsoft’s case, just made a fresh over $100B billion investment into the future of ChatGPT, Apple has kept quiet on the matter. Still, this isn’t the first time we’ve heard of Apple wanting to start getting into AI in a more substantial way — rumors late last year indicated that Apple had plans to give Siri much greater AI capabilities, and this paper is most likely the proof of those plans.

        It’s unclear when Apple’s LLM will enter the mainstream market. However, it’s likely that Apple will discuss ReALM during WWDC in June.