According to Bloomberg's Mark Gurman, Apple bought a Canadian AI startup earlier this year. As the company promises big AI announcements for 2024, this acquisition might help bring a killer feature that no other competitor has yet: on-device AI.
In this study, Apple researchers say that they can make AI models run up to twice the size of the iPhone's memory by using windowing and row-column bundling: • Windowing: It loads parameters for only the past few tokens, reusing activations from recently computed tokens. This sliding windows approach reduces the number of IO requests to load weights.
このニュースをすぐに読めるように要約しました。ニュースに興味がある場合は、ここで全文を読むことができます。 続きを読む: