According to Bloomberg's Mark Gurman, Apple bought a Canadian AI startup earlier this year. As the company promises big AI announcements for 2024, this acquisition might help bring a killer feature that no other competitor has yet: on-device AI.
In this study, Apple researchers say that they can make AI models run up to twice the size of the iPhone's memory by using windowing and row-column bundling: • Windowing: It loads parameters for only the past few tokens, reusing activations from recently computed tokens. This sliding windows approach reduces the number of IO requests to load weights.
이 소식을 빠르게 읽을 수 있도록 요약했습니다. 뉴스에 관심이 있으시면 여기에서 전문을 읽으실 수 있습니다. 더 많은 것을 읽으십시오: