According to Bloomberg's Mark Gurman, Apple bought a Canadian AI startup earlier this year. As the company promises big AI announcements for 2024, this acquisition might help bring a killer feature that no other competitor has yet: on-device AI.
In this study, Apple researchers say that they can make AI models run up to twice the size of the iPhone's memory by using windowing and row-column bundling: • Windowing: It loads parameters for only the past few tokens, reusing activations from recently computed tokens. This sliding windows approach reduces the number of IO requests to load weights.
لقد قمنا بتلخيص هذا الخبر حتى تتمكن من قراءته بسرعة. إذا كنت مهتمًا بالأخبار، يمكنك قراءة النص الكامل هنا. اقرأ أكثر: