In prep for WWDC, reading up on some things I should’ve learned about Apple Foundation Models a year ago. I think I had dismissed it quickly because the on-device models are so small by frontier AI standards.
@manton My biggest want from WWDC is some news about better on-device AI. The Apple Foundation Models stuff is easy to implement but the results are…not great. Pretty simple prompts result in some wild outputs at times.
@jameskoole.ca I hope they’re working on that. With the Gemini license, they could have a much stronger model stored locally too, not just for Siri. Although with 8 GB phones there’s only so much you can do.
@manton any links that you recommend? I am curious to catch up too. I have been deep in OSS local model territory for the last while and wondering where to start in catching up on Apple moves.
@chadkoh No specific links come to mind… I read through some of the basic docs starting here, and just skipped around in WWDC sessions. I expect a lot will be out of date tomorrow.