manton
manton

A couple days after the WWDC keynote, starting to see a couple cracks in Apple’s AI strategy. I’ll blog more later. But I think the architecture for small on-device models and larger models in the cloud that are extremely locked down is very smart. This is flexible and can scale, if users accept it.

|
Embed
Progress spinner
numericcitizen
numericcitizen

@manton I'll accept it.

|
Embed
Progress spinner
In reply to
paulrobertlloyd
paulrobertlloyd

@manton …and a gaping hole in their strategy to reach net zero by 2030. Or is that OpenAI’s problem? 🙄

|
Embed
Progress spinner
manton
manton

@paulrobertlloyd How so? They said their own data centers are all 100% renewable energy. I don't count OpenAI, just as I wouldn't count Google's servers just because it's the default search engine. (Although I do think everyone's servers need to be all renewable as soon as possible.)

|
Embed
Progress spinner
manton
manton

@numericcitizen Me too. It muddles things so we'll have to see if normal users understand how it all fits together (not that they really should need to).

|
Embed
Progress spinner
odd
odd

@manton I Agree. Now, I wonder if this relatively new technology, together with other relatively new technologies will scorch the planet. They are useful, yes, but are we, or rather they, (that live in lands close to the equator), willing to pay the price for this useful, but not necessary technology? I don’t know the whole picture energy-wise, but I know the planet keeps warming at an accelerating rate, and I’m a bit worried and hesitant.

|
Embed
Progress spinner
paulrobertlloyd
paulrobertlloyd

@manton All design decisions have consequences. Pushing requests to ChatGPT means computation on Microsoft’s servers, and famously their climate targets have gone out the window. Then there’s the fact that only newer Apple devices can run the local models, further encouraging hardware upgrades.

|
Embed
Progress spinner
paulrobertlloyd
paulrobertlloyd

@manton I’d encourage you to read this post about the Jevons paradox which explains how energy efficiency gains can often lead to more energy usage rather than less. This seems like a case in point.

|
Embed
Progress spinner
adamprocter
adamprocter

@paulrobertlloyd oh nice this is very good

|
Embed
Progress spinner
adamprocter
adamprocter

@paulrobertlloyd when I say good I mean bad but good to continue to highlight this very legit concern and it’s not just energy use but also water use

|
Embed
Progress spinner
manton
manton

@paulrobertlloyd If it wasn’t AI encouraging hardware upgrades, it would be something else: new cameras, more storage, whatever. I agree that it can be wasteful, but that problem seems more about Apple’s growth, stock price, etc. than AI specifically.

|
Embed
Progress spinner