manton
manton

Catching up this morning on all the OpenAI and Microsoft news. Hard to overstate how dramatic a weekend this was for the tech world. As a (small) OpenAI customer, I’m not sure where this leaves me. One thing is clear: Satya Nadella is a really impactful CEO. He turned a crisis into a triumph.

|
Embed
In reply to
gannonburgett
gannonburgett

@manton very curious to see how this all plays out, but it really was/is a top tier move from MSFT.

|
Embed
tkoola
tkoola

@manton isn’t this just a short-term fix for Nadella? Whatever lead to this drama has a potential to cause him serious trouble later?

|
Embed
manton
manton

@tkoola Maybe. In theory this sets the foundation for a lot more in-house AI work for Microsoft, if everything pans out. Meanwhile the OpenAI partnership continues along for the short term.

|
Embed
cshotton@mastodon.social
cshotton@mastodon.social

@manton If I were you, I'd skip worrying at all about OpenAI. Go get a copy of LM Studio, pull down one of the Mistral LLMs from HuggingFace, and never look back. OpenAI was dead in the water before it started. The Open Source LLM scene is going to eat their lunch in not too long.

|
Embed
manton
manton

@cshotton I should play with that. I don’t think I want to run my own AI stuff, though, at least not yet. Because of the processing power needed it’s such a nice thing to outsource.

|
Embed
cshotton@mastodon.social
cshotton@mastodon.social

@manton I have a pretty vanilla Mac Studio M1 and it runs these things fine. LM Studio replicates almost all of the OpenAI APIs and runs all of the Llama-derived LLMs as if you are talking to ChatGPT 3.5 or 4. The only missing piece at the moment is function callbacks. You'd be amazed at how well a 4 GB model like Mistral 7B does running locally. It takes about 5 minutes to get it all going. Give it a try! lmstudio.ai/

|
Embed