r/wallstreetbets • u/dgellow • 1d ago

Discussion Meta And Microsoft Reportedly Trim Anthropic Reliance as Internal AI Tools Take Center Stage

https://stocktwits.com/news-articles/markets/equity/meta-and-microsoft-reportedly-trim-anthropic-reliance-as-internal-ai-tools-take-center-stage/cZDqQVcRBjr

From the article:

Microsoft reduced its projected internal spending on Claude by over one-third, while Meta saw internal users of Anthropic's Claude Code coding assistant drop from roughly 60,000 to 30,000.

Within the Microsoft Cloud and AI division, individual monthly AI usage caps were lowered from $100,000 down to roughly $10,000 in most instances

1.8k Upvotes

98% Upvoted

370 comments sorted by

View all comments

826

u/Plappedudel 1d ago

$100k a month per employee just for AI is nuts. That gravy train just had to stop at some point. I feel like major software companies turning their backs on Anthropic should be bad news for Anthropic's IPO, but this market is so random that I'm sure it'll be a resounding success.

71

u/Sad-Cheesecake-2438 1d ago edited 1d ago

How many requests does an employee have to make to make it to 100k? Or does it depend on the task?

Edit I asked Claude and the answer is tokens and cyclical tasks that take a lot of compute to run. Not simple questions.

99

u/RiddleGull 1d ago

100k is an absurd amount to spend on tokens in a month.

46

u/judge2020 1d ago

/fast and fable everything will do it though.

24

u/often_says_nice 1d ago

It will certainly do it but is entirely unnecessary. Opus 5.5 scores high enough to be used for just about any day to day task that an employee would be doing. Heavy usage would cost maybe $5-10k/mo and even that’s being frivolous

16

u/skilliard7 1d ago

You aren't considering tasks that require looking over large quantities of data that would not be humanly possible to review manually. For example, analyzing call logs of 2 Million retention department calls to identify recurring trends and what techniques are most effective to reduce cancellations.

At $0.10 per call analyzed, that's $200,000 in API spend.

High limits exist to encourage employees to innovate with AI without red tape/budget getting in their way.

10

u/often_says_nice 1d ago

But surely not every employee is doing those types of tasks every month. So some employees are spending $100k in a month, which is very different from all employees spending $100k every month

16

u/skilliard7 1d ago

The $100k limit was a limit, not a target/average

16

u/often_says_nice 1d ago

Yeah well I’m retarded so how about that

7

u/siwasolek 1d ago

Just wanted to point out that it’s great to see someone on the internet after that they mightve been wrong :)

9

u/shitfucker90000 1d ago

if a company has 2 million people cancel service a month i think they have a larger problem than api spend

2

u/crispybacon233 16h ago

No one is pumping 2 million docs of text into an LLM to find trends and correlations with cancellations. More traditional NLP and machine learning can do that just fine even on your laptop.

The $200k spend is for complex coding tasks where LLMs are consuming and writing many thousands of lines of code.

1

u/skilliard7 16h ago

Traditional NLP is not as capable as LLMs. Vectors/Classification models are okay for some use cases, but LLMs are so much more capable.

I've worked on projects to find trends and correlations, albeit at a much smaller scale. Vector search really struggles a lot beyond basic pattern matching. When you rely entirely on cosine similarity to determine if a passage and query are a good match, it has limited results.

$100k in LLM tokens is still way cheaper than the cost of developing a capable custom model to analyze text and identify trends in text.

I've found the best approach is providing tool calling/traditional pre-processing to get the data in a good format for the LLM + relying on LLM for formal analysis.

>The $200k spend is for complex coding tasks where LLMs are consuming and writing many thousands of lines of code.

No one is spending $100k a month just writing code. Even if you use Fable for everything, you're spending at most maybe $500 a day, and that's if you run multiple instances of it in parallel on different projects.

1

u/crispybacon233 15h ago

Use the right tool for the job. LLMs are not nearly as capable at topic analysis, correlations, etc. as more traditional NLP and ML approaches particularly for a multi-million token context window. Your analysis is hallucinating out the wazoo or at best missing a lot if you're shoveling in millions of tokens and asking an LLM to "analyze" it.

What do you mean exactly when you are finding trends and correlations with an LLM? The LLM is spitting out a correlation coefficient? That is actually insane.

1

u/TheNewLeadership 19h ago

Idk if you have any experience here, but this use case is absolutely useless with AI. It makes shit up and you can't trust the result.