Zuck's bot increased our Vercel bill 10x

7 points - last Wednesday at 8:54 PM

I’m writing this after receiving a Vercel bill that was 10x higher than usual.

The worst part: The increase wasn’t caused by more users, but by +1M requests from meta-externalagent/1.1.

The requests targeted a Vercel preview deployment that we had shared on WhatsApp to test whether its link-preview metadata was working correctly.

We naively never bothered with bot calls; they had never caused any problems in the previous four years of our app on Vercel, but that changed when Meta’s crawler began repeatedly visiting this preview deployment.

If you host on Vercel, review your bot-protection settings and make sure preview deployments aren’t unnecessarily exposed. Otherwise, an aggressive crawler could leave you with a surprisingly large bill. And unfortunately, Vercel declined to help to ease this bill.

Zuck is definitely not slowing down.

Comments

speedgoose yesterday at 12:00 PM

On one hand, it's very annoying.

On another hand, you realised that you are vulnerable to denial of wallet attacks without loosing that much money.

raunaksingwi yesterday at 7:56 AM

Doesn't it get blocked by IP rate limiting? Nobody should be able to make so many calls to your site that it results in 10x higher bill on your side.

Even if not a crawler, it's basically a DoS attach. More over, why does muse have to crawl your urls so many times?

al_borland yesterday at 12:04 AM

I wonder what would happen if you sent Meta an invoice to cover the cost of their usage.

avinash147 yesterday at 2:49 AM

[flagged]

tmpsvc2695f5 yesterday at 6:54 AM

[dead]