The issue is not so much with amount of data, it’s bandwidth. Mastodon has seen that already: if you have someone on your server with thousands of followers and they post something with a link or anything that can have a embedded card, any single post from them will trigger immediately to your server being flooded with requests related to that card. You can get a server effectively DDOS’d even if you are not hosting a lot.