Hello everybody,
I’m starting to speak with people around the fediverse (devs/admins) around building a « fediCDN / FediStorage » platform to support the Pixelfed / Loops project.
Loops is a tiktok clone which is likely going to require 1000s of TB of storage and bandwidth over time… this is a similar situation for peertube as you grow in size and use.
I figure a FediCDN we build for loops could be shared with the Peertube/Mastodon/etc because that’s good one for us us is good for all of us.
- The peertube p2p solution is excellent and I believe Loops could benefit from that in the medium term (requiring additional engineering effort + 90% of people are on mobiles so no idea how that’ll work).
Question: Is it worth building/hosting in colocation. Large 200TB+ storage arrays and putting an S3 (minio/garage/seaweedfs etc) or even a jortage style file level dedupe server GitHub - Timshel/s3-dedup-proxy: An object store deduplication proxy for large file using services.
Wasabi/backblaze are still $5USD per TB… so we could find considerable savings there?
Does Framasoft have any plans or recommendations on how to proceed?
I would be very interested in building some kind of cooperative/colab hosting service that can start in 1-2 locations and allow people with colos to add their fileservers into the cluster over time.
Building a CDN to cache these files regionally to limit inbound traffic directly to these Storage nodes is also required, but that’s an easier problem to solve with existing software/VPS VMs.