Get the latest tech news
Theory crafting a system for 1000 simultaneous micro SD card ingests
Hello! I am looking for some advice for reworking a system to be able to ingest data from as many micro sd cards as possible at one time. At work, we take a lot of footage and we need to get that footage from the various sd cards and ingest it and copy it to a local server. Currently we are running a Threadripper Pro 7965X system which holds a bunch of USB addon cards. these breakout into USB hubs that hold SD card readers. I think right now we can do roughly 200 at once with our current set up...
The final piece is the custom firmware to drive all those controllers and keep them working, aggregate the data together, and ship it off to the network interface for handling. Unless you’re shooting outside documentary/reality style workloads, this is the superior method as a single snake can keep everything fed and your time sync is SOOOO much easier to maintain since it’s captured at the cam op. You’ll likely run into physical limitations though - long USB cables can be problematic for higher speeds, and you’re gonna have one heck of a medusa setup
Or read this on Hacker News