Get the latest tech news
UIT – performant, modular, low-memory file processing at scale, in the Cloud
Library for performant, modular, low-memory file processing at scale, in the Cloud - janwilmake/uit
Thus, as features and complexity grew the need was born to create a more modular extensible architecture with good serverless practices in mind. Although FormData does not support stream-reading directly from Request and other Web Standards yet, UIT leverages the fact that intermediate results can be read using the Streams API using multipart-formdata-stream-js. uithub.ingestzip- Ingests and processes ZIP files into normalized formdata format uithub.merge- Combines multiple formdata streams into a single unified stream uithub.outputmd- Transforms and outputs data as markdown files uithub.outputzip- Packages processed data into downloadable ZIP archives uithub.search- Provides search capabilities across file hierarchies uithub.ziptree- Highly performant zip file-hierarchy extractor uithub.otp- Source proxy that generates an OTP to minimize secret exposure to other modules.
Or read this on Hacker News