Get the latest tech news
Text-to-LoRA: Hypernetwork that generates task-specific LLM adapters (LoRAs)
Hypernetworks that adapt LLMs for specific benchmark tasks using only textual task description as the input - SakanaAI/text-to-lora
We have re-trained a new set of baselines and T2L models due to a small mismatch between the specific package version combinations used in the original submission. Furthermore, vLLM is inherently non-deterministic when applying LoRA (in the version-configuration combinations we tested). However, after re-retraining and collecting new results, T2L still consistently outperforms baselines across model families, confirming the validity of our original empirical analysis.
Or read this on Hacker News
