Get the latest tech news
CodeScientist: Automated scientific discovery system for code-based experiments
CodeScientist: An automated scientific discovery system for code-based experiments - allenai/codescientist
The initial version of CodeScientist did this, but the containers were very slow to spin up, and it limited the number of simultaneous experments that could be spooled up to what was available on the local machine. A: This is highly variable, and depends on a great many things that are unknown (like the number of debugging iterations required, the size of the prompts the LLM generates, etc.). You may wish to place your keys in an exclusion file (e.g. EXCLUDE_PATTERNS.TXT) and setup pre-commit hooks to check for these patterns to help prevent them from accidentally being committed.
Or read this on Hacker News