Skip to content

Initial Release

Choose a tag to compare

@alexzhang13 alexzhang13 released this 12 Jan 17:38
· 69 commits to main since this release
18a9368

Initial Release

Working implementation of RLMs that supports local, Docker, Modal, and Prime Intellect sandboxes.

  • Mainly communicates between lm_handler and the sandbox through either HTTP or sockets.
  • Supports the sub-call llm_query and batch_llm_query for multiple asynchronous subclass.
  • Supports persistent REPLs for RLM clients, meaning the REPL environment does not reset after every RLM call.
  • Supports most major client providers (mainly tested with OpenAI completions SDK).