Device Manager
Device manager is a host machine that manages one or more GPU devices associated with OwLite runners. It oversees the benchmark job queue and relays incoming requests for building TensorRT engines from users to the Runners. The custom device manager enables our users to effectively and safely expand their GPU resources to accommodate the growing demands of internal OwLite users.
A custom device manager is currently provided to on-premise users only.
1. Listing device managers
owlite device ls
2. Connecting to a device in an existing device manager
Any user can access 'NEST', the free device manager running on RunPod, by one of the following commands.
owlite device connect
# or equivalently
owlite device connect --name NEST
Free plan users will be automatically connected to 'NEST' without explicitly running the above commands as it is their only option.