Add image for ARM workloads for cuda-tests and mark tests that work on ARM.
Most tests don't work due to cross-compiling between sbma and aarch64.
However, a few do. Add an image to support them.
These CUDA tests were initially broken in gVisor but now appear to pass.
The test now also verifies that all capabilities are enabled when running.
PiperOrigin-RevId: 713094806
This refreshes the set of models built into the image to a more diverse
set of models while keeping the same categories covered.
It also adds support for embedding generation and benchmark metrics for
embedding-type models.
The image is also (slightly) smaller which helps make benchmarks not take
forever.
PiperOrigin-RevId: 706594537
Per https://docs.nvidia.com/cuda/cuda-toolkit-release-notes/index.html#id5,
CUDA 12.3.0 requires driver `>=545.23.06`, while CUDA 12.2.2 requires driver
`>=535.104.05`. Per nvproxy/version.go, 535.104.05 is currently the oldest
driver version we support.
PiperOrigin-RevId: 694652445
GCR will be deprecated, while the prefix `gcr.io` will be
be hosted via Artifact Registry. By adding this one extra step,
all test images will be accessible via both `gcr.io` and
`pkg.dev`.
PiperOrigin-RevId: 694278137
It should fix this error:
+ ruby /src/ruby.rb
/usr/local/bundle/gems/rackup-2.2.0/lib/rackup/handler.rb:81:in `pick': Couldn't find handler for: puma, falcon, thin, HTTP, webrick. (LoadError)
from /usr/local/bundle/gems/sinatra-4.0.0/lib/sinatra/base.rb:1624:in `run!'
from /usr/local/bundle/gems/sinatra-4.0.0/lib/sinatra/main.rb:47:in `block in <module:Sinatra>'
PiperOrigin-RevId: 693089452
Zach KoopmansandgVisor bot
Lucas ManningandgVisor bot
Andrei VaginandgVisor bot
Jing ChenandgVisor bot
Ayush RanjanandgVisor bot
2022tgoel
Etienne PerotandgVisor bot
xianzhe-databricks
Jamie LiuandgVisor bot