Serving Job Guide
Welcome to the Arena Serving Job Guide! This guide covers how to use the arena cli to manage the serving job. This page outlines the most common situations and questions that bring readers to this section.
Who should use this guide?
If you want to use arena to manage serving jobs, this guide is for you. we have included detailed usages for managing serving jobs.
Manage The Serving Jobs
- How to list all serving jobs.
- How to attach the serving job.
- How to get the serving job details.
- How to get the serving job logs.
- How to delete the serving jobs.
Tensorflow Serving Job Guide
- I want to submit a tensorflow serving job with enabled istio.
- I want to submit a tensorflow serving job with enabled gpushare mode.
- I want to submit a tensorflow serving job which uses gpus.
- I want to submit a tensorflow serving job with prometheus.
- I want to update a tensorflow serving job after deployed.
Custom Serving Job Guide
- I want to submit a custom serving job which uses gpus.
- I want to update a custom serving job after deployed.
KFServing Job Guide
- I want to submit a kfserving job whose type is custom.
Seldon Core Serving Job Guide
Nvidia Triton Serving Job Guide
- I want to submit a nvidia triton serving job which use gpus.
- I want to update a nvidia triton serving job after deployed.
KServe Job Guide
- I want to submit a kserve job with supported serving runtime
- I want to submit a kserve job with custom serving runtime
Distributed Serving Job Guide
- I want to submit a distributed serving job.