Skip to content

Commit

Permalink
Merge branch 'docker_aarch' of https://github.com/pytorch/serve into …
Browse files Browse the repository at this point in the history
…docker_aarch
  • Loading branch information
udaij12 committed Sep 16, 2024
2 parents 385ba55 + 7faad18 commit 6d6bd92
Show file tree
Hide file tree
Showing 6 changed files with 18 additions and 18 deletions.
4 changes: 2 additions & 2 deletions docs/Troubleshooting.md
Original file line number Diff line number Diff line change
Expand Up @@ -76,8 +76,8 @@ Relevant issues: [[#566](https://github.com/pytorch/serve/issues/566)]
#### How can I resolve model specific python dependency?
You can provide a requirements.txt while creating a mar file using "--requirements-file/ -r" flag. You can refer to the [waveglow text-to-speech-synthesizer](https://github.com/pytorch/serve/tree/master/examples/text_to_speech_synthesizer) example

- [waveglow mar creation script](https://github.com/pytorch/serve/blob/master/examples/text_to_speech_synthesizer/create_mar.sh)
- [waveglow handler](https://github.com/pytorch/serve/blob/2d9c7ccc316f592374943a1963c1057bbe232c9e/examples/text_to_speech_synthesizer/waveglow_handler.py#L49)
- [waveglow mar creation script](https://github.com/pytorch/serve/blob/master/examples/text_to_speech_synthesizer/WaveGlow/create_mar.sh)
- [waveglow handler](https://github.com/pytorch/serve/blob/2d9c7ccc316f592374943a1963c1057bbe232c9e/examples/text_to_speech_synthesizer/WaveGlow/waveglow_handler.py#L49)

Relevant issues: [[#566](https://github.com/pytorch/serve/issues/566)]
Refer [Torch model archiver cli](https://github.com/pytorch/serve/blob/master/model-archiver/README.md#torch-model-archiver-command-line-interface) for more details.
Expand Down
4 changes: 2 additions & 2 deletions docs/custom_service.md
Original file line number Diff line number Diff line change
Expand Up @@ -250,7 +250,7 @@ class ModelHandler(BaseHandler):

```

Refer [waveglow_handler](https://github.com/pytorch/serve/blob/master/examples/text_to_speech_synthesizer/waveglow_handler.py) for more details.
Refer [waveglow_handler](https://github.com/pytorch/serve/blob/master/examples/text_to_speech_synthesizer/WaveGlow/waveglow_handler.py) for more details.

#### Captum explanations for custom handler

Expand Down Expand Up @@ -362,7 +362,7 @@ class CustomImageClassifier(ImageClassifier):
For more details refer following examples :
- [mnist digit classifier handler](https://github.com/pytorch/serve/tree/master/examples/image_classifier)
- [Huggingface transformer generalized handler](https://github.com/pytorch/serve/blob/master/examples/Huggingface_Transformers/Transformer_handler_generalized.py)
- [Waveglow text to speech synthesizer](https://github.com/pytorch/serve/blob/master/examples/text_to_speech_synthesizer/waveglow_handler.py)
- [Waveglow text to speech synthesizer](https://github.com/pytorch/serve/blob/master/examples/text_to_speech_synthesizer/WaveGlow/waveglow_handler.py)

## Creating a model archive with an entry point

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -350,8 +350,8 @@ private static Operation getUnRegisterOperation(boolean version) {
operationId = "version_unregisterModel";
} else {
operationDescription =
"Unregister the default version of a model from TorchServe if it is the only version available."
+ "This is a asynchronous call by default. Caller can call listModels to confirm model is unregistered";
"Unregister the default version of a model from TorchServe if it is the only version available. "
+ "This is an asynchronous call by default. Caller can call listModels to confirm model is unregistered.";
operationId = "unregisterModel";
}
Operation operation = new Operation(operationId, operationDescription);
Expand Down Expand Up @@ -482,12 +482,12 @@ private static Operation getScaleOperation(boolean version) {
if (version) {
operationDescription =
"Configure number of workers for a specified version of a model. "
+ "This is a asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.";
+ "This is an asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.";
operationId = "version_setAutoScale";
} else {
operationDescription =
"Configure number of workers for a default version of a model."
+ "This is a asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.";
"Configure number of workers for a default version of a model. "
+ "This is an asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.";
operationId = "setAutoScale";
}

Expand Down
6 changes: 3 additions & 3 deletions frontend/server/src/main/resources/proto/management.proto
Original file line number Diff line number Diff line change
Expand Up @@ -111,12 +111,12 @@ service ManagementAPIsService {
// Register a new model in TorchServe.
rpc RegisterModel(RegisterModelRequest) returns (ManagementResponse) {}

// Configure number of workers for a default version of a model.This is a asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.
// Configure number of workers for a default version of a model. This is an asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.
rpc ScaleWorker(ScaleWorkerRequest) returns (ManagementResponse) {}

// Set default version of a model
rpc SetDefault(SetDefaultRequest) returns (ManagementResponse) {}

// Unregister the default version of a model from TorchServe if it is the only version available.This is a asynchronous call by default. Caller can call listModels to confirm model is unregistered
// Unregister the default version of a model from TorchServe if it is the only version available. This is an asynchronous call by default. Caller can call listModels to confirm model is unregistered.
rpc UnregisterModel(UnregisterModelRequest) returns (ManagementResponse) {}
}
}
6 changes: 3 additions & 3 deletions frontend/server/src/test/resources/management_open_api.json
Original file line number Diff line number Diff line change
Expand Up @@ -666,7 +666,7 @@
}
},
"put": {
"description": "Configure number of workers for a default version of a model.This is a asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.",
"description": "Configure number of workers for a default version of a model. This is an asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.",
"operationId": "setAutoScale",
"parameters": [
{
Expand Down Expand Up @@ -877,7 +877,7 @@
}
},
"delete": {
"description": "Unregister the default version of a model from TorchServe if it is the only version available.This is a asynchronous call by default. Caller can call listModels to confirm model is unregistered",
"description": "Unregister the default version of a model from TorchServe if it is the only version available. This is an asynchronous call by default. Caller can call listModels to confirm model is unregistered.",
"operationId": "unregisterModel",
"parameters": [
{
Expand Down Expand Up @@ -1254,7 +1254,7 @@
}
},
"put": {
"description": "Configure number of workers for a specified version of a model. This is a asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.",
"description": "Configure number of workers for a specified version of a model. This is an asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.",
"operationId": "version_setAutoScale",
"parameters": [
{
Expand Down
6 changes: 3 additions & 3 deletions frontend/server/src/test/resources/model_management_api.json
Original file line number Diff line number Diff line change
Expand Up @@ -211,7 +211,7 @@
}
},
"put": {
"description": "Configure number of workers for a default version of a model.This is a asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.",
"description": "Configure number of workers for a default version of a model. This is an asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.",
"operationId": "setAutoScale",
"parameters": [
{
Expand Down Expand Up @@ -422,7 +422,7 @@
}
},
"delete": {
"description": "Unregister the default version of a model from TorchServe if it is the only version available.This is a asynchronous call by default. Caller can call listModels to confirm model is unregistered",
"description": "Unregister the default version of a model from TorchServe if it is the only version available. This is an asynchronous call by default. Caller can call listModels to confirm model is unregistered.",
"operationId": "unregisterModel",
"parameters": [
{
Expand Down Expand Up @@ -799,7 +799,7 @@
}
},
"put": {
"description": "Configure number of workers for a specified version of a model. This is a asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.",
"description": "Configure number of workers for a specified version of a model. This is an asynchronous call by default. Caller need to call describeModel to check if the model workers has been changed.",
"operationId": "version_setAutoScale",
"parameters": [
{
Expand Down

0 comments on commit 6d6bd92

Please sign in to comment.