معرفی شرکت ها
azureml-inference-server-http-0.8.4
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشترتوضیحات
Azure Machine Learning inferencing server.
| ویژگی | مقدار |
|---|---|
| سیستم عامل | - |
| نام فایل | azureml-inference-server-http-0.8.4 |
| نام | azureml-inference-server-http |
| نسخه کتابخانه | 0.8.4 |
| نگهدارنده | [] |
| ایمیل نگهدارنده | [] |
| نویسنده | Microsoft Corp |
| ایمیل نویسنده | amlInferenceImages@microsoft.com |
| آدرس صفحه اصلی | - |
| آدرس اینترنتی | https://pypi.org/project/azureml-inference-server-http/ |
| مجوز | https://aka.ms/azureml-sdk-license |
============================================================================
Azure Machine Learning Inference HTTP Server (azureml-inference-server-http)
============================================================================
Check our official documentation `here <https://docs.microsoft.com/en-us/azure/machine-learning/how-to-inference-server-http>`__.
We are currently working on an updated version of this package, if you would like to suggest features or share feedback please fill out this form `here
<https://forms.office.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbRzjWjI2uwMBOsl7fXFLuCRJUNEc4MFVTVThKRUgxTjNGTTExMVc3M1E1QS4u>`__.
Python 3.6 Deprecation
======================
- Python 3.6 support on Windows is dropped from `azureml-inference-server-http` v0.4.12 to pick up `waitress v2.1.1 <https://pypi.org/project/waitress/2.1.1/>`__ with the security bugfix of `CVE-2022-24761 <https://nvd.nist.gov/vuln/detail/CVE-2022-24761>`__.
- Python 3.6 support on Mac, Linux and WSL2 will not be impacted by above change for now.
- Python 3.6 support on all platforms will be dropped in **December, 2022** (previously: 6/15/2022)
CORS support
=============
Cross-origin resource sharing is a way to allow resources on a webpage to be requested from another domain. CORS works
via HTTP headers sent with the client request and returned with the service response. For more information on CORS and
valid headers, see `Cross-origin resource sharing <https://en.wikipedia.org/wiki/Cross-origin_resource_sharing>`__ in
Wikipedia.
Users can specify the domains allowed for access through the ``AML_CORS_ORIGINS`` environment variable, as a comma
separated list of domains, such as ``www.microsoft.com, www.bing.com``. While discouraged, users can also set it to
``*`` to allow access from all domains. CORS is disabled if this environment variable is not set.
Existing usage to employ ``@rawhttp`` as a way to specify CORS header is not affected, and can be used if you need more
granular control of CORS (such as the need to specify other CORS headers). See `here
<https://docs.microsoft.com/en-us/azure/machine-learning/how-to-deploy-advanced-entry-script#cross-origin-resource-sharing-cors>`__
for an example.
Loading server config from a json file
======================================
Server supports the loading of the config using a json file.
Config file can be specified using:
1. The env variable ``AZUREML_CONFIG_FILE`` (the absolute path to the json configuration file).
2. CLI parameter --config_file.
Note:
1. All the paths mentioned in the config.json (configuration file) should be absolute path.
2. Priority: CLI > ENV Variable > config file
config.json will be searched in below locations by default if config file is not provided explicitly using env variable/CLI paramter:
1. AML_APP_ROOT directory
2. Directory containing the scoring script
Config file will support only below keys:
* AML_APP_ROOT
* AZUREML_SOURCE_DIRECTORY
* AZUREML_ENTRY_SCRIPT
* SERVICE_NAME
* WORKSPACE_NAME
* SERVICE_PATH_PREFIX
* SERVICE_VERSION
* SCORING_TIMEOUT_MS
* AML_FLASK_ONE_COMPATIBILITY
* AZUREML_LOG_LEVEL
* AML_APP_INSIGHTS_ENABLED
* AML_APP_INSIGHTS_KEY
* AML_MODEL_DC_STORAGE_ENABLED
* APP_INSIGHTS_LOG_RESPONSE_ENABLED
* AML_CORS_ORIGINS
* AZUREML_MODEL_DIR
* HOSTNAME
* AZUREML_DEBUG_PORT
Sample config.json:
| {
| "AZUREML_ENTRY_SCRIPT": "/mnt/d/tests/manual/default_score.py"
| "AML_CORS_ORIGINS": "www.microsoft.com ",
| "SCORING_TIMEOUT_MS": 6000,
| "AML_APP_INSIGHTS_ENABLED": true
| }
Changelog
=========
0.8.4 (2023-04-19)
~~~~~~~~~~~~~~~~~~
Features
--------
- Added ability to configure seperate dedicated health check port.
Fixes
-----
- Restored streaming for score response.
- Updated the error message related to scoring script not found.
0.8.3 (2023-03-23)
~~~~~~~~~~~~~~~~~~
Fixes
-----
- Fixed the issue related to compatibility with flask1.
0.8.2 (2023-03-20)
~~~~~~~~~~~~~~~~~~
Enhancements
------------
- Warning message will be logged if there are extra keys in the config file which are not supported by the server.
0.8.1 (2023-03-06)
~~~~~~~~~~~~~~~~~~
Features
--------
- Supports loading server config from a json file.
Added support for a new env variable ``AZUREML_CONFIG_FILE``. Refer to README for detailed usage.
Enhancements
------------
- Exception details will not be returned in the HTTP response. Check the server logs for details.
0.8.0 (2022-12-15)
~~~~~~~~~~~~~~~~~~
Breaking Changes
----------------
- Drop support for Python 3.6
Enhancements
------------
- All error responses will be in json. (Format: {'message': <error_message>})
- Loggers can be configured by users through a logging.json file in
`AML_APP_ROOT` or alongside the entry script.
Log message default format has been updated. (Format: "<UTC DATE> <UTC TIME>
<LOG LEVEL CHAR> [<PID>] <LOGGER NAME> - <MESSAGE>")
0.7.7 (2022-11-01)
~~~~~~~~~~~~~~~~~~
Fixes
-----
- Upgrade ``inference-schema`` dependency to support Python 3.9
0.7.6 (2022-09-13)
~~~~~~~~~~~~~~~~~~
Fixes
-----
- ``AML_APP_ROOT`` variable is now defaulted to the current working directory
- ``AZUREML_ENTRY_SCRIPT`` is now set to an absolute path to the entry script
0.7.5 (2022-08-16)
~~~~~~~~~~~~~~~~~~
Breaking Changes
----------------
- The header for Client Request ID is renamed from ``x-client-request-id`` to ``x-ms-client-request-id``.
- Server will no longer throw an error when both ``x-ms-request-id`` and ``x-request-id`` are provided. Going forward,
``x-ms-request-id`` will be treated as the Client Request ID. However, it is still considered deprecated and users
are recommended to use ``x-ms-client-request-id`` for Client Request ID.
- When neither ``x-ms-request-id`` or ``x-ms-client-request-id`` is set, the server copies the value of
``x-request-id`` to ``x-ms-request-id``. This is done to preserve backwards compatability, ensuring that
``x-ms-request-id`` is not empty. No value is logged to AppInsights as "Client Request Id".
- When only ``x-ms-request-id`` is set, the server returns ``x-ms-request-id`` and ``x-ms-client-request-id`` set to the
value. This value is logged to AppInsights as "Client Request Id".
- When only ``x-ms-client-request-id`` is set, the server returns ``x-ms-request-id`` and ``x-ms-client-request-id``
set to the value. This value is logged to AppInsights as "Client Request Id".
- When both ``x-ms-request-id`` and ``x-ms-client-request-id`` are set, the values are returned in the respective
headers. However, only the value from ``x-ms-client-request-id`` is logged to AppInsights as "Client Request Id".
0.7.4 (2022-07-29)
~~~~~~~~~~~~~~~~~~
Fixes
-----
- Fix an issue where the server would require arguments that have default values in run().
0.7.3 (2022-07-18)
~~~~~~~~~~~~~~~~~~
Features
--------
- CORS can be enabled with the environment variable ``AML_CORS_ORIGINS``. Refer to README for detailed usage.
- Server can now be started with ``python -m azureml_inference_server_http`` in additional to ``azmlinfsrv``.
- OPTIONS calls are modified to return ``200 OK`` instead of the previous ``405 Method not allowed``.
- Users can bring their own swaggers by placing ``swagger2.json`` and ``swagger3.json`` in ``AML_APP_ROOT``.
Enhancements
------------
- Swaggers are always generated now, regardless whether the user's run() function is decorated with inference-schema.
- The x-request-id and x-client-request-id headers are now limited to 100 characters.
Fixes
-----
- Fixed an issue that prevents the server from cleanly exiting when the scoring script cannot be initialized. If
AppInsights is not enabled, users may see ``AttributeError: 'AppInsightsClient' object has no attribute 'logger'``.
0.7.2 (2022-06-06)
~~~~~~~~~~~~~~~~~~
Enhancements
------------
- Added support for Flask 2.1.
- The server now responds with a 400 Bad Request when it finds invalid inputs.
0.7.1 (2022-05-10)
~~~~~~~~~~~~~~~~~~
Deprecation
-----------
- The "x-ms-request-id" header is deprecated and is being replaced by "x-request-id". Until "x-ms-request-id" is
removed, the server will accept either header and respond with both headers set to the same request id. Providing two
request ids through the headers is not allowed and will be responded with a Bad Request.
Enhancements
------------
- Added support for Flask 2.0. A compatibility layer is introduced to ensure this upgrade doesn't break users who use
``@rawhttp`` as the methods on the Flask request object have slightly changed. Specifically,
* ``request.headers.has_keys()`` was removed
* ``request.json`` throws an exception if the content-type is not "application/json". Previously it returns ``None``.
The compatibility layer restores these functionalities to their previous behaviors. However, this compatibility layer
will be removed in a future date and users are encouraged to audit their score scripts today. To see if your score
script is ready for Flask 2, run the server with the environment variable ``AML_FLASK_ONE_COMPATIBILITY`` set to
``false``.
Flask's full changelog can be found here: https://flask.palletsprojects.com/en/2.1.x/changes/
- Added support for the "x-request-id" and "x-client-request-id" headers. A new GUID is generated for "x-request-id" if
one is not provided. These values are echoed back to the client in the response headers.
نیازمندی
| مقدار | نام |
|---|---|
| <2.3.0 | flask |
| ~=3.0.1 | flask-cors |
| ~=1.5.0 | inference-schema |
| ~=1.1.0 | opencensus-ext-azure |
| <1.11,>=1.9 | pydantic |
| ==20.1.0 | gunicorn |
| <6.0.0 | psutil |
| ==2.1.2 | waitress |
| ~=3.7.4.post0 | aiohttp |
| ~=0.6.1 | aiotask-context |
| ~=1.38.1 | grpcio-tools |
| ~=3.20 | protobuf |
| ~=21.6.0 | sanic |
| ~=1.0.1 | sanic-cors |
| ~=2.11.0 | tritonclient[all] |
| ~=3.7.4.post0 | aiohttp |
| ~=0.6.1 | aiotask-context |
| ~=1.38.1 | grpcio-tools |
| ~=3.20 | protobuf |
| ~=21.6.0 | sanic |
| ~=1.0.1 | sanic-cors |
| ~=2.11.0 | tritonclient[all] |
| - | azure-monitor-query |
| - | black |
| ==6.2 | coverage |
| - | debugpy |
| - | flake8 |
| - | flake8-comprehensions |
| - | flake8-import-order |
| ==2.0.0 | junitparser |
| - | numpy |
| - | pandas |
| - | pre-commit |
| - | pytest |
| - | pytest-asyncio |
| - | pytest-benchmark |
| - | pytest-cov |
| ~=9.0.1 | Pillow |
| - | requests |
| <=22.6.0 | sanic-testing |
| ==21.9.0 | towncrier |
| - | wheel |
زبان مورد نیاز
| مقدار | نام |
|---|---|
| >=3.7 | Python |
نحوه نصب
نصب پکیج whl azureml-inference-server-http-0.8.4:
pip install azureml-inference-server-http-0.8.4.whl
نصب پکیج tar.gz azureml-inference-server-http-0.8.4:
pip install azureml-inference-server-http-0.8.4.tar.gz