معرفی شرکت ها
arize-7.0.1rc0
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشترتوضیحات
A helper library to interact with Arize AI APIs
| ویژگی | مقدار |
|---|---|
| سیستم عامل | - |
| نام فایل | arize-7.0.1rc0 |
| نام | arize |
| نسخه کتابخانه | 7.0.1rc0 |
| نگهدارنده | [] |
| ایمیل نگهدارنده | [] |
| نویسنده | Arize AI |
| ایمیل نویسنده | support@arize.com |
| آدرس صفحه اصلی | - |
| آدرس اینترنتی | https://pypi.org/project/arize/ |
| مجوز | BSD |
<div align="center">
<img src="https://storage.googleapis.com/arize-assets/arize-logo-white.jpg" width="600" /><br><br>
</div>
[](https://badge.fury.io/py/arize)
[](https://join.slack.com/t/arize-ai/shared_invite/zt-g9c1j1xs-aQEwOAkU4T2x5K8cqI1Xqg)
---
## Overview
A helper library to interact with Arize AI APIs.
Arize is an end-to-end ML observability and model monitoring platform. The platform is designed to help ML engineers and data science practitioners surface and fix issues with ML models in production faster with:
- Automated ML monitoring and model monitoring
- Workflows to troubleshoot model performance
- Real-time visualizations for model performance monitoring, data quality monitoring, and drift monitoring
- Model prediction cohort analysis
- Pre-deployment model validation
- Integrated model explainability
---
## Quickstart
This guide will help you instrument your code to log observability data for model monitoring and ML observability. The types of data supported include prediction labels, human readable/debuggable model features and tags, actual labels (once the ground truth is learned), and other model-related data. Logging model data allows you to generate powerful visualizations in the Arize platform to better monitor model performance, understand issues that arise, and debug your model's behavior. Additionally, Arize provides data quality monitoring, data drift detection, and performance management of your production models.
Start logging your model data with the following steps:
### 1. Create your account
Sign up for a free account [HERE](https://app.arize.com/auth/join).
<div align="center">
<img src="https://storage.googleapis.com/arize-assets/Arize%20UI%20platform.jpg" /><br><br>
</div>
### 2. Get your service API key
When you create an account, we generate a service API key. You will need this API Key and your Space Key for logging authentication.
### 3. Instrument your code
### Python Client
If you are using the Arize python client, add a few lines to your code to log predictions and actuals. Logs are sent to Arize asynchronously.
### Install Library
Install the Arize library in an environment using Python >= 3.6.
```sh
$ pip3 install arize
```
Or clone the repo:
```sh
$ git clone https://github.com/Arize-ai/client_python.git
$ python3 -m pip install client_python/
```
### Initialize Python Client
Initialize the arize client at the start of your service using your previously created API and Space Keys.
> **_NOTE:_** We strongly suggest storing the API key as a secret or an environment variable.
```python
from arize.api import Client
from arize.utils.types import ModelTypes, Environments
API_KEY = os.environ.get('ARIZE_API_KEY') #If passing api_key via env vars
arize_client = Client(space_key='ARIZE_SPACE_KEY', api_key=API_KEY)
```
### Collect your model input features and labels you'd like to track
#### Real-time single prediction:
For a single real-time prediction, you can track all input features used at prediction time by logging them via a key:value dictionary.
```python
features = {
'state': 'ca',
'city': 'berkeley',
'merchant_name': 'Peets Coffee',
'pos_approved': True,
'item_count': 10,
'merchant_type': 'coffee shop',
'charge_amount': 20.11,
}
```
#### Bulk predictions:
When dealing with bulk predictions, you can pass in input features, prediction/actual labels, and prediction_ids for more than one prediction via a Pandas Dataframe where df.columns contain feature names.
```python
## e.g. labels from a CSV. Labels must be 2-D data frames where df.columns correspond to the label name
features_df = pd.read_csv('path/to/file.csv')
prediction_labels_df = pd.DataFrame(np.random.randint(1, 100, size=(features.shape[0], 1)))
ids_df = pd.DataFrame([str(uuid.uuid4()) for _ in range(len(prediction_labels.index))])
```
### Log Predictions
#### Single real-time prediction:
```python
## Returns an array of concurrent.futures.Future
pred = arize.log(
model_id='sample-model-1',
model_version='v1.23.64',
model_type=ModelTypes.BINARY,
prediction_id='plED4eERDCasd9797ca34',
prediction_label=True,
features=features,
)
#### To confirm that the log request completed successfully, await for it to resolve:
## NB: This is a blocking call
response = pred.get()
res = response.result()
if res.status_code != 200:
print(f'future failed with response code {res.status_code}, {res.text}')
```
#### Bulk upload of predictions:
```python
responses = arize.bulk_log(
model_id='sample-model-1',
model_version='v1.23.64',
model_type=ModelTypes.BINARY,
prediction_ids=ids_df,
prediction_labels=prediction_labels_df,
features=features_df
)
#### To confirm that the log request completed successfully, await for futures to resolve:
## NB: This is a blocking call
import concurrent.futures as cf
for response in cf.as_completed(responses):
res = response.result()
if res.status_code != 200:
print(f'future failed with response code {res.status_code}, {res.text}')
```
The client's log_prediction/actual function returns a single concurrent future while log_bulk_predictions/actuals returns a list of concurrent futures for asynchronous behavior. To capture the logging response, you can await the resolved futures. If you desire a fire-and-forget pattern, you can disregard the responses altogether.
We automatically discover new models logged over time based on the model ID sent on each prediction.
### Logging Actual Labels
> **_NOTE:_** Notice the prediction_id passed in matches the original prediction sent on the previous example above.
```python
response = arize.log(
model_id='sample-model-1',
model_type=ModelTypes.BINARY,
prediction_id='plED4eERDCasd9797ca34',
actual_label=False
)
```
#### Bulk upload of actuals:
```python
responses = arize.bulk_log(
model_id='sample-model-1',
model_type=ModelTypes.BINARY,
prediction_ids=ids_df,
actual_labels=actual_labels_df,
)
#### To confirm that the log request completed successfully, await for futures to resolve:
## NB: This is a blocking call
import concurrent.futures as cf
for response in cf.as_completed(responses):
res = response.result()
if res.status_code != 200:
print(f'future failed with response code {res.status_code}, {res.text}')
```
Once the actual labels (ground truth) for your predictions have been determined, you can send them to Arize and evaluate your metrics over time. The prediction id for one prediction links to its corresponding actual label so it's important to note those must be the same when matching events.
### Bulk upload of all your data (features, predictions, actuals, SHAP values) in a pandas.DataFrame
Use arize.pandas.logger to publish a dataframe with the features, predicted label, actual, and/or SHAP to Arize for monitoring, analysis, and explainability.
#### Initialize Arize Client from `arize.pandas.logger`
```python
from arize.pandas.logger import Client, Schema
from arize.utils.types import ModelTypes, Environments
API_KEY = os.environ.get('ARIZE_API_KEY') #If passing api_key via env vars
arize_client = Client(space_key='ARIZE_SPACE_KEY', api_key=API_KEY)
```
#### Logging features & predictions only, then actuals
```python
response = arize_client.log(
dataframe=your_sample_df,
model_id="fraud-model",
model_version="1.0",
model_type=ModelTypes.SCORE_CATEGORICAL,
environment=Environments.PRODUCTION,
schema = Schema(
prediction_id_column_name="prediction_id",
timestamp_column_name="prediction_ts",
prediction_label_column_name="prediction_label",
prediction_score_column_name="prediction_score",
feature_column_names=feature_cols,
)
)
response = arize_client.log(
dataframe=your_sample_df,
model_id=model_id,
model_type=ModelTypes.SCORE_CATEGORICAL,
environment=Environments.PRODUCTION,
schema = Schema(
prediction_id_column_name="prediction_id",
actual_label_column_name="actual_label",
)
)
```
#### Logging features, predictions, actuals, and SHAP values together
```python
response = arize_client.log(
dataframe=your_sample_df,
model_id="fraud-model",
model_version="1.0",
model_type=ModelTypes.NUMERIC,
environment=Environments.PRODUCTION,
schema = Schema(
prediction_id_column_name="prediction_id",
timestamp_column_name="prediction_ts",
prediction_label_column_name="prediction_label",
actual_label_column_name="actual_label",
feature_column_names=feature_col_name,
shap_values_column_names=dict(zip(feature_col_name, shap_col_name))
)
)
```
### 4. Log In for Analytics
That's it! Once your service is deployed and predictions are logged you'll be able to log into your Arize account and dive into your data, slicing it by features, tags, models, time, etc.
#### Analytics Dashboard
<div align="center">
<img src="https://storage.googleapis.com/arize-assets/Arize%20UI%20platform.jpg" /><br><br>
</div>
---
### Logging SHAP values
Log feature importance in SHAP values to the Arize platform to explain your model's predictions. By logging SHAP values you gain the ability to view the global feature importances of your predictions as well as the ability to perform cohort and prediction based analysis to compare feature importance values under varying conditions. For more information on SHAP and how to use SHAP with Arize, check out our [SHAP documentation](https://docs.arize.com/arize/product-guides/explainability).
---
### Other languages
If you are using a different language, you'll be able to post an HTTP request to our Arize edge-servers to log your events.
### HTTP post request to Arize
```bash
curl -X POST -H "Authorization: YOU_API_KEY" "https://log.arize.com/v1/log" -d'{"space_key": "YOUR_SPACE_KEY", "model_id": "test_model_1", "prediction_id":"test100", "prediction":{"model_version": "v1.23.64", "features":{"state":{"string": "CO"}, "item_count":{"int": 10}, "charge_amt":{"float": 12.34}, "physical_card":{"string": true}}, "prediction_label": {"binary": false}}}'
```
---
### Website
Visit Us At: https://arize.com/model-monitoring/
Official Documentations: https://docs.arize.com/arize/
### Additional Resources
- [What is ML observability?](https://arize.com/what-is-ml-observability/)
- [Playbook to model monitoring in production](https://arize.com/the-playbook-to-monitor-your-models-performance-in-production/)
- [Using statistical distance metrics for ML monitoring and observability](https://arize.com/using-statistical-distance-metrics-for-machine-learning-observability/)
- [ML infrastructure tools for data preparation](https://arize.com/ml-infrastructure-tools-for-data-preparation/)
- [ML infrastructure tools for model building](https://arize.com/ml-infrastructure-tools-for-model-building/)
- [ML infrastructure tools for production](https://arize.com/ml-infrastructure-tools-for-production-part-1/)
- [ML infrastructure tools for model deployment and model serving](https://arize.com/ml-infrastructure-tools-for-production-part-2-model-deployment-and-serving/)
- [ML infrastructure tools for ML monitoring and observability](https://arize.com/ml-infrastructure-tools-ml-observability/)
Visit the [Arize Blog](https://arize.com/blog) and [Resource Center](https://arize.com/resource-hub/) for more resources on ML observability and model monitoring.
نیازمندی
| مقدار | نام |
|---|---|
| ==1.0.0 | requests-futures |
| ~=1.51 | googleapis-common-protos |
| ~=3.12 | protobuf |
| <2,>=0.25.3 | pandas |
| >=5.0.0 | pyarrow |
| <5,>=4.25 | transformers |
| <1,>=0.13 | tokenizers |
| <3,>=2.8 | datasets |
| <3,>=1.13 | torch |
| <10,>=8.4.0 | Pillow |
| <4,>=3.0.0 | nltk |
| <3,>=2.3.1 | sacrebleu |
| <1,>=0.1.2 | rouge-score |
| <1,>=0.3 | evaluate |
| <1.24.0 | numpy |
| <2,>=0.12.0 | scikit-learn |
| <1,>=0.2.7 | interpret |
| <1,>=0.22.0 | interpret-community |
| <3.3.4,>=2.2.3 | lightgbm |
زبان مورد نیاز
| مقدار | نام |
|---|---|
| >=3.8 | Python |
نحوه نصب
نصب پکیج whl arize-7.0.1rc0:
pip install arize-7.0.1rc0.whl
نصب پکیج tar.gz arize-7.0.1rc0:
pip install arize-7.0.1rc0.tar.gz