معرفی شرکت ها
airflow-provider-fivetran-async-1.0.0a5
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشترتوضیحات
A Fivetran async provider for Apache Airflow
| ویژگی | مقدار |
|---|---|
| سیستم عامل | - |
| نام فایل | airflow-provider-fivetran-async-1.0.0a5 |
| نام | airflow-provider-fivetran-async |
| نسخه کتابخانه | 1.0.0a5 |
| نگهدارنده | [] |
| ایمیل نگهدارنده | [] |
| نویسنده | Astronomer & Fivetran |
| ایمیل نویسنده | humans@astronomer.io |
| آدرس صفحه اصلی | https://github.com/astronomer/airflow-provider-fivetran-async |
| آدرس اینترنتی | https://pypi.org/project/airflow-provider-fivetran-async/ |
| مجوز | Apache License 2.0 |
# Fivetran Async Provider for Apache Airflow
This package provides an async operator, sensor and hook that integrates [Fivetran](https://fivetran.com) into Apache Airflow.
`FivetranSensorAsync` allows you to monitor a Fivetran sync job for completion before running downstream processes.
`FivetranOperatorAsync` submits a Fivetran sync job and polls for its status on the triggerer.
Since an async sensor or operator frees up worker slot while polling is happening on the triggerer,
they consume less resources when compared to traditional "sync" sensors and operators.
[Fivetran automates your data pipeline, and Airflow automates your data processing.](https://www.youtube.com/watch?v=siSx6L2ckSw&ab_channel=Fivetran)
## Installation
Prerequisites: An environment running `apache-airflow`.
```
pip install airflow-provider-fivetran-async
```
## Configuration
In the Airflow user interface, configure a Connection for Fivetran. Most of the Connection config fields will be left blank. Configure the following fields:
* `Conn Id`: `fivetran`
* `Conn Type`: `Fivetran`
* `Login`: Fivetran API Key
* `Password`: Fivetran API Secret
Find the Fivetran API Key and Secret in the [Fivetran Account Settings](https://fivetran.com/account/settings), under the **API Config** section. See our documentation for more information on [Fivetran API Authentication](https://fivetran.com/docs/rest-api/getting-started#authentication).
The sensor assumes the `Conn Id` is set to `fivetran`, however if you are managing multiple Fivetran accounts, you can set this to anything you like. See the DAG in examples to see how to specify a custom `Conn Id`.
## Modules
### [Fivetran Operator Async](https://github.com/astronomer/airflow-provider-fivetran-async/tree/main/fivetran_provider_async/operators.py)
`FivetranOperatorAsync` submits a Fivetran sync job and monitors it on trigger for completion.
It requires that you specify the `connector_id` of the sync job to start. You can find `connector_id` in the Settings page of the connector you configured in the [Fivetran dashboard](https://fivetran.com/dashboard/connectors).
Import into your DAG via:
```python
from fivetran_provider_async.operators import FivetranOperatorAsync
```
### [Fivetran Sensor Async](https://github.com/astronomer/airflow-provider-fivetran-async/tree/main/fivetran_provider_async/sensors.py)
`FivetranSensorAsync` monitors a Fivetran sync job for completion.
Monitoring with `FivetranSensorAsync` allows you to trigger downstream processes only when the Fivetran sync jobs have completed, ensuring data consistency.
You can use multiple instances of `FivetranSensorAsync` to monitor multiple Fivetran connectors.
If used in this way,
`FivetranSensorAsync` requires that you specify the `connector_id` of the sync job to start. You can find `connector_id` in the Settings page of the connector you configured in the [Fivetran dashboard](https://fivetran.com/dashboard/connectors).
Import into your DAG via:
```python
from fivetran_provider_async.sensors import FivetranSensorAsync
```
## Examples
See the [**examples**](https://github.com/astronomer/airflow-provider-fivetran-async/tree/main/fivetran_provider_async/example_dags) directory for an example DAG.
## Issues
Please submit [issues](https://github.com/astronomer/airflow-provider-fivetran-async/issues) and [pull requests](https://github.com/astronomer/airflow-provider-fivetran-async/pulls) in our official repo:
[https://github.com/astronomer/airflow-provider-fivetran-async](https://github.com/astronomer/airflow-provider-fivetran-async)
We are happy to hear from you. Please email any feedback to the authors at [humans@astronomer.io](mailto:humans@astronomer.io).
نیازمندی
| مقدار | نام |
|---|---|
| >=2.2.0 | apache-airflow |
| - | aiohttp |
| - | asgiref |
| - | airflow-provider-fivetran |
| >=0.19.2 | openlineage-airflow |
| >=0.19.2 | openlineage-airflow |
| - | parameterized |
| - | pytest |
| - | pytest-asyncio |
| - | pytest-cov |
| - | requests-mock |
زبان مورد نیاز
| مقدار | نام |
|---|---|
| >=3.8 | Python |
نحوه نصب
نصب پکیج whl airflow-provider-fivetran-async-1.0.0a5:
pip install airflow-provider-fivetran-async-1.0.0a5.whl
نصب پکیج tar.gz airflow-provider-fivetran-async-1.0.0a5:
pip install airflow-provider-fivetran-async-1.0.0a5.tar.gz