معرفی شرکت ها
bigflow-1.4.2rc6
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشترتوضیحات
BigQuery client wrapper with clean API
| ویژگی | مقدار |
|---|---|
| سیستم عامل | OS Independent |
| نام فایل | bigflow-1.4.2rc6 |
| نام | bigflow |
| نسخه کتابخانه | 1.4.2rc6 |
| نگهدارنده | [] |
| ایمیل نگهدارنده | [] |
| نویسنده | Chi |
| ایمیل نویسنده | chibox-team@allegrogroup.com |
| آدرس صفحه اصلی | https://github.com/allegro/bigflow |
| آدرس اینترنتی | https://pypi.org/project/bigflow/ |
| مجوز | - |
# BigFlow
## Documentation
1. [What is BigFlow?](#what-is-bigflow)
1. [Getting started](#getting-started)
1. [Installing Bigflow](#installing-bigflow)
1. [Help me](#help-me)
1. [BigFlow tutorial](docs/tutorial.md)
1. [CLI](docs/cli.md)
1. [Configuration](./docs/configuration.md)
1. [Project structure and build](./docs/project_structure_and_build.md)
1. [Deployment](docs/deployment.md)
1. [Workflow & Job](./docs/workflow-and-job.md)
1. [Starter](./docs/scaffold.md)
1. [Technologies](./docs/technologies.md)
1. [Development](./docs/development.md)
## Cookbook
* [Monitoring](./docs/monitoring.md)
* [Automated end-to-end testing](./docs/e2e_testing.md)
* [Dockerized, GPU based ML prediction process](./docs/ml-prediction.md)
## What is BigFlow?
BigFlow is a Python framework for data processing pipelines on [GCP](https://cloud.google.com/).
The main features are:
* [Dockerized deployment environment](./docs/project_structure_and_build.md#overview)
* [Powerful CLI](./docs/cli.md)
* [Automated build](./docs/project_structure_and_build.md#overview), [deployment](./docs/deployment.md),
[versioning](./docs/project_structure_and_build.md#project-versioning) and [configuration](./docs/configuration.md)
* [Unified project structure](./docs/project_structure_and_build.md#project-structure)
* [Support for GCP data processing technologies](./docs/technologies.md) — [Dataflow](https://beam.apache.org/) (Apache Beam) and [BigQuery](https://cloud.google.com/bigquery)
* [Project starter](./docs/scaffold.md)
## Getting started
Start from installing BigFlow on your local machine.
Next, go through the BigFlow [tutorial](./docs/tutorial.md).
## Installing BigFlow
**Prerequisites**. Before you start, make sure you have the following software installed:
1. [Python](https://www.python.org/downloads/) == 3.7
2. [Google Cloud SDK](https://cloud.google.com/sdk/docs/downloads-interactive)
3. [Docker Engine](https://docs.docker.com/engine/install/)
You can install the `bigflow` package globally, but we recommend
installing it locally with `venv`, in your project's folder:
```bash
python -m venv .bigflow_env
source .bigflow_env/bin/activate
```
Install the `bigflow` PIP package:
```bash
pip install bigflow[bigquery,dataflow]
```
Test it:
```shell
bigflow -h
```
Read more about [BigFlow CLI](docs/cli.md).
To interact with GCP you need to set a default project and log in:
```shell script
gcloud config set project <your-gcp-project-id>
gcloud auth application-default login
```
Finally, check if your Docker is running:
```shell script
docker info
```
## Help me
You can ask questions on our [gitter channel](https://gitter.im/allegro/bigflow) or [stackoverflow](https://stackoverflow.com/questions/tagged/bigflow).
نیازمندی
| مقدار | نام |
|---|---|
| <2,>=1.30 | google-cloud-storage |
| <2.1.0 | MarkupSafe |
| <3,>=1.20 | google-auth |
| <4,>=3.0.2 | unittest-xml-reporting |
| <3,>=2.10 | jinja2 |
| <7,>=5.3 | pip-tools |
| <2,>=1.2.10 | deprecated |
| >=0.10 | toml |
| <2,>=1.7 | tblib |
| <2,>=1 | lazy-object-proxy |
| >=0.35 | wheel |
| >=45 | setuptools |
| ~=3.7 | typing-extensions |
| - | backports.cached-property |
| ==5.0.0 | cachetools |
| ==2021.10.8 | certifi |
| ==2.0.12 | charset-normalizer |
| ==8.0.4 | click |
| ==1.2.13 | deprecated |
| ==2.7.1 | google-api-core |
| ==2.6.2 | google-auth |
| ==2.2.3 | google-cloud-core |
| ==1.44.0 | google-cloud-storage |
| ==1.3.0 | google-crc32c |
| ==2.3.2 | google-resumable-media |
| ==1.56.0 | googleapis-common-protos |
| ==3.3 | idna |
| ==4.11.3 | importlib-metadata |
| ==2.11.3 | jinja2 |
| ==1.7.1 | lazy-object-proxy |
| ==4.8.0 | lxml |
| ==2.0.1 | markupsafe |
| ==0.12.0 | pep517 |
| ==6.5.1 | pip-tools |
| ==3.19.4 | protobuf |
| ==0.4.8 | pyasn1 |
| ==0.2.8 | pyasn1-modules |
| ==2.27.1 | requests |
| ==4.8 | rsa |
| ==1.16.0 | six |
| ==1.7.0 | tblib |
| ==0.10.2 | toml |
| ==2.0.1 | tomli |
| ==3.2.0 | unittest-xml-reporting |
| ==1.26.9 | urllib3 |
| ==0.37.1 | wheel |
| ==1.14.0 | wrapt |
| ==3.7.0 | zipp |
| ==3.10.0.2 | typing-extensions |
| ==1.0.1 | backports-cached-property |
| <2,>=1.6 | google-cloud-bigquery |
| <2,>=0.25 | pandas |
| <2,>=1.14 | six |
| <2.37,>=2.24 | apache-beam[gcp] |
| <4,>=3 | google-cloud-dataproc |
| <4,>=3.0 | pyspark |
| !=1.19.7 | proto-plus |
| <2,>=1.15 | google-cloud-logging |
نحوه نصب
نصب پکیج whl bigflow-1.4.2rc6:
pip install bigflow-1.4.2rc6.whl
نصب پکیج tar.gz bigflow-1.4.2rc6:
pip install bigflow-1.4.2rc6.tar.gz