معرفی شرکت ها
dsw2to3-1.0.2
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشترتوضیحات
CLI tool to support migration from DSW 2.14 to DSW 3.0
| ویژگی | مقدار |
|---|---|
| سیستم عامل | - |
| نام فایل | dsw2to3-1.0.2 |
| نام | dsw2to3 |
| نسخه کتابخانه | 1.0.2 |
| نگهدارنده | [] |
| ایمیل نگهدارنده | [] |
| نویسنده | Marek Suchánek |
| ایمیل نویسنده | - |
| آدرس صفحه اصلی | https://github.com/ds-wizard/dsw2to3 |
| آدرس اینترنتی | https://pypi.org/project/dsw2to3/ |
| مجوز | Apache License 2.0 |
# dsw2to3
[](https://github.com/ds-wizard/dsw2to3/releases)
[](https://pypi.org/project/dsw2to3/)
[](LICENSE)
[](https://docs.ds-wizard.org/en/latest/)
CLI tool to support data migration from DSW 2.14 to DSW 3.0
## Usage
### Prerequisites
* DSW 3.0
* MongoDB (with DSW 2.14 data)
* PostgreSQL (with initial DSW 3.0 structure)
* S3 storage (e.g. [Minio](https://min.io))
* Python 3.6+ (recommended to use [virtual environment](https://docs.python.org/3/library/venv.html))
* `postgresql-devel` (`libpq-dev` in Debian/Ubuntu, `libpq-devel` on others)
The machine where you are going to execute the migration tool must have access to MongoDB, PostgreSQL, and S3 storage. See `examples/docker-compose.yml` for reference.
You need to run DSW 3.0 at least once before the data migration, so it initializes your PostgreSQL database (it will create tables and initial data). You can try to log-in with the default user to check if it is initialized correctly.
Don't hesitate to consult with us if unclear.
### Installation
You can install the tool using PyPI:
```shell
$ python -m venv env
$ . env/bin/activate
(env) $ pip install wheel
(env) $ pip install dsw2to3
...
(env) $ dsw2to3 --help
```
Or using this repository:
```shell
$ git clone https://github.com/ds-wizard/dsw2to3.git
$ python -m venv env
$ . env/bin/activate
(env) $ pip install wheel
(env) $ pip install .
...
(env) $ dsw2to3 --help
```
### Important notes
- Migration tool must have access to MongoDB database (data source), PostgreSQL database and S3 storage (target). It needs to be configured in `config.yml`. During the migration (e.g. from DSW or other tool), the data must not change to avoid inconsistency.
- Migration tool does not make any changes in MongoDB, it only reads data from there.
- Migration tool checks if target PostgreSQL database is in expected state (after fresh installation of DSW 3.0).
- Migration tool initially deletes all data from PostgreSQL database before migrating to avoid duplication and inconsistency (for regular use it just removes the default data, e.g., default users).
- Migration tool initially deletes all objects in configured S3 bucket. If the bucket does not exist, it tries to create a new one.
- Migration tool migrates data from MongoDB to PostgreSQL in expected way for DSW as well as from MongoDB (GridFS) to S3 storage.
- You can run the tool with `--dry-run` to check what it will do. During dry run, nothing is deleted, changed, or added (no SQL transactions are committed).
- It may happen that your MongoDB database contains inconsistent data (violating integrity). With `--fix-integrity` you can fix that by skipping data. You should first check what the data are, and then decide if you will fix it manually in MongoDB or migrate without them.
- This tool may improve based on feedback, check new version and update using `pip install -U dsw2to3` if needed.
### Steps
1. Prepare `config.yml` for the migration based on your setup (see `config.example.yml`)
2. Stop DSW in order to prevent changes in data during the migration
3. Archive data from MongoDB (e.g. using [mongodump](https://docs.mongodb.com/manual/reference/program/mongodump/))
4. Run `dsw2to3 -c path/to/config.yml --dry-run` to see how it will work with your configuration
5. Run `dsw2to3 -c path/to/config.yml` (see `dsw2to3 --help` for more options)
6. After migration, run DSW 3.0 and check the migrated data
7. Clean up your deployment (get rid of unused services and configuration files)
In case of error during the migration, follow the details from logs. You can run it with `--best-effort` flag that will skip errors (just log them out).
## Questions and Discussion
If anything is unclear, or you need help, let us know via issue in this repository.
## License
This project is licensed under the Apache License v2.0 - see the [LICENSE](LICENSE) file for more details.
زبان مورد نیاز
| مقدار | نام |
|---|---|
| >=3.6, <4 | Python |
نحوه نصب
نصب پکیج whl dsw2to3-1.0.2:
pip install dsw2to3-1.0.2.whl
نصب پکیج tar.gz dsw2to3-1.0.2:
pip install dsw2to3-1.0.2.tar.gz