# Getting Started
`edb-pot` tool is an easy way to provision Cloud resources and deploy
PostgreSQL, EDB Postgres Advanced Server and tools (high availability and monitoring)
for Proof Of Technology.
Supported Cloud providers are **AWS**, **Azure** and **Google Cloud**.
`edb-pot` helps user to deploy custom Postgres Reference Architectures tailored for showing functionalities of EDB Tech.
`edb-pot` is an open source tool and is not officially supported by EDB
Support. It is maintained and supported by the GitHub members of this
repository. Please provide feedback by posting issues and providing pull
requests.
Before starting to delve into this repository, it is best to get familiar with
the steps in the deployment process of a specific cloud (AWS, Azure and Google
Cloud).
# Pre-Requisites
`edb-pot` is dependent on following components. Install the following
components before using it.
1. Python 3
2. `pip3`
Third party pre-requisites:
1. **Latest vendor** Cloud CLI or SDK ( AWS, Azure or Google Cloud )
Depending on the cloud provider, install the **latest version** for: AWS
CLI, Azure CLI or Google Cloud SDK on the system.
2. **Terraform** >= 0.13
3. **Ansible** >= 2.9
To help the installation of the third party pre-requisites listed above,
`edb-pot` provides installation scripts for Linux (x64) and MacOS (x64).
Please refer to section [Pre-Requisites installation scripts](#pre-requisites-installation-scripts).
# Installation
## From source code
Installation is done using the `pip3` command. Once the code has been
downloaded, either by cloning the repository or downloading a release, go to
the created folder and run the command `pip3 install`:
```shell
$ cd postgres-deployment
$ sudo pip3 install . --upgrade
```
## From Pypi
```shell
$ sudo pip3 install edb-pot
```
Make sure the tool is well installed by running the command:
```shell
$ edb-pot --version
```
## Shell auto-completion
`edb-pot` supports command line auto-completion with the `tab` key.
Supported shells are `bash` ans `zsh`.
To enable auto-completion in current session, the following command must be
ran:
```shell
$ eval "$(register-python-argcomplete edb-pot)"
```
To enable auto-completion for all the sessions, the command above must be added
at the end of your `~/.bashrc` file or `~/.zshrc` file, depending on the shell
you use.
## Pre-Requisites installation scripts
To ease installation of the third party pre-requisites tools like `aws`,
`terraform`, `ansible`, etc.. some bash installation scripts are provided for
Linux (x64) and MacOS (x64). They are located in the `script/` folder.
The following packages are required in order to execute the installation
script: `gcc` (Linux only), `python3-devel` (Linux only), `unzip`, `wget`,
`tar`. These packages should be installed through usual package manager (`dnf`,
`apt`, `brew`, etc..).
Finally, Python `virtualenv` must be installed with `root` privileges:
```shell
$ sudo pip3 install virtualenv
```
The pre-requisites installation script can now be run. By default, third party
tools are installed into the folder `$HOME/.edb-cloud-tools`, this path can be
changed by setting the environment variable `INSTALL_PATH`.
On Linux:
```shell
$ /usr/local/share/edb-pot/scripts/install_requirements_linux_x64.sh
```
On MacOS (Python 3.9 installed with `brew`):
```shell
$ /usr/local/share/edb-pot/scripts/install_requirements_darwin_x64.sh
```
The last action is to add the installation path to the `PATH` variable. If your
shell is `bash`, just enter:
```shell
$ source ~/.bashrc
```
For other shells, you have to re-export the environment variable `PATH` this
way:
```shell
$ export PATH=$PATH:$HOME/.edb-cloud-tools/bin
```
You can now check if the tools are ready to use with the commands
`aws --version`, `ansible --version`, etc..
# Usage
Each new deployment will be done under a dedicated name space, this the
`<PROJECT_NAME>`.
`edb-pot` CLI features are implemented through sub-commands. Each
sub-command can be executed like this:
```shell
$ edb-pot <CLOUD_VENDOR> <SUB_COMMAND> [<PROJECT_NAME>]
```
## Cloud vendor list
* `aws`: Amazon Web Services
* `azure`: Microsoft Azure Cloud
* `gcloud`: Google Cloud
## Sub-commands
* `configure`: New project initialization and configuration
* `provision`: Cloud resources provisioning
* `destroy`: Cloud resources destruction
* `deploy`: Postgres and tools deployment
* `display`: Display the project information
* `passwords`: Display the project passwords
* `show`: Show configuration
* `list`: List projects
* `specs`: Show Cloud Vendor default specifications
* `logs`: Show project logs
* `remove`: Remove project
# How to Use
Deployment of new project should follow the work flow below:
1. [Configure Cloud credentials](#configure-cloud-credentials)
2. [Project configuration](#project-configuration)
3. [Cloud resources provisioning](#cloud-resources-provisioning)
4. [Postgres and tools deployment](#postgres-and-tools-deployment)
## Configure Cloud credentials
This step depends on the target Cloud vendor.
### AWS credentials configuration
AWS credentials configuration will be done through `aws` tool. For this step,
we need to get your **AWS Access Key ID** and **AWS Secret Access Key**. For
more information about Amazon Access Key management, please go to
[official documentation page](https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_access-keys.html#Using_CreateAccessKey).
Run the following command and enter the Access Key ID and Secret Access Key:
```shell
$ aws configure
```
### Azure credentials configuration
Azure Cloud credentials configuration can be achieved using the `az` tool with
the following command:
```shell
$ az login --use-device-code
```
### GCloud credentials configuration
GCloud credentials configuration includes more steps than the other Cloud
vendors. **GCloud project ID** is required.
1. Login with your email address:
```shell
$ gcloud auth login <LOGIN_EMAIL> --no-launch-browser
```
2. Open the link in your browser and copy the given verification code.
3. Project configuration
```shell
$ gcloud config set project <PROJECT_ID>
```
4. To find the IAM account of the service, please enter the following command
to list service accounts:
```shell
$ gcloud iam service-accounts list
```
5. Finally, to create and download a new service account key:
```shell
$ gcloud iam service-accounts keys create ~/accounts.json --iam-account=<IAM_ACCOUNT>
```
The JSON file `$HOME/accounts.json` must be kept and will be required by
`edb-pot`.
## Project configuration
Once Cloud vendor credentials have been configured, you can proceed with
project configuration step.
### Cloud vendor specifications
`edb-pot` brings default configuration values for the Cloud resources
to be provisioned, like **instance type**, **disk size**, **OS image**,
**additional volumes**, etc..
To change these configuration values, you need first to dump the default values
with:
```shell
$ edb-pot <CLOUD_VENDOR> specs > my_configuration.json
```
Then, you can edit and update resources configuration stored in the JSON file.
### Project initialization
Project initialialization will done using the `configure` sub-command:
```shell
$ edb-deploy <CLOUD_VENDOR> configure <PROJECT_NAME> \
--route53-access-key <route53-acccess-key> \
--route53-secret <route53-secret> \
--email-id <email-id> \
-u "<EDB_REPO_USERNAME>:<EDB_REPO_PASSWORD>" \
-r <CLOUD_REGION> \
-s my_configuration.json
```
Notes:
* `"EDB_REPO_USERNAME:EDB_REPO_PASSWORD"`
EDB Packages repository credentials. **Required**.
* `CLOUD_REGION`
Cloud vendor region. Default value depends on Cloud vendor.
For more details, please use:
```shell
$ edb-pot <CLOUD_VENDOR> configure --help
```
## Cloud resources provisioning
After project configuration, we can proceed to Cloud resources provisioning:
```shell
$ edb-pot <CLOUD_VENDOR> provision <PROJECT_NAME>
```
## Components deployment
Finally, we can deploy the components with the `deploy` sub-command:
```shell
$ edb-pot <CLOUD_VENDOR> deploy <PROJECT_NAME>
```
## Other features
List of projects:
```shell
$ edb-pot <CLOUD_VENDOR> list
```
Display of projects inventory:
```shell
$ edb-pot <CLOUD_VENDOR> display <PROJECT_NAME>
```
Display of projects passwords:
```shell
$ edb-pot <CLOUD_VENDOR> passwords <PROJECT_NAME>
```
Cloud resources destruction:
```shell
$ edb-pot <CLOUD_VENDOR> destroy <PROJECT_NAME>
```
Project tree deletion:
```shell
$ edb-pot <CLOUD_VENDOR> remove <PROJECT_NAME>
```
# License
Original work Copyright 2019-2020, EnterpriseDB Corporation
All rights reserved.
Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions are met:
1. Redistributions of source code must retain the above copyright notice, this
list of conditions and the following disclaimer.
2. Redistributions in binary form must reproduce the above copyright notice,
this list of conditions and the following disclaimer in the documentation
and/or other materials provided with the distribution.
3. Neither the name of EnterpriseDB nor the names of its contributors may be
used to endorse or promote products derived from this software without specific
prior written permission.
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR
ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON
ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE.