معرفی شرکت ها
cloudsnorkel.cdk-github-runners-0.9.8
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشترتوضیحات
CDK construct to create GitHub Actions self-hosted runners. A webhook listens to events and creates ephemeral runners on the fly.
| ویژگی | مقدار |
|---|---|
| سیستم عامل | - |
| نام فایل | cloudsnorkel.cdk-github-runners-0.9.8 |
| نام | cloudsnorkel.cdk-github-runners |
| نسخه کتابخانه | 0.9.8 |
| نگهدارنده | [] |
| ایمیل نگهدارنده | [] |
| نویسنده | Amir Szekely<amir@cloudsnorkel.com> |
| ایمیل نویسنده | - |
| آدرس صفحه اصلی | https://github.com/CloudSnorkel/cdk-github-runners.git |
| آدرس اینترنتی | https://pypi.org/project/cloudsnorkel.cdk-github-runners/ |
| مجوز | Apache-2.0 |
# GitHub Self-Hosted Runners CDK Constructs
[](https://www.npmjs.com/package/@cloudsnorkel/cdk-github-runners)
[](https://pypi.org/project/cloudsnorkel.cdk-github-runners)
[](https://central.sonatype.com/artifact/com.cloudsnorkel/cdk.github.runners/)
[](https://pkg.go.dev/github.com/CloudSnorkel/cdk-github-runners-go/cloudsnorkelcdkgithubrunners)
[](https://www.nuget.org/packages/CloudSnorkel.Cdk.Github.Runners/)
[](https://github.com/CloudSnorkel/cdk-github-runners/actions/workflows/release.yml)
[](https://github.com/CloudSnorkel/cdk-github-runners/blob/main/LICENSE)
Use this CDK construct to create ephemeral [self-hosted GitHub runners](https://docs.github.com/en/actions/hosting-your-own-runners/about-self-hosted-runners) on-demand inside your AWS account.
* Easy to configure GitHub integration with a web-based interface
* Customizable runners with decent defaults
* Multiple runner configurations controlled by labels
* Everything fully hosted in your account
* Automatically updated build environment with latest runner version
Self-hosted runners in AWS are useful when:
* You need easy access to internal resources in your actions
* You want to pre-install some software for your actions
* You want to provide some basic AWS API access (but [aws-actions/configure-aws-credentials](https://github.com/marketplace/actions/configure-aws-credentials-action-for-github-actions) has more security controls)
* You are using GitHub Enterprise Server
Ephemeral (or on-demand) runners are the [recommended way by GitHub](https://docs.github.com/en/actions/hosting-your-own-runners/autoscaling-with-self-hosted-runners#using-ephemeral-runners-for-autoscaling) for auto-scaling, and they make sure all jobs run with a clean image. Runners are started on-demand. You don't pay unless a job is running.
## API
The best way to browse API documentation is on [Constructs Hub](https://constructs.dev/packages/@cloudsnorkel/cdk-github-runners/). It is available in all supported programming languages.
## Providers
A runner provider creates compute resources on-demand and uses [actions/runner](https://github.com/actions/runner) to start a runner.
| | EC2 | CodeBuild | Fargate | ECS | Lambda |
|------------------|-------------------|----------------------------|----------------|----------------|---------------|
| **Time limit** | Unlimited | 8 hours | Unlimited | Unlimited | 15 minutes |
| **vCPUs** | Unlimited | 2, 4, 8, or 72 | 0.25 to 4 | Unlimited | 1 to 6 |
| **RAM** | Unlimited | 3gb, 7gb, 15gb, or 145gb | 512mb to 30gb | Unlimited | 128mb to 10gb |
| **Storage** | Unlimited | 50gb to 824gb | 20gb to 200gb | Unlimited | Up to 10gb |
| **Architecture** | x86_64, ARM64 | x86_64, ARM64 | x86_64, ARM64 | x86_64, ARM64 | x86_64, ARM64 |
| **sudo** | ✔ | ✔ | ✔ | ✔ | ❌ |
| **Docker** | ✔ | ✔ (Linux only) | ❌ | ✔ | ❌ |
| **Spot pricing** | ✔ | ❌ | ✔ | ✔ | ❌ |
| **OS** | Linux, Windows | Linux, Windows | Linux, Windows | Linux, Windows | Linux |
The best provider to use mostly depends on your current infrastructure. When in doubt, CodeBuild is always a good choice. Execution history and logs are easy to view, and it has no restrictive limits unless you need to run for more than 8 hours.
* EC2 is useful when you want runners to have complete access to the host
* ECS is useful when you want to control the infrastructure, like leaving the runner host running for faster startups
* Lambda is useful for short jobs that can work within time, size and readonly system constraints
You can also create your own provider by implementing `IRunnerProvider`.
## Installation
1. Install and use the appropriate package
<details><summary>Python</summary>
### Install
Available on [PyPI](https://pypi.org/project/cloudsnorkel.cdk-github-runners).
```bash
pip install cloudsnorkel.cdk-github-runners
```
### Use
```python
from cloudsnorkel.cdk_github_runners import GitHubRunners
GitHubRunners(self, "runners")
```
</details>
<details><summary>TypeScript or JavaScript</summary>
### Install
Available on [npm](https://www.npmjs.com/package/@cloudsnorkel/cdk-github-runners).
```bash
npm i @cloudsnorkel/cdk-github-runners
```
### Use
```python
import { GitHubRunners } from '@cloudsnorkel/cdk-github-runners';
new GitHubRunners(this, "runners");
```
</details>
<details><summary>Java</summary>
### Install
Available on [Maven](https://central.sonatype.com/artifact/com.cloudsnorkel/cdk.github.runners/).
```xml
<dependency>
<groupId>com.cloudsnorkel</groupId>
<artifactId>cdk.github.runners</artifactId>
</dependency>
```
### Use
```java
import com.cloudsnorkel.cdk.github.runners.GitHubRunners;
GitHubRunners.Builder.create(this, "runners").build();
```
</details>
<details><summary>Go</summary>
### Install
Available on [GitHub](https://pkg.go.dev/github.com/CloudSnorkel/cdk-github-runners-go/cloudsnorkelcdkgithubrunners).
```bash
go get github.com/CloudSnorkel/cdk-github-runners-go/cloudsnorkelcdkgithubrunners
```
### Use
```go
import "github.com/CloudSnorkel/cdk-github-runners-go/cloudsnorkelcdkgithubrunners"
NewGitHubRunners(this, jsii.String("runners"))
```
</details>
<details><summary>.NET</summary>
### Install
Available on [Nuget](https://www.nuget.org/packages/CloudSnorkel.Cdk.Github.Runners/).
```bash
dotnet add package CloudSnorkel.Cdk.Github.Runners
```
### Use
```csharp
using CloudSnorkel;
new GitHubRunners(this, "runners");
```
</details>
2. Use `GitHubRunners` construct in your code (starting with default arguments is fine)
3. Deploy your stack
4. Look for the status command output similar to `aws --region us-east-1 lambda invoke --function-name status-XYZ123 status.json`
```
✅ github-runners-test
✨ Deployment time: 260.01s
Outputs:
github-runners-test.runnersstatuscommand4A30F0F5 = aws --region us-east-1 lambda invoke --function-name github-runners-test-runnersstatus1A5771C0-mvttg8oPQnQS status.json
```
5. Execute the status command (you may need to specify `--profile` too) and open the resulting `status.json` file
6. Open the URL in `github.setup.url` from `status.json` or [manually setup GitHub](SETUP_GITHUB.md) integration as an app or with personal access token
7. Run status command again to confirm `github.auth.status` and `github.webhook.status` are OK
8. Trigger a GitHub action that has a `self-hosted` label with `runs-on: [self-hosted, linux, codebuild]` or similar
9. If the action is not successful, see [troubleshooting](#Troubleshooting)
[](https://youtu.be/wlyv_3V8lIw)
## Customizing
The default providers configured by `GitHubRunners` are useful for testing but probably not too much for actual production work. They run in the default VPC or no VPC and have no added IAM permissions. You would usually want to configure the providers yourself.
For example:
```python
let vpc: ec2.Vpc;
let runnerSg: ec2.SecurityGroup;
let dbSg: ec2.SecurityGroup;
let bucket: s3.Bucket;
// create a custom CodeBuild provider
const myProvider = new CodeBuildRunnerProvider(this, 'codebuild runner', {
labels: ['my-codebuild'],
vpc: vpc,
securityGroups: [runnerSg],
});
// grant some permissions to the provider
bucket.grantReadWrite(myProvider);
dbSg.connections.allowFrom(runnerSg, ec2.Port.tcp(3306), 'allow runners to connect to MySQL database');
// create the runner infrastructure
new GitHubRunners(this, 'runners', {
providers: [myProvider],
});
```
Another way to customize runners is by modifying the image used to spin them up. The image contains the [runner](https://github.com/actions/runner), any required dependencies, and integration code with the provider. You may choose to customize this image by adding more packages, for example.
```python
const myBuilder = CodeBuildRunnerProvider.imageBuilder(this, 'image builder', {
dockerfilePath: FargateRunner.LINUX_X64_DOCKERFILE_PATH,
runnerVersion: RunnerVersion.specific('2.291.0'),
rebuildInterval: Duration.days(14),
});
myBuilder.addComponent(
RunnerImageComponent.custom({ commands: ['apt install -y nginx xz-utils'] })
);
const myProvider = new FargateRunnerProvider(this, 'fargate runner', {
labels: ['customized-fargate'],
vpc: vpc,
securityGroups: [runnerSg],
imageBuilder: myBuilder,
});
// create the runner infrastructure
new GitHubRunners(this, 'runners', {
providers: [myProvider],
});
```
Your workflow will then look like:
```yaml
name: self-hosted example
on: push
jobs:
self-hosted:
runs-on: [self-hosted, customized-fargate]
steps:
- run: echo hello world
```
Windows images can also be customized the same way.
```python
const myWindowsBuilder = FargateRunnerProvider.imageBuilder(this, 'Windows image builder', {
architecture: Architecture.X86_64,
os: Os.WINDOWS,
runnerVersion: RunnerVersion.specific('2.291.0'),
rebuildInterval: Duration.days(14),
});
myWindowsBuilder.addComponent(
RunnerImageComponent.custom({
name: 'Ninja',
commands: [
'Invoke-WebRequest -UseBasicParsing -Uri "https://github.com/ninja-build/ninja/releases/download/v1.11.1/ninja-win.zip" -OutFile ninja.zip',
'Expand-Archive ninja.zip -DestinationPath C:\\actions',
'del ninja.zip',
],
})
);
const myProvider = new FargateRunnerProvider(this, 'fargate runner', {
labels: ['customized-windows-fargate'],
vpc: vpc,
securityGroups: [runnerSg],
imageBuidler: myWindowsBuilder,
});
new GitHubRunners(this, 'runners', {
providers: [myProvider],
});
```
The runner OS and architecture is determined by the image it is set to use. For example, to create a Fargate runner provider for ARM64 set the `architecture` property for the image builder to `Architecture.ARM64` in the image builder properties.
```python
new GitHubRunners(this, 'runners', {
providers: [
new FargateRunnerProvider(this, 'fargate runner', {
labels: ['arm64', 'fargate'],
imageBuidler: FargateRunnerProvider.imageBuilder(this, 'image builder', {
architecture: Architecture.ARM64,
os: Os.LINUX_UBUNTU,
}),
}),
],
});
```
## Architecture
## Troubleshooting
1. Always start with the status function, make sure no errors are reported, and confirm all status codes are OK
2. If jobs are stuck on pending:
1. Make sure `runs-on` in the workflow matches the expected labels set in the runner provider
2. If jobs get stuck often and take a long time to start, cancel the pending jobs and start them again
3. Confirm the webhook Lambda was called by visiting the URL in `troubleshooting.webhookHandlerUrl` from `status.json`
1. If it's not called or logs errors, confirm the webhook settings on the GitHub side
2. If you see too many errors, make sure you're only sending `workflow_job` events
4. When using GitHub app, make sure there are active installation in `github.auth.app.installations`
5. Check execution details of the orchestrator step function by visiting the URL in `troubleshooting.stepFunctionUrl` from `status.json`
1. Use the details tab to find the specific execution of the provider (Lambda, CodeBuild, Fargate, etc.)
2. Every step function execution should be successful, even if the runner action inside it failed
## Monitoring
There are two important ways to monitor your runners:
1. Make sure runners don't fail to start. When that happens, jobs may sit and wait. Use `GitHubRunners.metricFailed()` to get a metric for the number of failed runner starts. You should use this metric to trigger an alarm.
2. Make sure runner images don't fail to build. Failed runner image builds mean you will get stuck with out-of-date software on your runners. It may lead to security vulnerabilities, or it may lead to slower runner start-ups as the runner software itself needs to be updated. Use `GitHubRunners.failedImageBuildsTopic()` to get SNS topic that gets notified of failed runner image builds. You should subscribe to this topic.
Other useful metrics to track:
1. Use `GitHubRunners.metricJobCompleted()` to get a metric for the number of completed jobs broken down by labels and job success.
2. Use `GitHubRunners.metricTime()` to get a metric for the total time a runner is running. This includes the overhead of starting the runner.
## Other Options
1. [philips-labs/terraform-aws-github-runner](https://github.com/philips-labs/terraform-aws-github-runner) if you're using Terraform
2. [actions/actions-runner-controller](https://github.com/actions/actions-runner-controller) if you're using Kubernetes
نیازمندی
| مقدار | نام |
|---|---|
| <3.0.0,>=2.50.0 | aws-cdk-lib |
| <11.0.0,>=10.0.5 | constructs |
| <2.0.0,>=1.80.0 | jsii |
| >=0.0.3 | publication |
| ~=2.13.3 | typeguard |
زبان مورد نیاز
| مقدار | نام |
|---|---|
| ~=3.7 | Python |
نحوه نصب
نصب پکیج whl cloudsnorkel.cdk-github-runners-0.9.8:
pip install cloudsnorkel.cdk-github-runners-0.9.8.whl
نصب پکیج tar.gz cloudsnorkel.cdk-github-runners-0.9.8:
pip install cloudsnorkel.cdk-github-runners-0.9.8.tar.gz