2020-12-30 18:26:25 +03:00
|
|
|
# AdGuard Home Scripts
|
|
|
|
|
|
|
|
## `hooks/`: Git Hooks
|
|
|
|
|
|
|
|
### Usage
|
|
|
|
|
|
|
|
Run `make init` from the project root.
|
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
|
|
|
|
|
2020-12-30 18:26:25 +03:00
|
|
|
## `querylog/`: Query Log Helpers
|
|
|
|
|
|
|
|
### Usage
|
|
|
|
|
|
|
|
* `npm install`: install dependencies. Run this first.
|
|
|
|
* `npm run anonymize <source> <dst>`: read the query log from the `<source>`
|
|
|
|
and write anonymized version to `<dst>`.
|
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
|
|
|
|
|
2020-12-30 18:26:25 +03:00
|
|
|
## `make/`: Makefile Scripts
|
|
|
|
|
|
|
|
The release channels are: `development` (the default), `edge`, `beta`, and
|
|
|
|
`release`. If verbosity levels aren't documented here, there are only two: `0`,
|
|
|
|
don't print anything, and `1`, be verbose.
|
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
|
|
|
|
|
2020-12-30 18:26:25 +03:00
|
|
|
### `build-docker.sh`: Build A Multi-Architecture Docker Image
|
|
|
|
|
|
|
|
Required environment:
|
|
|
|
|
|
|
|
* `CHANNEL`: release channel, see above.
|
|
|
|
* `COMMIT`: current Git revision.
|
|
|
|
* `DIST_DIR`: the directory where a release has previously been built.
|
|
|
|
* `VERSION`: release version.
|
|
|
|
|
|
|
|
Optional environment:
|
|
|
|
|
|
|
|
* `DOCKER_IMAGE_NAME`: the name of the resulting Docker container. By default
|
|
|
|
it's `adguardhome-dev`.
|
|
|
|
* `DOCKER_OUTPUT`: the `--output` parameters. By default they are
|
|
|
|
`type=image,name=${DOCKER_IMAGE_NAME},push=false`.
|
|
|
|
* `SUDO`: allow users to use `sudo` or `doas` with `docker`. By default none
|
|
|
|
is used.
|
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
|
|
|
|
|
2020-12-30 18:26:25 +03:00
|
|
|
### `build-release.sh`: Build A Release For All Platforms
|
|
|
|
|
|
|
|
Required environment:
|
|
|
|
* `CHANNEL`: release channel, see above.
|
|
|
|
* `GPG_KEY` and `GPG_KEY_PASSPHRASE`: data for `gpg`. Only required if `SIGN`
|
|
|
|
is `1`.
|
|
|
|
|
|
|
|
Optional environment:
|
2021-03-10 20:12:18 +03:00
|
|
|
* `ARCH` and `OS`: space-separated list of architectures and operating systems
|
|
|
|
for which to build a release. For example, to build only for 64-bit ARM and
|
|
|
|
AMD on Linux and Darwin:
|
|
|
|
```sh
|
|
|
|
make ARCH='amd64 arm64' OS='darwin linux' … build-release
|
|
|
|
```
|
|
|
|
The default value is `''`, which means build everything.
|
2021-05-21 15:40:44 +03:00
|
|
|
* `BUILD_SNAP`: `0` to not build Snapcraft packages, `1` to build. The
|
|
|
|
default value is `1`.
|
2020-12-30 18:26:25 +03:00
|
|
|
* `DIST_DIR`: the directory to build a release into. The default value is
|
|
|
|
`dist`.
|
2021-08-17 15:58:40 +03:00
|
|
|
* `GO`: set an alternative name for the Go compiler.
|
2020-12-30 18:26:25 +03:00
|
|
|
* `SIGN`: `0` to not sign the resulting packages, `1` to sign. The default
|
|
|
|
value is `1`.
|
|
|
|
* `VERBOSE`: `1` to be verbose, `2` to also print environment. This script
|
|
|
|
calls `go-build.sh` with the verbosity level one level lower, so to get
|
|
|
|
verbosity level `2` in `go-build.sh`, set this to `3` when calling
|
|
|
|
`build-release.sh`.
|
|
|
|
* `VERSION`: release version. Will be set by `version.sh` if it is unset or
|
2021-04-30 19:51:23 +03:00
|
|
|
if it has the default `Makefile` value of `v0.0.0`.
|
2020-12-30 18:26:25 +03:00
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
|
|
|
|
|
2020-12-30 18:26:25 +03:00
|
|
|
### `clean.sh`: Cleanup
|
|
|
|
|
|
|
|
Optional environment:
|
2021-08-17 15:58:40 +03:00
|
|
|
* `GO`: set an alternative name for the Go compiler.
|
2020-12-30 18:26:25 +03:00
|
|
|
|
|
|
|
Required environment:
|
|
|
|
* `DIST_DIR`: the directory where a release has previously been built.
|
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
|
|
|
|
|
2020-12-30 18:26:25 +03:00
|
|
|
### `go-build.sh`: Build The Backend
|
|
|
|
|
|
|
|
Optional environment:
|
|
|
|
* `GOARM`: ARM processor options for the Go compiler.
|
|
|
|
* `GOMIPS`: ARM processor options for the Go compiler.
|
2021-08-17 15:58:40 +03:00
|
|
|
* `GO`: set an alternative name for the Go compiler.
|
2020-12-30 18:26:25 +03:00
|
|
|
* `OUT`: output binary name.
|
|
|
|
* `PARALLELISM`: set the maximum number of concurrently run build commands
|
|
|
|
(that is, compiler, linker, etc.).
|
2022-02-01 21:44:01 +03:00
|
|
|
* `SOURCE_DATE_EPOCH`: the [standardized][repr] environment variable for the
|
|
|
|
Unix epoch time of the latest commit in the repository. If set, overrides
|
|
|
|
the default obtained from Git. Useful for reproducible builds.
|
2020-12-30 18:26:25 +03:00
|
|
|
* `VERBOSE`: verbosity level. `1` shows every command that is run and every
|
|
|
|
Go package that is processed. `2` also shows subcommands and environment.
|
|
|
|
The default value is `0`, don't be verbose.
|
2021-05-24 21:46:33 +03:00
|
|
|
* `VERSION`: release version. Will be set by `version.sh` if it is unset or
|
|
|
|
if it has the default `Makefile` value of `v0.0.0`.
|
2020-12-30 18:26:25 +03:00
|
|
|
|
|
|
|
Required environment:
|
|
|
|
* `CHANNEL`: release channel, see above.
|
|
|
|
|
2022-02-01 21:44:01 +03:00
|
|
|
[repr]: https://reproducible-builds.org/docs/source-date-epoch/
|
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
|
|
|
|
|
2020-12-30 18:26:25 +03:00
|
|
|
### `go-deps.sh`: Install Backend Dependencies
|
|
|
|
|
|
|
|
Optional environment:
|
2021-08-17 15:58:40 +03:00
|
|
|
* `GO`: set an alternative name for the Go compiler.
|
2020-12-30 18:26:25 +03:00
|
|
|
* `VERBOSE`: verbosity level. `1` shows every command that is run and every
|
|
|
|
Go package that is processed. `2` also shows subcommands and environment.
|
|
|
|
The default value is `0`, don't be verbose.
|
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
|
|
|
|
|
2020-12-30 18:26:25 +03:00
|
|
|
### `go-lint.sh`: Run Backend Static Analyzers
|
|
|
|
|
|
|
|
Don't forget to run `make go-tools` once first!
|
|
|
|
|
|
|
|
Optional environment:
|
|
|
|
* `EXIT_ON_ERROR`: if set to `0`, don't exit the script after the first
|
|
|
|
encountered error. The default value is `1`.
|
2021-08-17 15:58:40 +03:00
|
|
|
* `GO`: set an alternative name for the Go compiler.
|
2020-12-30 18:26:25 +03:00
|
|
|
* `VERBOSE`: verbosity level. `1` shows every command that is run. `2` also
|
|
|
|
shows subcommands. The default value is `0`, don't be verbose.
|
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
|
|
|
|
|
2020-12-30 18:26:25 +03:00
|
|
|
### `go-test.sh`: Run Backend Tests
|
|
|
|
|
|
|
|
Optional environment:
|
2021-08-17 15:58:40 +03:00
|
|
|
* `GO`: set an alternative name for the Go compiler.
|
2020-12-30 18:26:25 +03:00
|
|
|
* `RACE`: set to `0` to not use the Go race detector. The default value is
|
|
|
|
`1`, use the race detector.
|
2021-01-29 20:00:11 +03:00
|
|
|
* `TIMEOUT_FLAGS`: set timeout flags for tests. The default value is
|
|
|
|
`--timeout 30s`.
|
2020-12-30 18:26:25 +03:00
|
|
|
* `VERBOSE`: verbosity level. `1` shows every command that is run and every
|
|
|
|
Go package that is processed. `2` also shows subcommands. The default
|
|
|
|
value is `0`, don't be verbose.
|
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
|
|
|
|
|
2020-12-30 18:26:25 +03:00
|
|
|
### `go-tools.sh`: Install Backend Tooling
|
|
|
|
|
|
|
|
Installs the Go static analysis and other tools into `${PWD}/bin`. Either add
|
|
|
|
`${PWD}/bin` to your `$PATH` before all other entries, or use the commands
|
|
|
|
directly, or use the commands through `make` (for example, `make go-lint`).
|
|
|
|
|
|
|
|
Optional environment:
|
2021-08-17 15:58:40 +03:00
|
|
|
* `GO`: set an alternative name for the Go compiler.
|
2020-12-30 18:26:25 +03:00
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
|
|
|
|
|
2021-03-10 18:08:47 +03:00
|
|
|
### `version.sh`: Generate And Print The Current Version
|
2020-12-30 18:26:25 +03:00
|
|
|
|
|
|
|
Required environment:
|
|
|
|
* `CHANNEL`: release channel, see above.
|
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
|
|
|
|
|
2020-12-30 18:26:25 +03:00
|
|
|
## `snap/`: Snap GUI Files
|
|
|
|
|
|
|
|
App icons (see https://github.com/AdguardTeam/AdGuardHome/pull/1836), Snap
|
|
|
|
manifest file templates, and helper scripts.
|
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
|
|
|
|
|
2020-12-30 18:26:25 +03:00
|
|
|
## `translations/`: Twosky Integration Script
|
|
|
|
|
|
|
|
### Usage
|
|
|
|
|
|
|
|
* `npm install`: install dependencies. Run this first.
|
|
|
|
* `npm run locales:download`: download and save all translations.
|
|
|
|
* `npm run locales:upload`: upload the base `en` locale.
|
|
|
|
* `npm run locales:summary`: show the current locales summary.
|
|
|
|
* `npm run locales:unused`: show the list of unused strings.
|
|
|
|
|
|
|
|
After the download you'll find the output locales in the `client/src/__locales/`
|
|
|
|
directory.
|
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
Optional environment:
|
2022-11-08 16:24:44 +03:00
|
|
|
|
|
|
|
* `SLEEP_TIME`: set the sleep time between downloads for `locales:download`,
|
|
|
|
in milliseconds. The default is 250 ms.
|
|
|
|
|
2021-12-03 16:20:10 +03:00
|
|
|
* `UPLOAD_LANGUAGE`: set an alternative language for `locales:upload` to
|
|
|
|
upload.
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-12-15 16:44:28 +03:00
|
|
|
## `companiesdb/`: Whotracks.me Database Converter
|
2020-12-30 18:26:25 +03:00
|
|
|
|
2022-10-19 12:13:22 +03:00
|
|
|
A simple script that downloads and updates the companies DB in the `client`
|
2021-12-15 16:44:28 +03:00
|
|
|
code from [the repo][companiesrepo].
|
2020-12-30 18:26:25 +03:00
|
|
|
|
|
|
|
### Usage
|
|
|
|
|
|
|
|
```sh
|
2022-10-19 12:13:22 +03:00
|
|
|
( cd scripts/companiesdb && sh ./download.sh )
|
2020-12-30 18:26:25 +03:00
|
|
|
```
|
|
|
|
|
2021-12-15 16:44:28 +03:00
|
|
|
[companiesrepo]: https://github.com/AdguardTeam/companiesdb
|
2022-10-21 14:05:10 +03:00
|
|
|
|
|
|
|
|
|
|
|
|
2022-10-27 15:46:25 +03:00
|
|
|
## `blocked-services/`: Blocked Services Updater
|
2022-10-21 14:05:10 +03:00
|
|
|
|
2022-10-27 15:46:25 +03:00
|
|
|
A simple script that downloads and updates the blocked services index from
|
2022-10-21 14:05:10 +03:00
|
|
|
AdGuard's [Hostlists Registry][reg].
|
|
|
|
|
|
|
|
Optional environment:
|
|
|
|
|
|
|
|
* `URL`: the URL of the index file. By default it's
|
2022-10-27 15:46:25 +03:00
|
|
|
`https://adguardteam.github.io/HostlistsRegistry/assets/services.json`.
|
2022-10-21 14:05:10 +03:00
|
|
|
|
|
|
|
### Usage
|
|
|
|
|
|
|
|
```sh
|
2022-10-27 15:46:25 +03:00
|
|
|
go run ./scripts/blocked-services/main.go
|
2022-10-21 14:05:10 +03:00
|
|
|
```
|
|
|
|
|
|
|
|
[reg]: https://github.com/AdguardTeam/HostlistsRegistry
|
2022-10-27 15:46:25 +03:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## `vetted-filters/`: Vetted Filters Updater
|
|
|
|
|
|
|
|
Similar to the one above, a script that downloads and updates the vetted
|
|
|
|
filtering list data from AdGuard's [Hostlists Registry][reg].
|
|
|
|
|
|
|
|
Optional environment:
|
|
|
|
|
|
|
|
* `URL`: the URL of the index file. By default it's
|
|
|
|
`https://adguardteam.github.io/HostlistsRegistry/assets/filters.json`.
|
|
|
|
|
|
|
|
### Usage
|
|
|
|
|
|
|
|
```sh
|
|
|
|
go run ./scripts/vetted-filters/main.go
|
|
|
|
```
|