65 Commits

Author SHA1 Message Date
Andrew Rynhard
f1107fa3a3 docs: add survey
Adds a survey link so that we can get feedback from users.

Signed-off-by: Andrew Rynhard <andrew@rynhard.io>
2021-04-22 09:43:06 -07:00
Spencer Smith
93623d47f2 docs: update AWS instructions
This PR adds some docs changes where we had incorrect commands in the
AWS docs.

Signed-off-by: Spencer Smith <robertspencersmith@gmail.com>
2021-04-21 06:24:37 -07:00
Brandon McNama
94520b03f6 docs: fixup typo in encryption guide command
Fixes a typo in a documented command for going from an unencrypted
EPHEMERAL partition to an encrypted one.

Signed-off-by: Brandon McNama <brandonmcnama@outlook.com>
2021-04-11 02:29:33 -07:00
Alexey Palazhchenko
aca63b8829 docs: fix "DigitalOcean" spelling
Refs #3427.

Signed-off-by: Alexey Palazhchenko <alexey.palazhchenko@gmail.com>
2021-04-07 09:13:24 -07:00
Branden Cash
7bcb91a433 docs: fix typo for stage flag
docs mentioned `--staged` flag, but should be `--stage`

Signed-off-by: Branden Cash <ammmze@gmail.com>
2021-04-01 10:44:46 -07:00
Spencer Smith
74b2b5578c docs: update AWS docs to ensure instances are tagged
This PR updates our AWS docs so that we specify a tag when creating
instances. This makes it easier to know which VMs were created as part
of this process, as well as quickly spot the init node.

Signed-off-by: Spencer Smith <robertspencersmith@gmail.com>
2021-03-25 11:55:19 -04:00
Spencer Smith
946e74f047 docs: update path for kernel downloads in qemu docs
This PR fixes a docs bug where the name of the kernel and init to
download were incorrect for qemu.

Signed-off-by: Spencer Smith <robertspencersmith@gmail.com>
2021-03-24 09:48:12 -07:00
Alexey Palazhchenko
f7d276b854 chore: remove old osctl reference
One place was missed.

Signed-off-by: Alexey Palazhchenko <alexey.palazhchenko@gmail.com>
2021-03-19 08:08:58 -07:00
Andrey Smirnov
f0512dfce9 feat: update Kubernetes to 1.20.5
See CHANGELOG:
https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG/CHANGELOG-1.20.md#changelog-since-v1204

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-19 03:14:46 -07:00
Andrey Smirnov
8810440744 docs: add control plane in-depth guide
Add FAQ on initial time sync.

Add 0.9 new videos.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-17 11:23:59 -07:00
Andrey Smirnov
cbc38418d8 release(v0.10.0-alpha.0): prepare release
This is the official v0.10.0-alpha.0 release.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-17 08:40:09 -07:00
Seán C McCord
2e22f20bd8 docs: minor fixes to getting started
Fixes a few minor errors in the Getting Started doc.

Signed-off-by: Seán C McCord <ulexus@gmail.com>
2021-03-12 13:06:47 -08:00
Artem Chernyshev
83b4e7f744 feat: add Rock pi 4 support
Another nice addition to the list of supported SBCs.

Signed-off-by: Artem Chernyshev <artem.0xD2@gmail.com>
2021-03-12 05:08:29 -08:00
Seán C McCord
1362966ff5 docs: rewrite getting-started for ISO
Update the Getting Started documentation to reflect the new ISO-based
installation method.

Fixes #3016

Signed-off-by: Seán C McCord <ulexus@gmail.com>
2021-03-12 04:44:10 -08:00
Andrey Smirnov
6f7df3da1e fix: update output of convert-k8s command
This includes Sean's comments from #3278 and introduces a new flag which
is referenced in manual conversion process document.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-12 02:21:01 -08:00
Seán C McCord
dce6118c29 docs: add guide for VIP
Add documentation for using VIP, or shared IP addresses, for the
controlplane.

Fixes #3289

Signed-off-by: Seán C McCord <ulexus@gmail.com>
2021-03-11 19:01:38 -08:00
Andrey Smirnov
7c529e1cbd docs: fix links in the documentation
Gridsome forces folders to be lower-case.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-11 12:26:50 -08:00
Spencer Smith
f596c7f6be docs: add video for raspberry pi install
This PR adds a quick how-to on installing talos on rpi.

Signed-off-by: Spencer Smith <robertspencersmith@gmail.com>
2021-03-11 11:11:58 -05:00
Andrey Smirnov
47324dcaea docs: add guide on editing machine configuration
This covers new configuration update modes and new commands in 0.9.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-10 14:02:16 -08:00
Andrey Smirnov
11056a8034 docs: add highlights for 0.9 release
This describes high-level new features in Talos 0.9.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-10 07:21:13 -08:00
Andrey Smirnov
ae8bedb9a0 docs: add control plane conversion guide and 0.9 upgrade notes
These docs are critical to get 0.9.0-beta released.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-10 07:20:44 -08:00
Andrey Smirnov
ed9673e50a docs: add troubleshooting control plane documentation
Describe common failures and debugging approach.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
Co-authored-by: Spencer Smith <rsmitty@users.noreply.github.com>
2021-03-09 13:31:08 -08:00
Andrey Smirnov
485cb1262f docs: update Kubernetes upgrade guide
CLI tool usage is same, but manual process is quite different.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-09 13:23:58 -08:00
Andrey Smirnov
d3798cd7a8 docs: document controller runtime, resources and talosctl get
This is more of a in-depth guide explaining internals.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
Co-authored-by: Spencer Smith <rsmitty@users.noreply.github.com>
2021-03-09 11:27:48 -08:00
Andrey Smirnov
49853fc2ec fix: mkdir source of the extra mounts for the kubelet
This makes sure source directory exists before performing mount
operation.

Also adds an ability to patch the config bundle configs with JSON patch,
which is exposed in `talosctl cluster create`, this allowed me to easily
test this fix:

```
talosctl cluster create ... --config-patch='[{"op": "add", "path": "/machine/kubelet/extraMounts", "value": [{"destination": "/var/log/containers", "type": "bind", "source": "/var/log/containers", "options": ["rshared", "rbind", "rw"]}]}]'
```

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-05 11:47:55 -08:00
Andrey Smirnov
ec72ae892b release(v0.9.0-alpha.5): prepare release
This is the official v0.9.0-alpha.5 release.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-03 12:04:05 -08:00
Andrey Smirnov
60b7f79fd8 feat: add --on-reboot flag to talosctl edit/patch machineConfig
This allows to apply config even if sequencer is locked to recover from
confguration mistakes.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-03 08:48:29 -08:00
Andrey Smirnov
60aa011c7a feat: rename namespaces, resources, types etc
See https://github.com/talos-systems/os-runtime/pull/12 for new mnaming
conventions.

No functional changes.

Additionally implements printing extra columns in `talosctl get xyz`.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-02 13:34:15 -08:00
Andrey Smirnov
3a2caca781 release(v0.9.0-alpha.4): prepare release
This is the official v0.9.0-alpha.4 release.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-02 12:50:20 -08:00
Artem Chernyshev
9333e2a600 docs: add disk encryption guide
Describe usage tips, caveats, flow.

Signed-off-by: Artem Chernyshev <artem.0xD2@gmail.com>
2021-03-02 06:44:40 -08:00
Andrey Smirnov
a12a5dd255 release(v0.9.0-alpha.3): prepare release
This is the official v0.9.0-alpha.3 release.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-01 12:55:08 -08:00
Artem Chernyshev
376fdcf6cb feat: implement etcd remove-member cli command
Fixes: https://github.com/talos-systems/talos/issues/3219

We already have `etcd leave`, which makes the node exclude itself from
etcd members.
But in case if the node can't remove itself because it doesn't have
connection to etcd we need this etcd remove-member cli, which basically removes
a node from a different node.

No unit tests for that as it's going to destroy the test cluster.

Signed-off-by: Artem Chernyshev <artem.0xD2@gmail.com>
2021-03-01 07:55:08 -08:00
Andrey Smirnov
d173fd4c01 feat: update etcd to 3.4.15
See https://github.com/etcd-io/etcd/releases/tag/v3.4.15

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-03-01 06:16:40 -08:00
Andrey Smirnov
c7ee239087 fix: show stopped/exited containers via CRI inspector
This fixes output of `talosctl containers` to show failed/exited
containers so that it's possible to see e.g. `kube-apiserver` container
when it fails to start. This also enables using ID from the container
list to see logs of failing containers, so it's easy to debug issues
when control plane pods don't start because of wrong configuration.

Also remove option to use either CRI or containerd inspector, default to
containerd for system namespace and to CRI for kubernetes namespace.

The only side effect is that we can't see `kubelet` container in the
output of `talosctl containers -k`, but `kubelet` itself is available in
`talosctl services` and `talosctl logs kubelet`.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-26 14:45:13 -08:00
Andrey Smirnov
d7cdc8cc15 feat: implement simple layer 2 shared IP for CP
This adds a VIP (virtual IP) option to the network configuration of an
interface, which will allow a set of nodes to share a floating IP
address among them.  For now, this is restricted to control plane use
and only a single shared IP is supported.

Fixes #3111

Signed-off-by: Seán C McCord <ulexus@gmail.com>
Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-26 14:14:34 -08:00
Artem Chernyshev
041620c852 feat: implement talosctl edit and patch config commands
Fixes: https://github.com/talos-systems/talos/issues/3209

Using parts of `kubectl` package to run the editor.
Also using the same approach as in `kubectl edit` command:
- add commented section to the top of the file with the description.
- if the config has errors, display validation errors in the commented
section at the top of the file.
- retry apply config until it succeeds.
- abort if no changes were detected or if the edited file is empty.

Patch currently supports jsonpatch only and can read it either from the
file or from the inline argument.

https://asciinema.org/a/wPawpctjoCFbJZKo2z2ATDXeC

Signed-off-by: Artem Chernyshev <artem.0xD2@gmail.com>
2021-02-26 02:00:20 +03:00
Andrey Smirnov
589d01892c fix: update the layout of the Disks API to match proxying requirements
Fixes #3199

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-24 11:33:15 -08:00
Andrey Smirnov
5aa75e020e release(v0.9.0-alpha.2): prepare release
This is the official v0.9.0-alpha.2 release.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-20 14:46:12 -08:00
Andrey Smirnov
c37f2c6d36 docs: add link to GitHub Discussions as a support forum
We might benefit from more structured and searchable support forum.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-20 11:57:42 -08:00
Andrey Smirnov
8789849c70 feat: add support for extra volume mounts for control plane pods
This allows to mount extra volumes into Talos-managed control plane
static pods. With additional options like extra files, any additional
content/configuration can be mounted.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-20 08:50:09 -08:00
Andrey Smirnov
2b76c4890f feat: add an option to disable kube-proxy manifest
This options drops kube-proxy manifest from the list of bootstrap
manifests. It might be used with CNIs which don't need `kube-proxy`.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-19 07:26:34 -08:00
Andrey Smirnov
e9fc54f6e3 feat: update Kubernetes to 1.20.3
https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG/CHANGELOG-1.20.md#changelog-since-v1202

Also updater pkgs for:

* talos-systems/pkgs#238 (raspberrypi-firmware update)
* talos-systems/pkgs#242 (Linux 5.10.17 + init_on_free=0)

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-19 05:22:34 -08:00
Artem Chernyshev
54d6a45217 feat: add state encryption support
State partition encryption support adds a new section to the machine config.
And a new step to the sequencer flow which saves encryption
configuration object as json serialized value in the META partition.

Everything else is the same as is for the ephemeral partition.
Additionally enabled state partition encryption in the disk encryption
integration tests.

Signed-off-by: Artem Chernyshev <artem.0xD2@gmail.com>
2021-02-18 06:55:22 -08:00
Andrey Smirnov
8e35560baa release(v0.9.0-alpha.1): prepare release
This is the official v0.9.0-alpha.1 release.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-18 04:45:53 -08:00
Andrey Smirnov
7751920dba feat: add a tool and package to convert self-hosted CP to static pods
This is required to upgrade from Talos 0.8.x to 0.9.x. After the cluster
is fully upgraded, control plane is still self-hosted (as it was
bootstrapped with bootkube).

Tool `talosctl convert-k8s` (and library behind it) performs the upgrade
to self-hosted version.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-17 23:26:57 -08:00
Artem Chernyshev
58ff2c9808 feat: implement ephemeral partition encryption
This PR introduces the first part of disk encryption support.
New config section `systemDiskEncryption` was added into MachineConfig.
For now it contains only Ephemeral partition encryption.

Encryption itself supports two kinds of keys for now:
- node id deterministic key.
- static key which is hardcoded in the config and mainly used for test
purposes.

Talosctl cluster create can now be told to encrypt ephemeral partition
by using `--encrypt-ephemeral` flag.

Additionally:
- updated pkgs library version.
- changed Dockefile to copy cryptsetup deps from pkgs.

Signed-off-by: Artem Chernyshev <artem.0xD2@gmail.com>
2021-02-17 13:39:04 -08:00
Andrey Smirnov
e5bd35ae3c feat: add resource watch API + CLI
This uses API in `os-runtime` to pull the initial list of resources +
updates for resource by type.

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-17 13:24:47 -08:00
Andrey Smirnov
cc83b83808 feat: rename apply-config --no-reboot to --on-reboot
This explains the intetion better: config is applied on reboot, and
allows to easily distinguish it from `apply-config --immediate` which
applies config immediately without a reboot (that is coming in a
different PR).

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-17 12:49:47 -08:00
Andrey Smirnov
d99a016af2 fix: correct response structure for GenerateConfig API
Also fix recovery grpc handler to print panic stacktrace to the log.

Any API should follow the structure compatible with apid proxying
injection of errors/nodes.

Explicitly fail GenerateConfig API on worker nodes, as it panics on
worker nodes (missing certificates in node config).

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-11 06:34:10 -08:00
Andrey Smirnov
daea9d3811 feat: support version contract for Talos config generation
This allows to generating current version Talos configs (by default) or
backwards compatible configuration (e.g. for Talos 0.8).

`talosctl gen config` defaults to current version, but explicit version
can be passed to the command via flags.

`talosctl cluster create` defaults to install/container image version,
but that can be overridden. This makes `talosctl cluster create` now
compatible with 0.8.1 images out of the box.

Upgrade tests use contract based on source version in the test.

When used as a library, `VersionContract` can be omitted (defaults to
current version) or passed explicitly. `VersionContract` can be
convienietly parsed from Talos version string or specified as one of the
constants.

Fixes #3130

Signed-off-by: Andrey Smirnov <smirnov.andrey@gmail.com>
2021-02-10 13:02:52 -08:00