setup-monitoring

Full monitoring setup — install agents + configure wiring + register with Prometheus

v1d4ef0dbe6 steps

Steps

auth

Authenticate with Proxmox

keebDev02.auth
Configuration
apiUrl: https://10.0.0.4:8006
username: root
password: ${{ vault.get("proxmox-vault", "password") }}
realm: pam
node: keeb-dev-02
skipTlsVerify: true
discover-hub

Validate observability stack on hancock

hancockMonitoring.discover
Configuration
sshHost: 10.0.0.12
sshUser: keeb
targetsDir: /storage/02/linux/docker/prometheus/targets
lookup-vm

Lookup target VM in fleet

fleet.lookup

← depends on: auth (on succeeded)

Configuration
apiUrl: https://10.0.0.4:8006
ticket: ${{ model.keebDev02.resource.node.node.attributes.ticket }}
csrfToken: ${{ model.keebDev02.resource.node.node.attributes.csrfToken }}
node: keeb-dev-02
skipTlsVerify: true
install-agents

Install node-exporter and promtail on the VM

monitoringAgent.install

← depends on: lookup-vm (on succeeded)

Configuration
sshHost: ${{ model.fleet.resource.vm[inputs.vmName].attributes.ip }}
sshUser: root
configure-promtail

Configure promtail on the VM to push logs to Loki

monitoringAgent.configure

← depends on: install-agents (on succeeded), discover-hub (on succeeded)

Configuration
sshHost: ${{ model.fleet.resource.vm[inputs.vmName].attributes.ip }}
sshUser: root
register-target

Register VM as a Prometheus scrape target on hancock

hancockMonitoring.register

← depends on: install-agents (on succeeded), discover-hub (on succeeded)

Configuration
sshHost: 10.0.0.12
sshUser: keeb
targetsDir: /storage/02/linux/docker/prometheus/targets