feat(workers): systemd unit + push-workers.sh
Deploy README extended with workers bootstrap + note on the void2-db SQL_ASCII cluster requiring client_encoding=UTF8 on Python clients. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
This commit is contained in:
@@ -51,3 +51,52 @@ ssh root@void2-app 'cd /opt/void-server && npm run migrate'
|
|||||||
- `.env` is excluded from the rsync to avoid clobbering production secrets with dev values.
|
- `.env` is excluded from the rsync to avoid clobbering production secrets with dev values.
|
||||||
- The push script uses `--omit=dev` to skip test deps on the target.
|
- The push script uses `--omit=dev` to skip test deps on the target.
|
||||||
- `tests/` is excluded — they're for the dev environment only.
|
- `tests/` is excluded — they're for the dev environment only.
|
||||||
|
|
||||||
|
## Workers (Python void-workers — Plan 4+)
|
||||||
|
|
||||||
|
Runs alongside void-server as a second systemd unit.
|
||||||
|
|
||||||
|
One-time setup on CT 311:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
apt install -y python3.12 python3.12-venv python3-pip \
|
||||||
|
ffmpeg tesseract-ocr tesseract-ocr-eng poppler-utils
|
||||||
|
|
||||||
|
useradd -r -m -d /opt/void-workers -s /bin/bash voidworkers
|
||||||
|
mkdir -p /opt/void-workers /var/lib/void/whisper-models
|
||||||
|
chown voidworkers: /opt/void-workers
|
||||||
|
chown -R voidworkers: /var/lib/void/whisper-models
|
||||||
|
|
||||||
|
# voidworkers needs to read the shared blob store
|
||||||
|
usermod -aG void voidworkers
|
||||||
|
chmod -R g+rX /var/lib/void/blobs
|
||||||
|
|
||||||
|
install -m 644 deploy/void-workers.service /etc/systemd/system/
|
||||||
|
systemctl daemon-reload
|
||||||
|
systemctl enable void-workers
|
||||||
|
```
|
||||||
|
|
||||||
|
`/opt/void-workers/.env` (mode 600, owned by voidworkers):
|
||||||
|
|
||||||
|
```
|
||||||
|
DATABASE_URL=postgres://void:<pw>@192.168.1.215:5432/void
|
||||||
|
BLOB_ROOT=/var/lib/void/blobs
|
||||||
|
WHISPER_MODEL=small.en
|
||||||
|
WHISPER_CACHE=/var/lib/void/whisper-models
|
||||||
|
```
|
||||||
|
|
||||||
|
Deploy after edits:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
cd /project/src/void-v2
|
||||||
|
./deploy/push-workers.sh
|
||||||
|
```
|
||||||
|
|
||||||
|
## SQL_ASCII cluster note
|
||||||
|
|
||||||
|
`void2-db` was initialized as SQL_ASCII (not UTF-8). The data is already
|
||||||
|
UTF-8 in practice but Python's psycopg refuses to decode without an
|
||||||
|
explicit `client_encoding=UTF8` parameter. Workers set this on every
|
||||||
|
connection (`lib/db/pool.py` equivalent in `workers/void_workers/`).
|
||||||
|
Node's `pg` lib is more lenient and doesn't need this. If you ever
|
||||||
|
re-initdb the cluster, use `--encoding=UTF8 --locale=C.UTF-8`.
|
||||||
|
|||||||
27
deploy/push-workers.sh
Executable file
27
deploy/push-workers.sh
Executable file
@@ -0,0 +1,27 @@
|
|||||||
|
#!/usr/bin/env bash
|
||||||
|
set -euo pipefail
|
||||||
|
|
||||||
|
# Push Python void-workers source to CT 311 and restart the service.
|
||||||
|
# Run from /project/src/void-v2.
|
||||||
|
|
||||||
|
TARGET=${TARGET:-root@192.168.1.13}
|
||||||
|
REMOTE_DIR=${REMOTE_DIR:-/opt/void-workers}
|
||||||
|
|
||||||
|
rsync -avz --delete \
|
||||||
|
--exclude .venv \
|
||||||
|
--exclude __pycache__ \
|
||||||
|
--exclude '*.egg-info' \
|
||||||
|
--exclude tests \
|
||||||
|
workers/ "$TARGET:$REMOTE_DIR/"
|
||||||
|
|
||||||
|
ssh "$TARGET" "
|
||||||
|
cd $REMOTE_DIR
|
||||||
|
if [ ! -d venv ]; then
|
||||||
|
python3.12 -m venv venv
|
||||||
|
fi
|
||||||
|
. venv/bin/activate
|
||||||
|
pip install --quiet --upgrade pip
|
||||||
|
pip install --quiet -e '.[all]'
|
||||||
|
systemctl restart void-workers
|
||||||
|
"
|
||||||
|
echo "Workers deployed."
|
||||||
19
deploy/void-workers.service
Normal file
19
deploy/void-workers.service
Normal file
@@ -0,0 +1,19 @@
|
|||||||
|
[Unit]
|
||||||
|
Description=Void 2.0 workers
|
||||||
|
After=network-online.target void-server.service
|
||||||
|
Wants=network-online.target
|
||||||
|
|
||||||
|
[Service]
|
||||||
|
Type=simple
|
||||||
|
User=voidworkers
|
||||||
|
WorkingDirectory=/opt/void-workers
|
||||||
|
EnvironmentFile=/opt/void-workers/.env
|
||||||
|
ExecStart=/opt/void-workers/venv/bin/python -m void_workers.runner
|
||||||
|
Restart=on-failure
|
||||||
|
RestartSec=5
|
||||||
|
StandardOutput=journal
|
||||||
|
StandardError=journal
|
||||||
|
MemoryMax=6G
|
||||||
|
|
||||||
|
[Install]
|
||||||
|
WantedBy=multi-user.target
|
||||||
Reference in New Issue
Block a user