Paul Payne
4d983819c9
feat(synapse): update ingress to use traefik ingress class and bump version feat(syncthing-discovery): introduce syncthing discovery service with deployment and ingress feat(syncthing-relay): add syncthing relay server with deployment and ingress configuration fix(taiga): update liveness and readiness probes to use tcpSocket for health checks fix(taiga): change PVC access mode to ReadWriteMany for media and static storage feat(traefik): add icon and ignore rules for traefik service docs(ushahidi): add notes for Redis configuration and Laravel startup probe adjustments feat(ushahidi): implement dedicated Redis deployment for Ushahidi fix(vllm): update deployment strategy and readiness/liveness probes for improved stability fix(writefreely): pin writefreely image version to v0.15.1 for consistency docs(zulip): add notes for TLS-terminating reverse proxy configuration and expected behavior
17 lines
344 B
YAML
17 lines
344 B
YAML
version: 0.5.4-6
|
|
requires: []
|
|
defaultConfig:
|
|
namespace: llm
|
|
model: Qwen/Qwen2.5-7B-Instruct
|
|
maxModelLen: 8192
|
|
gpuMemoryUtilization: 0.9
|
|
cpuRequest: '4'
|
|
cpuLimit: '8'
|
|
memoryRequest: 16Gi
|
|
memoryLimit: 24Gi
|
|
gpuCount: 1
|
|
domain: vllm.{{ .cloud.domain }}
|
|
externalDnsDomain: "{{ .cloud.domain }}"
|
|
defaultSecrets:
|
|
- key: apiKey
|