rssnyder/spark-utilities
1
0
Fork 0
Code Issues Pull requests 2 Projects Releases Packages Wiki Activity Actions

litellm: a route for forge-liveportrait (Truesight face frames) #3

Open
moserhu wants to merge 1 commit from forge-liveportrait-route into master
pull from: forge-liveportrait-route
merge into: rssnyder:master
Conversation 0 Commits 1 Files changed 1 +7 -1
moserhu commented 2026-10-11 19:33:21 -05:00
Collaborator
Copy link

@rssnyder one small follow-up to #2, already live on your Spark.

What: litellm/config.yaml gets a pass-through route for forge-liveportrait, the same shape as the other Forge routes. #2 added the model to llama-swap but gave it no LiteLLM route, so Truesight couldn't reach it through LiteLLM.

What I did on the Spark (2026-10-12 UTC):

  • 00:08: applied #2's Forge parts to ~/llama-swap/config.yaml: the five Forge entries as in master, plus forge-liveportrait in spark-memory. Everything else was left as it was, including your qwen3.6-35b-a3b-nvfp4. Backup: .bak-forge-master-20261012T000833Z. SIGHUP reload; deepseek was idle.
  • 00:08: forge-liveportrait added to /etc/spark-swapper/swapper.toml's models (your 35b entry kept), then a swapper restart.
  • 00:16: this route in ~/litellm/config.yaml (backup .bak-liveportrait-20261012T001622Z), then a spark-litellm restart. There had been no LiteLLM requests in the 10 minutes before.
  • New key truesight: limited to forge-liveportrait, forge-hidream and /swapper/status. It gets 403 on your chat models.

Tested through LiteLLM:

  • HiDream painted a photo portrait and an anime portrait.
  • LivePortrait made all 22 face frames for each: 96 s first load, 9 s per face, about 30 s with the THA3 eye pass.
  • The frames render correctly on the GB10. That was the open question in #1, because of the cuDNN bug.

Still yours: qwen3.6-35b-a3b-nvfp4 is live but not in master (llama-swap, LiteLLM and the swapper's list). Deploying master as-is would drop it.

🤖 Generated with Claude Code

@rssnyder one small follow-up to #2, already live on your Spark. **What:** `litellm/config.yaml` gets a pass-through route for `forge-liveportrait`, the same shape as the other Forge routes. #2 added the model to llama-swap but gave it no LiteLLM route, so Truesight couldn't reach it through LiteLLM. **What I did on the Spark (2026-10-12 UTC):** - **00:08:** applied #2's Forge parts to `~/llama-swap/config.yaml`: the five Forge entries as in `master`, plus `forge-liveportrait` in `spark-memory`. Everything else was left as it was, including your `qwen3.6-35b-a3b-nvfp4`. Backup: `.bak-forge-master-20261012T000833Z`. SIGHUP reload; deepseek was idle. - **00:08:** `forge-liveportrait` added to `/etc/spark-swapper/swapper.toml`'s `models` (your 35b entry kept), then a swapper restart. - **00:16:** this route in `~/litellm/config.yaml` (backup `.bak-liveportrait-20261012T001622Z`), then a `spark-litellm` restart. There had been no LiteLLM requests in the 10 minutes before. - **New key `truesight`:** limited to `forge-liveportrait`, `forge-hidream` and `/swapper/status`. It gets 403 on your chat models. **Tested through LiteLLM:** - HiDream painted a photo portrait and an anime portrait. - LivePortrait made all 22 face frames for each: 96 s first load, 9 s per face, about 30 s with the THA3 eye pass. - The frames render correctly on the GB10. That was the open question in #1, because of the cuDNN bug. **Still yours:** `qwen3.6-35b-a3b-nvfp4` is live but not in `master` (llama-swap, LiteLLM and the swapper's list). Deploying `master` as-is would drop it. 🤖 Generated with [Claude Code](https://claude.com/claude-code) 
forge-liveportrait came in with #2's router config but had no LiteLLM route,
so Truesight couldn't reach it through LiteLLM. Same shape as the others: a
pass-through to spark-swapper. Its client has its own key, truesight, limited
to liveportrait, hidream and /swapper/status. Identical to what has been live
on the Spark since 2026-10-12 00:16 UTC.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This pull request can be merged automatically.
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin forge-liveportrait-route:forge-liveportrait-route
git switch forge-liveportrait-route

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch master
git merge --no-ff forge-liveportrait-route
git switch forge-liveportrait-route
git rebase master
git switch master
git merge --ff-only forge-liveportrait-route
git switch forge-liveportrait-route
git rebase master
git switch master
git merge --no-ff forge-liveportrait-route
git switch master
git merge --squash forge-liveportrait-route
git switch master
git merge --ff-only forge-liveportrait-route
git switch master
git merge forge-liveportrait-route
git push origin master
Sign in to join this conversation.
Reviewers
No reviewers
rssnyder
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
rssnyder/spark-utilities!3
No description provided.