Snakeoil Forums

Would like to see the ability for a user to add a process to be included in cpuset. E.g. ​​would like dedicate a processor for CamillaDSP
p/s tried to manualy add cpuset but it appears that cpusets are reset at boot

Good idea. Really worth exploring CPUSet to see what it can do..

Havn't had much time to work on the new GUI past week, and unlikely to have the time with the coming long weekend. But will try and incorp this into the new GUI rework. Issue created and tracked here.

Some more information for next release of cpuset:

1. cpuset does not stop IRQs from using the user cpuset (CPUs 2,3).  Ideally, to reduce latency, IRQs should be on a different CPU to the music player.  My workaround is to edit
   /etc/default/irqbalance and set IRQBALANCE_BANNED_CPUS=C  (hex mask value, run in CPUs 0,1 not in CPUs 2,3)
   
2. This may help with setting a new cpuset for a user process.  CamillaDSP was started as a system process at boot. Manually shifted using
   sudo cset proc --move --toset=user --pid 723 --threads
   
   Confirmed move worked using cset shield --shield -v  
   Code:

   cset: "user" cpuset of CPUSPEC(2-3) with 11 tasks running
   USER       PID  PPID SPPr TASK NAME
   -------- ----- ----- ---- ---------
   root       723     1 Sf70 [camilladsp]
   root       738     1 Sf70 [camilladsp]
   root       746     1 Sf70 [camilladsp]
   root       747     1 Sf70 [AlsaPlayback]
   root       748     1 Sf70 [AlsaCapture]
   root      2125     1 Soth [mpd]
   root      2174     1 Soth [io]
   root      2175     1 Sf40 [rtio]
   root      2178     1 Soth [player]
   root      2182     1 Soth [decoder]
   root      2387     1 Sf40 [output]
cset: done
3. Some issues with existing cpuset, a few player processes were not shifted to the user cpuset
   LMS + Squeezlite R2 : squeeze2upnp-x8  (using DLNA/UPnP bridge) remained in the system cpuset
   LMS + upmpdcli : squeeze2upnp-x8, mpd  remained in the system cpuset
   Minimserver : uses Java which remained in the system cpuset
   

Can confirm SQ improved with shifting IRQs to system cpuset and CamillaDSP to user cpuset.

*****
Added 22-Jun

A few more notes

1.  Can move a few more kernel processes from user to system cpuset using
   sudo cset shield -k on
   While I heard no discernible difference with SQ, for completeness, should include this.
   
2. With upmpdcli,  it is not possible to shift the underlying mpd process from system to user cpuset.  Given that upmpdcli is only a wrapper and the work is done by mpd, cpuset may not provide a SQ benefit for upmpdcli?
   
3. Tried dedicating a cpu to LMS and another cpu to Squeezelite R2.  No difference in SQ to running both LMS and Squeezelite R2 in same cpu.
   
4. Similarly no difference in SQ with mpd and CamillaDSP running on same cpu or on separate individual cpus.
   
5. However, with cpu intensive servers like Roon or HQplayer, there may be a benefit in running their players on a seperate cpu?  Someone should test this.
   
6. If mympd is enabled (coming in next release), should shift it from system to user cpuset. I do not use mympd and will disable it.
   

Have updated the ticket with last post. Hoping to incorp this into the new GUI in the upcoming release.

Further adventures with cpuset; information may be useful for the further extension of cpuset within SnakeOil.

Have a 4 CPU Intel NUC and used this script for my mpd setup
 
Mpd and CamiilaDSP were moved to individual CPUs using a command similar to this:
"cset proc --move --toset=player --pid $(pgrep mpd) --threads".

Ideally, to reduce latency, IRQs should be on a different CPU to the music threads. Some IRQs were bound to CPUs, but many of the IRQs were moved using the following:

1. Edited /etc/default/irqbalance and set IRQBALANCE_BANNED_CPUS=C  (hex mask value, run in CPUs 0,1 not in CPUs 2,3). 
   
2. Alternately, disabled or uninstalled IRQBalance and more IRQs will run on the first CPU (CPU0)
   
3. Used "cset proc -k -f root -t system" to move some more IRQs
   
4. Used "cset proc --move --toset=irq --pid $(pgrep irq/123-xhci_hc) --kthread --force" to move USB IRQ to its own CPU.
   

Some music threads could not be moved eg. Minimserver is Java based. These music threads should be started within a cpuset using a command similar to this:
"cset proc -s server -e /bin/bash -- /var/www/players/minimserver/start.sh"

Some useful information on cpusets
https://documentation.suse.com/sle-rt/15...model.html
https://documentation.suse.com/sle-rt/15...puset.html

Part III.   Had the following CPUsets (Intel NUC has 4 CPUs)
 

The player CPUset ran the following mpd processes:
 

The server CPUset was running DSP:
 

The IRQ CPUset was running the USB output:
 

Note that processes had increasing proprities down the music chain. IRQ for Ethernet: 55, feeding Mpd: 75, then processed by CamillaDSP:80 and output to IRQ for USB: 85. This ensured that downstream processes were always ready to accept inputs.

With IRQBalance removed, IRQs ran in CPU0 (System CPUset). The USB IRQ, which was the most CPU intensive task, ran on its own CPU. The Ethernet IRQ, being the input for mpd, ran on the same CPU. Further optimisation was done by moving some kernel threads to CPU0 using "cset proc -k -f root -t system".

In addition, had a 5.10 RT Kernel (built my own), did BIOS tweaks (removed hyperthreading, virtual machine settings, unnecessary ports & features) and ran DSP (convolution filters).

With mpd playing music, ran "cyclictest -t4 -p 90 -N -s -i 10000 -l 10000 -q" twenty times, with the following results.

[attachment=417]

Maximum latencies were typically 5 to 7 µs, which is excellent. CPU 0 had three 8 µs and one 10 µs max latency, which is not an issue because it ran everything not directly associated with music playback. However, CPU 1 (USB IRQ) and CPU 2 (mpd) had one 9 µs max latency, which suggests there could be room for improvement?  Will discuss things that require further investigation in a follow up post.

In summary, delighted with the tweaks that delivered SQ improvement for SnakeOil.

A note for AK when CPUset capabilities are further enhanced.  Using Ubuntu 20.04, SnakeOil 1.2.9

With Upmpdcli, used the following to shift it
 

The upmpdcli processes are successfully shifted to the player CPUset
 

Mpd have the following PIDs and should be in player CPUset (see above)
 

However, Top shows that Mpd can run in all the CPUs
 
Processor 2 is for Player CPUset and upmpdcli is correctly running in it.  But Mpd is appearing in processor 3 in this snapshot (and different processors in other snapshots).

Note that Mpd running on its own can be assigned to a CPUset.   It appears that the embedded Mpd process in upmpdcli cannot be locked into a CPUset. No idea why...