mirror of
https://github.com/nestriness/nestri.git
synced 2026-09-19 17:25:19 +03:00
06b844b961
Captures a session's audio and hands it to the transport over a local socket. Third component in, imported as a tree from `nestrilabs/neswire` on the same terms as the previous two. Wired to the workspace, `nesprotocol` by path. 4 tests pass. `bin/hub-stub.rs` is a stand-in for the transport's listener, which is what lets this be developed and tested without the rest of a box existing. It names the transport by its old name, and is left for the rename commit along with the two in the compositor. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
neswire
A small custom PipeWire sink for cloud gaming audio capture.
Currently for debugging uses RTP to send Opus (with FEC enabled by default) over to target address.
Testing
Mono/Stereo
Launch gstreamer pipeline to receive audio as so (will save incoming RTP audio into test.mkv):
gst-launch-1.0 udpsrc port=12345 caps="application/x-rtp,media=audio,encoding-name=OPUS,clock-rate=48000,payload=111" ! rtpopusdepay2 ! opusdec ! matroskamux ! filesink location=test.mkv sync=false
Then run neswire like so for example:
cargo run --release --bin neswire -- --rtp-addr 127.0.0.1:12345
Surround
Launch gstreamer pipeline to receive audio as so (will save incoming RTP audio into test_multi.mkv):
gst-launch-1.0 udpsrc port=12345 caps='application/x-rtp,media=audio,encoding-name=MULTIOPUS,clock-rate=48000,payload=111,encoding-params=(string)8,num_streams=(string)5,coupled_streams=(string)3,channel_mapping=(string)"0,6,1,2,3,4,5,7"' ! rtpopusdepay2 ! opusdec ! matroskamux ! filesink location=test.mkv sync=false
Then run neswire like so for example:
cargo run --release --bin neswire -- --rtp-addr 127.0.0.1:12345 --channels 8
For both afterwards, set the neswire sink as audio output source in your system (or specify it as output in some app/game), then play some audio, stop gst pipeline and sink, listen to results after.