Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(client): remove needless process_output in process_input #1922

Draft
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

mxinden
Copy link
Collaborator

@mxinden mxinden commented Jun 13, 2024

There is no need to call process_output within process_multiple_input after each GRO datagram batch. Instead, process all available incoming datagrams in process_multiple_input and then move on to the top of the loop, calling handler.handle and then process_output` as usual.

…ultiple_input

There is no need to call `process_output` within `process_multiple_input` after
each GRO datagram batch. Instead, process all available incoming datagrams in
`process_multiple_input` and then move on to the top of the `loop`, calling
`handler.handle` and then process_output` as usual.
Copy link

github-actions bot commented Jun 13, 2024

Failed Interop Tests

QUIC Interop Runner, client vs. server

All results

Succeeded Interop Tests

QUIC Interop Runner, client vs. server

Unsupported Interop Tests

QUIC Interop Runner, client vs. server

Copy link

codecov bot commented Jun 13, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 94.79%. Comparing base (2e1f92e) to head (0d8ff09).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1922      +/-   ##
==========================================
- Coverage   94.79%   94.79%   -0.01%     
==========================================
  Files         110      110              
  Lines       35722    35722              
==========================================
- Hits        33864    33863       -1     
- Misses       1858     1859       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

github-actions bot commented Jun 13, 2024

Firefox builds for this PR

The following builds are available for testing. Crossed-out builds did not succeed.

@mxinden mxinden marked this pull request as ready for review June 18, 2024 08:40
@mxinden
Copy link
Collaborator Author

mxinden commented Jun 18, 2024

Let's wait for a benchmark run before merging here. Just to make sure nothing depends on the additional calls to process_output.

@larseggert
Copy link
Collaborator

@mxinden the RPS bench seems to just sit there idle.

@larseggert
Copy link
Collaborator

@mxinden anything I can do to help land this?

@mxinden
Copy link
Collaborator Author

mxinden commented Jul 1, 2024

I suggest we land #1929 first. Might resolve the RPS benchmark stall.

@larseggert
Copy link
Collaborator

Pulled in from main w/#1929. Let's see.

Copy link

github-actions bot commented Jul 2, 2024

Benchmark results

Performance differences relative to 2e1f92e.

coalesce_acked_from_zero 1+1 entries: No change in performance detected.
       time:   [188.05 ns 188.55 ns 189.08 ns]
       change: [-0.3809% -0.0131% +0.4056%] (p = 0.95 > 0.05)

Found 9 outliers among 100 measurements (9.00%)
4 (4.00%) high mild
5 (5.00%) high severe

coalesce_acked_from_zero 3+1 entries: No change in performance detected.
       time:   [230.54 ns 231.12 ns 231.74 ns]
       change: [-1.3710% -0.4687% +0.1724%] (p = 0.28 > 0.05)

Found 13 outliers among 100 measurements (13.00%)
1 (1.00%) low mild
6 (6.00%) high mild
6 (6.00%) high severe

coalesce_acked_from_zero 10+1 entries: No change in performance detected.
       time:   [230.66 ns 231.49 ns 232.48 ns]
       change: [-0.2900% +0.0933% +0.4979%] (p = 0.64 > 0.05)

Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high severe

coalesce_acked_from_zero 1000+1 entries: No change in performance detected.
       time:   [214.26 ns 214.65 ns 215.13 ns]
       change: [-0.3166% +0.3603% +1.0440%] (p = 0.32 > 0.05)

Found 13 outliers among 100 measurements (13.00%)
5 (5.00%) high mild
8 (8.00%) high severe

RxStreamOrderer::inbound_frame(): Change within noise threshold.
       time:   [119.10 ms 119.18 ms 119.25 ms]
       change: [+0.4647% +0.5535% +0.6293%] (p = 0.00 < 0.05)

Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild

transfer/Run multiple transfers with varying seeds: Change within noise threshold.
       time:   [121.27 ms 121.56 ms 121.86 ms]
       thrpt:  [32.825 MiB/s 32.905 MiB/s 32.985 MiB/s]
change:
       time:   [-0.7320% -0.4144% -0.0564%] (p = 0.02 < 0.05)
       thrpt:  [+0.0564% +0.4161% +0.7374%]
transfer/Run multiple transfers with the same seed: Change within noise threshold.
       time:   [121.94 ms 122.12 ms 122.30 ms]
       thrpt:  [32.706 MiB/s 32.755 MiB/s 32.804 MiB/s]
change:
       time:   [-0.5968% -0.3944% -0.1917%] (p = 0.00 < 0.05)
       thrpt:  [+0.1921% +0.3959% +0.6004%]
1-conn/1-100mb-resp (aka. Download)/client: 💔 Performance has regressed.
       time:   [1.7535 s 1.8771 s 1.9494 s]
       thrpt:  [51.297 MiB/s 53.273 MiB/s 57.028 MiB/s]
change:
       time:   [+52.443% +65.455% +73.749%] (p = 0.00 < 0.05)
       thrpt:  [-42.446% -39.561% -34.402%]

Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) low severe

1-conn/10_000-parallel-1b-resp (aka. RPS)/client: 💔 Performance has regressed.
       time:   [459.08 ms 461.92 ms 464.81 ms]
       thrpt:  [21.514 Kelem/s 21.649 Kelem/s 21.783 Kelem/s]
change:
       time:   [+3.7751% +4.6991% +5.5965%] (p = 0.00 < 0.05)
       thrpt:  [-5.2999% -4.4882% -3.6378%]

Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) low mild
1 (1.00%) high mild

1-conn/1-1b-resp (aka. HPS)/client: No change in performance detected.
       time:   [45.022 ms 45.273 ms 45.524 ms]
       thrpt:  [21.966  elem/s 22.088  elem/s 22.211  elem/s]
change:
       time:   [-1.0955% -0.3266% +0.4472%] (p = 0.42 > 0.05)
       thrpt:  [-0.4453% +0.3277% +1.1076%]

Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) low mild
3 (3.00%) high mild

Client/server transfer results

Transfer of 33554432 bytes over loopback.

Client Server CC Pacing Mean [ms] Min [ms] Max [ms] Relative
msquic msquic 146.2 ± 57.7 100.3 317.3 1.00
neqo msquic reno on 259.7 ± 10.4 248.8 280.1 1.00
neqo msquic reno 262.4 ± 10.3 250.1 281.6 1.00
neqo msquic cubic on 281.2 ± 51.9 247.8 426.7 1.00
neqo msquic cubic 301.4 ± 75.2 251.3 458.8 1.00
msquic neqo reno on 958.9 ± 8.7 948.1 974.0 1.00
msquic neqo reno 951.4 ± 31.7 933.2 1026.6 1.00
msquic neqo cubic on 921.1 ± 11.4 910.7 941.1 1.00
msquic neqo cubic 926.3 ± 20.7 907.0 975.4 1.00
neqo neqo reno on 862.8 ± 24.3 830.8 898.5 1.00
neqo neqo reno 861.9 ± 23.2 825.7 893.4 1.00
neqo neqo cubic on 831.9 ± 12.0 811.5 851.6 1.00
neqo neqo cubic 799.7 ± 24.6 749.8 832.8 1.00

⬇️ Download logs

@mxinden
Copy link
Collaborator Author

mxinden commented Jul 2, 2024

Pulled in from main w/#1929. Let's see.

All green. Good news 😮‍💨

@mxinden
Copy link
Collaborator Author

mxinden commented Jul 2, 2024

1-conn/1-100mb-resp (aka. Download)/client: 💔 Performance has regressed.

   time:   [1.7535 s 1.8771 s 1.9494 s]
   thrpt:  [51.297 MiB/s 53.273 MiB/s 57.028 MiB/s]

change:
time: [+52.443% +65.455% +73.749%] (p = 0.00 < 0.05)
thrpt: [-42.446% -39.561% -34.402%]

Let's hold off merging for now.

@larseggert
Copy link
Collaborator

OK, making this a draft PR for now.

@larseggert larseggert marked this pull request as draft July 3, 2024 05:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants