Skip to content

2.12 cp - #3173

Merged
AviAvni merged 2 commits into
2.12from
2.12-cp
Aug 28, 2023
Merged

2.12 cp#3173
AviAvni merged 2 commits into
2.12from
2.12-cp

Conversation

@AviAvni

@AviAvni AviAvni commented Aug 28, 2023

Copy link
Copy Markdown
Contributor

No description provided.

@filipecosta90

filipecosta90 commented Aug 28, 2023

Copy link
Copy Markdown
Collaborator

Automated performance analysis summary

This comment was automatically generated given there is performance data available.

In summary:

  • Detected a total of 13 stable tests between versions.
  • Detected a total of 2 highly unstable benchmarks.
  • Detected a total of 3 improvements above the improvement water line.
  • Detected a total of 2 regressions bellow the regression water line 5.0.

You can check a comparison in detail via the grafana link

Comparison between master and 2.12-cp.

Time Period from 30 days ago. (environment used: oss-standalone)

Test Case Baseline master (median obs. +- std.dev) Comparison 2.12-cp (median obs. +- std.dev) % change (higher-better) Note
ENTITY_COUNT 49998 +- 0.0% (7 datapoints) 49998 +- nan% (1 datapoints) -0.0% -- no change --
EXPLICIT-EDGE-DELETION 50 +- 0.0% (7 datapoints) 50 +- nan% (1 datapoints) -0.0% -- no change --
GRAPH500-SCALE_18-EF_16-1_HOP 33323 +- 24.4% UNSTABLE (7 datapoints) 33323 +- nan% (1 datapoints) -0.0% UNSTABLE (very high variance)
GRAPH500-SCALE_18-EF_16-1_HOP_MIXED_READ_65perc_WRITE_25perc_DEL_10perc 50 +- 0.0% (7 datapoints) 50 +- nan% (1 datapoints) -0.0% -- no change --
GRAPH500-SCALE_18-EF_16-1_HOP_MIXED_READ_75perc_WRITE_25perc 56 +- 2.9% (7 datapoints) 59 +- nan% (1 datapoints) 5.9% IMPROVEMENT
GRAPH500-SCALE_18-EF_16-2_HOP 11111 +- 0.0% (7 datapoints) 9999 +- nan% (1 datapoints) -10.0% REGRESSION
GRAPH500-SCALE_18-EF_16-2_HOP_MIXED_READ_75perc_WRITE_25perc 56 +- 3.1% (7 datapoints) 59 +- nan% (1 datapoints) 5.9% IMPROVEMENT
GRAPH500-SCALE_18-EF_16-3_HOP 893 +- 0.7% (7 datapoints) 1111 +- nan% (1 datapoints) 24.4% IMPROVEMENT
GRAPH500-SCALE_18-EF_16-3_HOP_MIXED_READ_75perc_WRITE_25perc 53 +- 3.0% (7 datapoints) 53 +- nan% (1 datapoints) 0.0% -- no change --
IMPLICIT-EDGE-DELETION 50 +- 0.0% (7 datapoints) 50 +- nan% (1 datapoints) -0.0% -- no change --
INSPECT-EDGES 2500 +- 0.0% (7 datapoints) 2500 +- nan% (1 datapoints) 0.0% -- no change --
MIX_READ_WRITE 10000 +- 0.0% (7 datapoints) 10000 +- nan% (1 datapoints) 0.0% -- no change --
NODE-BATCH-DELETE 50 +- 0.0% (7 datapoints) 50 +- nan% (1 datapoints) -0.0% -- no change --
NODE-INDEX-LOOKUP 33 +- 0.0% (7 datapoints) 33 +- nan% (1 datapoints) 0.0% -- no change --
SORT_ENTITIES 100 +- 0.0% (7 datapoints) 100 +- nan% (1 datapoints) 0.0% -- no change --
UPDATE-BASELINE 24999 +- 0.0% (7 datapoints) 24998 +- nan% (1 datapoints) -0.0% -- no change --
VARIABLE-LENGTH-FILTER 33330 +- 26.7% UNSTABLE (7 datapoints) 33324 +- nan% (1 datapoints) -0.0% UNSTABLE (very high variance)
VARIABLE_LENGTH_EXPAND_INTO 100 +- 0.0% (7 datapoints) 100 +- nan% (1 datapoints) -0.0% -- no change --
allShortestPaths-10hop-100Kpaths 33 +- 5.3% (7 datapoints) 30 +- nan% (1 datapoints) -10.0% waterline=5.3%. REGRESSION
allShortestPaths-4hop-10Kpaths 357 +- 0.0% (7 datapoints) 357 +- nan% (1 datapoints) -0.0% -- no change --

@AviAvni
AviAvni merged commit b6894af into 2.12 Aug 28, 2023
@AviAvni
AviAvni deleted the 2.12-cp branch August 28, 2023 11:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants