Skip to content

TST: Set tests touched by text overhaul to mpl20 style#31300

Merged
QuLogic merged 2 commits intomatplotlib:text-overhaulfrom
QuLogic:text-test-style
Apr 7, 2026
Merged

TST: Set tests touched by text overhaul to mpl20 style#31300
QuLogic merged 2 commits intomatplotlib:text-overhaulfrom
QuLogic:text-test-style

Conversation

@QuLogic
Copy link
Copy Markdown
Member

@QuLogic QuLogic commented Mar 13, 2026 •
edited
Loading

PR summary

This is based on several other PRs to make it easier for me to track what needs changing. I will rebase those extra commits out once ready.

The first commit changes all related tests to mpl20, while the second commit changes a few so that they better work in the new style (e.g., moves a transparent legend over top something so that you can actually confirm that it's transparent.) I do expect to squash these together, but kept them separate so that it'd be easier to review the secondary changes.

AI Disclosure

None

PR checklist

@QuLogic QuLogic added this to the v3.11.0 milestone Mar 13, 2026
@github-project-automation github-project-automation Bot moved this to Waiting for other PR in Font and text overhaul Mar 13, 2026
QuLogic
QuLogic commented Mar 13, 2026
View reviewed changes
Comment thread lib/matplotlib/tests/baseline_images/test_axes/o_marker_path_snap.png
Comment thread lib/matplotlib/tests/baseline_images/test_axes/rc_spines.png
Comment thread lib/matplotlib/tests/baseline_images/test_axes/rc_grid.png
Comment thread lib/matplotlib/tests/baseline_images/test_axes/bar_tick_label_multiple_old_label_alignment.png
Comment thread lib/matplotlib/tests/baseline_images/test_legend/rgba_alpha.png
Comment thread lib/matplotlib/tests/baseline_images/test_legend/rcparam_alpha.png
Comment thread lib/matplotlib/tests/baseline_images/test_spines/spines_data_positions.png
Comment thread lib/matplotlib/tests/baseline_images/test_text/text_contains.png
Comment thread lib/matplotlib/tests/baseline_images/test_text/agg_text_clip.png
Comment thread lib/matplotlib/tests/test_axes.py
@QuLogic QuLogic force-pushed the text-test-style branch 4 times, most recently from 1403060 to c0ccc2f Compare March 14, 2026 02:23
@QuLogic QuLogic marked this pull request as ready for review April 3, 2026 01:50
@QuLogic QuLogic moved this from Waiting for other PR to Ready for Review in Font and text overhaul Apr 3, 2026
@QuLogic
Copy link
Copy Markdown
Member Author

QuLogic commented Apr 3, 2026

This is now all set, except that the following tests fail on macOS only:

FAILED lib/matplotlib/tests/test_axes.py::test_canonical[png] - matplotlib.testing.exceptions.ImageComparisonFailure: images not close (RMS 0.028):
	result_images/test_axes/canonical.png
	result_images/test_axes/canonical-expected.png
	result_images/test_axes/canonical-failed-diff.png
FAILED lib/matplotlib/tests/test_axes.py::test_set_get_ticklabels[png] - matplotlib.testing.exceptions.ImageComparisonFailure: images not close (RMS 0.029):
	result_images/test_axes/set_get_ticklabels.png
	result_images/test_axes/set_get_ticklabels-expected.png
	result_images/test_axes/set_get_ticklabels-failed-diff.png
FAILED lib/matplotlib/tests/test_figure.py::test_figure[png] - matplotlib.testing.exceptions.ImageComparisonFailure: images not close (RMS 0.021):
	result_images/test_figure/figure_today.png
	result_images/test_figure/figure_today-expected.png
	result_images/test_figure/figure_today-failed-diff.png
FAILED lib/mpl_toolkits/axes_grid1/tests/test_axes_grid1.py::test_zooming_with_inverted_axes[png] - matplotlib.testing.exceptions.ImageComparisonFailure: images not close (RMS 0.022):
	result_images/test_axes_grid1/zoomed_axes.png
	result_images/test_axes_grid1/zoomed_axes-expected.png
	result_images/test_axes_grid1/zoomed_axes-failed-diff.png
FAILED lib/matplotlib/tests/test_legend.py::test_labels_first[png] - matplotlib.testing.exceptions.ImageComparisonFailure: images not close (RMS 0.014):
	result_images/test_legend/legend_labels_first.png
	result_images/test_legend/legend_labels_first-expected.png
	result_images/test_legend/legend_labels_first-failed-diff.png
FAILED lib/matplotlib/tests/test_legend.py::test_multiple_keys[png] - matplotlib.testing.exceptions.ImageComparisonFailure: images not close (RMS 0.032):
	result_images/test_legend/legend_multiple_keys.png
	result_images/test_legend/legend_multiple_keys-expected.png
	result_images/test_legend/legend_multiple_keys-failed-diff.png

I am extremely surprised by the first one, as that's about the simplest plot there is.

@QuLogic
Copy link
Copy Markdown
Member Author

QuLogic commented Apr 3, 2026

Using our standard diff, it is basically invisible, but using imagemagick, the diff is:
foo
I do not understand how that could be so much for such a simple plot.

@tacaswell
Copy link
Copy Markdown
Member

tacaswell commented Apr 3, 2026

Also odd that the mises are not uniform across the line.

@tacaswell
Copy link
Copy Markdown
Member

tacaswell commented Apr 3, 2026

@ksunden Looked into this and they all already have tolerances and changing the style changes amount of tolerance we needs. Lets merge this and deal with the tolerances in the other PR.

Rough theory as to the distribution: we are seeing accumulated errors as a function of distance across the axis so the diagonal line is sampling different parts of that at different heights.

@ksunden
Copy link
Copy Markdown
Member

ksunden commented Apr 3, 2026

Specifically, all of these tests already had tolerances from the old style, the RMS just got higher than we had encoded.

This is due to a number of factors, likely

  • Fewer pixels in total (so changed pixels are a higher proportion)
  • Thicker lines
  • More color channels because the old tests were pure #0000FF blue

All of these tests are plotting some form of y=x+C lines (e.g. ax.plot([1,2,3]) or ax.plot(np.arange(5), etc) so it is really only that one particular line that needs this adjustment, just frustrating that it is such a simple and common case...

@QuLogic
Copy link
Copy Markdown
Member Author

QuLogic commented Apr 6, 2026

🤦‍♂️ I was looking at this from the reset-tolerances branch, and thus was confused because I thought all of these tests already had zero tolerance. Of course, if they all had one and it's just a tiny bit more now, that's quite alright.

@QuLogic QuLogic merged commit 41c4d8d into matplotlib:text-overhaul Apr 7, 2026
47 of 49 checks passed
@github-project-automation github-project-automation Bot moved this from Ready for Review to Done in Font and text overhaul Apr 7, 2026
@QuLogic QuLogic deleted the text-test-style branch April 7, 2026 01:53
@QuLogic QuLogic mentioned this pull request Apr 7, 2026
Merged
1 task
QuLogic added a commit to QuLogic/matplotlib that referenced this pull request Apr 10, 2026
@QuLogic
Update test images for font/text overhaul
12d2a4d 
This includes images changes for the following pull requests / commits:

* [Fix center of rotation with
  rotation_mode='anchor'](matplotlib#29199)
  (c44db77)
* [Remove ttconv backwards-compatibility
  code](matplotlib#30145)
  (8caff88)
* [Remove kerning_factor from
  tests](matplotlib#29816)
  (7b4d725)
* [Set text hinting to
  defaults](matplotlib#29816)
  (8255ae2)
* [Update FreeType to
  2.13.3](matplotlib#29816)
  (89c054d)
* [Implement text shaping with
  libraqm](matplotlib#30000)
  (b0ded3a,
  9813523)
* [Add language parameter to Text
  objects](matplotlib#29794)
  (7ce8eae)
* [Fix auto-sized glyphs with BaKoMa
  fonts](matplotlib#29936)
  (3ba2c13)
* [pdf: Improve text with characters outside embedded font
  limits](matplotlib#30512)
  (b70fb88,
  6cedcf7)
* [Prepare `CharacterTracker` for advanced font
  features](matplotlib#30608)
  (8274e17,
  70dc388,
  df670cf,
  ed5e074)
* [Add font feature API to
  Text](matplotlib#29695)
  (972a688)
* [Fix spacing in r"$\max
  f$"](matplotlib#30715)
  (4a99a83)
* [Implement libraqm for vector
  outputs](matplotlib#30607)
  (bd17cd4)
* [Drop the FT2Font intermediate
  buffer](matplotlib#30059)
  (9d7d7b4)
* [Rasterize dvi files without
  dvipng](matplotlib#30039)
  (7627118)
* [Update bundled FreeType and HarfBuzz
  libraries](matplotlib#30938)
  (a161658,
  9619bcc)
* [Fix positioning of wide mathtext
  accents](matplotlib#31069)
  (c2fa7ba)
* [Refactor RendererAgg.draw_{mathtext,text,tex} to use same base
  algorithm](matplotlib#31085)
  (931bcf3)
* [Implement TeX's fraction and script
  alignment](matplotlib#31046)
  (94ff452,
  4bfa0f9,
  1cd8510)
* [Fix confusion between text height and ascent in metrics
  calculations](matplotlib#31107)
  (60f2310)
* [mathtext: Fetch quad width & axis height from font
  metrics](matplotlib#31110)
  (692df3f,
  383028b)
* [mathtext: add mathnormal and distinguish between normal and italic
  family](matplotlib#31121)
  (a6913f3)
* [ENH: Ignore empty text for
  tightbbox](matplotlib#31285)
  (d772043)
* [Drop axis_artist tickdir image compat, due to text-overhaul
  merge](matplotlib#31281)
  (2057583)
* [text: Use font metrics to determine line
  heights](matplotlib#31291)
  (3ab6a27,
  d961462,
  97f4943)
* [ps/pdf: Override font height metrics to support AFM
  files](matplotlib#31371)
  (e0913d4)
* [TST: Cleanup back-compat code in tests touched by text
  overhaul](matplotlib#31295)
  (7c33379)
* [TST: Set tests touched by text overhaul to mpl20
  style](matplotlib#31300)
  (41c4d8d)
@QuLogic QuLogic mentioned this pull request Apr 10, 2026
Merged
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tacaswell tacaswell tacaswell approved these changes

@ksunden ksunden ksunden approved these changes

Assignees

No one assigned

Labels

topic: mpl_toolkit

Projects

Font and text overhaul
Status: Done

Milestone

v3.11.0

Development

Successfully merging this pull request may close these issues.

3 participants

@QuLogic @tacaswell @ksunden