Effnet docs release - #1074
Merged
Merged
Conversation
MMathisLab
approved these changes
Jan 7, 2021
Contributor
|
@AlexEMG, why rolling back predict_.py? |
* updated maDLC Colab Notebook (#1073) * Created using Colaboratory * Created using Colaboratory * Created using Colaboratory * Some fixes (#1080) * Fix batchwise video analysis * Fix grayscale-to-RGB FutureWarning * Minor 3D test script fix Co-authored-by: jeylau <30733203+jeylau@users.noreply.github.com> Co-authored-by: Mackenzie Mathis <mathis@rowland.harvard.edu> Co-authored-by: jeylau <30733203+jeylau@users.noreply.github.com>
Member
Author
|
Jan 2020: ResNet 50 EffNet-b3 |
Member
|
@AlexEMG it should be 2.1.10, not 2.1.9.10^ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This is wip to update the docs & release 2.1.10.
This is also benchmarked. My results were (Run with DLC 2.1.9 in Jan 2021) for 100 k iterations.
**ResNet50
Imgaug:
Results for 100000 training iterations: 95 1 train error: 2.13 pixels. Test error: 2.22 pixels.
With pcutoff of 0.4 train error: 2.13 pixels. Test error: 2.22 pixels
Scalecrop:
Results for 100000 training iterations: 95 2 train error: 1.47 pixels. Test error: 1.77 pixels.
With pcutoff of 0.4 train error: 1.47 pixels. Test error: 1.77 pixels
Tensorpack:
Results for 100000 training iterations: 95 3 train error: 2.09 pixels. Test error: 2.36 pixels.
With pcutoff of 0.4 train error: 2.09 pixels. Test error: 2.36 pixels
**EffNet-b3
Imgaug:
Results for 100000 training iterations: 95 4 train error: 2.39 pixels. Test error: 2.57 pixels.
With pcutoff of 0.4 train error: 2.39 pixels. Test error: 2.57 pixels
Scalecrop:
Results for 100000 training iterations: 95 5 train error: 2.26 pixels. Test error: 2.24 pixels.
With pcutoff of 0.4 train error: 2.26 pixels. Test error: 2.24 pixels
Tensorpack:
Results for 100000 training iterations: 95 6 train error: 1.65 pixels. Test error: 2.24 pixels.
With pcutoff of 0.4 train error: 1.65 pixels. Test error: 2.24 pixels
****NOTE: for the EfficientNet we have not optimized the learning rate schedule for batch size 1 and large images. Here we showed rigorously for different datasets and models that EffNets outperform ResNets and MobNets as expected from the imagenet performance: https://openaccess.thecvf.com/content/WACV2021/html/Mathis_Pretraining_Boosts_Out-of-Domain_Robustness_for_Pose_Estimation_WACV_2021_paper.html
(thereby we cross-validated the learning rate schedule for each model, you might want to do this as well on your data!).****