Until now, only a limited number of algorithms on a limited number of data sets are available. If you have or know of any additions, please let me know.
You can browse the results per data set or per method. The first shows the results of all methods that are available for a particular data set. The second shows the results of one particular method on all data sets.
Methods:
— White-Patch
— Shades-of-Grey
— General Grey-World
— 1st-order Grey-Edge
— 2nd-order Grey-Edge
— Gamut Mapping
— Spatial Correlations
— Bayesian Color Constancy
— Regression (SVR)
— Inverse Intensity Chromaticity Space
— Color Constancy using High-Level Visual Information
— Color Constancy using Natural Image Statistics
— CART-based Combination
— Weighted Grey-Edge
— Exemplar-Based Color Constancy
— Various Univ. Zagreb methods
— Using CNNs
Grey-World
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Laboratory | 9.8o | 7.0o | 7.6o | 37.3o | |
SFU Grey-ball (Original) | 7.9o | 7.0o | 7.1o | 48.1o | |
SFU Grey-ball (Linear) | 13.0o | 11.0o | 11.5o | 63.0o | |
Color-checker (Original) | 9.8o | 7.4o | 8.2o | 46.0o | |
Color-checker (by Shi) | 6.4o | 6.3o | 6.3o | 24.8o |
White-Patch
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Laboratory | 9.1o | 6.5o | 7.5o | 36.2o | |
SFU Grey-ball (Original) | 6.8o | 5.3o | 5.8o | 38.7o | |
SFU Grey-ball (Linear) | 12.7o | 10.5o | 11.3o | 46.5o | |
Color-checker (Original) | 8.1o | 6.0o | 6.4o | 36.3o | |
Color-checker (by Shi) | 7.6o | 5.7o | 6.4o | 40.6o |
Shades-of-Grey
The mentioned performance for every data set is with the optimal settings, which can differ per data set. For a full overview of the performance of different parameter settings, just download the results for every data set.
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Laboratory | 6.4o | 3.7o | 4.6o | 29.6o | |
SFU Grey-ball (Original) | 6.1o | 5.3o | 5.5o | 41.2o | |
SFU Grey-ball (Linear) | 11.6o | 9.7o | 10.2o | 58.1o | |
Color-checker (Original) | 7.0o | 5.3o | 5.6o | 36.6o | |
Color-checker (by Shi) | 4.9o | 4.0o | 4.2o | 22.4o |
General Grey-World
The mentioned performance for every data set is with the optimal settings, which can differ per data set. For a full overview of the performance of different parameter settings, just download the results for every data set.
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Laboratory | 5.4o | 3.3o | 3.8o | 28.9o | |
SFU Grey-ball (Original) | 6.1o | 5.3o | 5.5o | 41.2o | |
SFU Grey-ball (Linear) | 11.6o | 9.7o | 10.2o | 58.1o | |
Color-checker (Original) | 7.0o | 5.3o | 5.6o | 36.6o | |
Color-checker (by Shi) | 4.7o | 3.5o | 3.8o | 22.0o |
1st-order Grey-Edge
The mentioned performance for every data set is with the optimal settings, which can differ per data set. For a full overview of the performance of different parameter settings, just download the results for every data set.
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Laboratory | 5.6o | 3.2o | 3.7o | 31.6o | |
SFU Grey-ball (Original) | 5.9o | 4.7o | 5.1o | 41.2o | |
SFU Grey-ball (Linear) | 10.6o | 8.8o | 9.2o | 58.4o | |
Color-checker (Original) | 7.0o | 5.2o | 5.5o | 36.3o | |
Color-checker (by Shi) | 5.3o | 4.5o | 4.7o | 26.4o |
2nd-order Grey-Edge
The mentioned performance for every data set is with the optimal settings, which can differ per data set. For a full overview of the performance of different parameter settings, just download the results for every data set.
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Laboratory | 5.2o | 2.7o | 3.3o | 26.7o | |
SFU Grey-ball (Original) | 6.1o | 4.9o | 5.3o | 41.7o | |
SFU Grey-ball (Linear) | 10.7o | 9.0o | 9.4o | 56.0o | |
Color-checker (Original) | 7.0o | 5.0o | 5.4o | 38.0o | |
Color-checker (by Shi) | 5.1o | 4.4o | 4.6o | 23.9o |
Gamut Mapping
The mentioned performance for every data set is with the optimal settings, which can differ per data set. For a full overview of the performance of different parameter settings, just download the results for every data set.
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Laboratory | 3.6o | 2.1o | 2.4o | 27.1o | |
SFU Grey-ball (Original) | 6.9o | 5.8o | 6.1o | 41.9o | |
SFU Grey-ball (Linear) | 11.8o | 8.9o | 10.0o | 47.5o | |
Color-checker (Original) | 6.9o | 4.9o | 5.2o | 37.1o | |
Color-checker (by Shi) | 4.2o | 2.3o | 2.9o | 24.2o |
Spatial Correlations
The mentioned performance for every data set is with regularization. For a full overview of the performance with and without regularization, just download the results for every data set.
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Laboratory — HeavyTailed-based |
5.6o | 3.5o | 4.3o | 21.6o | |
SFU Grey-ball (Linear) — Gaussian-based |
12.7o | 10.8o | 11.5o | 41.2o | |
— HeavyTailed-based | 10.3o | 8.9o | 9.2o | 53.6o | |
Color-checker (by Shi) — Gaussian-based |
4.0o | 3.1o | 3.3o | 19.8o | |
— HeavyTailed-based | 3.6o | 3.0o | 3.0o | 21.6o |
The results of the Spatial Correlations denoted “Gaussian-based” are computed by Gijsenij et al. using an earlier implementation of the Spatial Correlations method. The results of Spatial Correlations denoted “HeavyTailed-based” is using the newest implementation and can be found in “Color Constancy with Spatio-spectral Statistics”, in IEEE TPAMI. More elaborate results by Chakrabarti et al. can be downloaded here. These results also contain slightly different results for the Grey-Edge-type methods.
Bayesian Color Constancy
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
Color-checker (Original) | 6.7o | 4.7o | 5.0o | 39.4o | |
Color-checker (by Shi) | 4.8o | 3.5o | 3.9o | 24.5o |
Regression (svr)
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Grey-ball (Linear) | 13.1o | 11.2o | 11.8o | 59.6o | |
Color-checker (by Shi) | 8.1o | 6.7o | 7.2o | 32.0o |
Inverse Intensity Chromaticity Space
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Laboratory | 15.5o | 8.2o | 10.7o | 80.9o | |
SFU Grey-ball (Original) | 6.6o | 5.6o | 5.8o | 76.2o | |
SFU Grey-ball (Linear) | 14.7o | 11.0o | 11.6o | 86.8o | |
Color-checker (Original) | 9.7o | 6.0o | 6.7o | 61.3o | |
Color-checker (by Shi) | 13.6o | 13.6o | 13.5o | 56.7o |
Color Constancy using High-Level Visual Information
The mentioned performance for every data set is the combination of bottom-up and top-down approaches. For a full overview of the performance of bottom-up, top-down and the combination of the two, just download the results for every data set.
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Grey-ball (Linear) | 9.7o | 7.7o | 8.2o | 60.0o | |
Color-checker (Original) | 6.4o | 4.5o | 5.0o | 33.6o | |
Color-checker (by Shi) | 3.5o | 2.5o | 2.6o | 25.2o |
Color Constancy using Natural Image Statistics
The mentioned performance for every data set is obtained using cross-validation on all considered methods and classifier-parameters.
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Grey-ball (Original) | 5.2o | 3.9o | 4.3o | 44.5o | |
SFU Grey-ball (Linear) | 9.9o | 7.7o | 8.3o | 56.1o | |
Color-checker (Original) | 6.1o | 4.5o | 4.9o | 36.8o | |
Color-checker (by Shi) | 4.2o | 3.1o | 3.5o | 26.2o |
CART-based Combination
The results denoted “alt. ground truth” are recomputed by Bianco et al. using an alternative ground truth, which can be downloaded together with the results.
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
Color-checker (by Shi) — Selection |
4.5o | 3.4o | 3.6o | 24.7o | |
— Combination | 3.9o | 2.9o | 3.3o | 22.3o | |
Color-checker (by Shi; alt. ground truth) — Selection |
4.2o | 3.2o | 3.4o | 22.7o | |
— Combination | 3.7o | 2.9o | 3.1o | 15.0o |
Weighted Grey-Edge
The results on SFU Grey-Ball (Linear) are calculated on a subset, for computational reasons. The subset is the same as introduced by Bianco et al. in “Improving color constancy using indoor-outdoor image classification”. This subset consists of a predefined train- and testset and can be found here.
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Laboratory (p = 7, ? = 5, ? = 8) |
5.6o | 2.4o | 2.9o | 43.8o | |
SFU Grey-ball (Linear)(SUBSET!) (p = 1, ? = 1, ? = 10) |
10.4o | 8.9o | 9.2o | 50.4o | |
Color-checker (Original) (p = 2, ? = 1, ? = 20) |
6.6o | 4.7o | 5.1o | 44.3o |
Exemplar-Based Color Constancy
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Grey-ball (Original) | 4.4o | 3.4o | 3.7o | 45.6o | |
SFU Grey-ball (Linear) | 8.0o | 6.5o | 6.8o | 53.6o | |
Color-checker (by Shi) | 2.9o | 2.3o | 2.4o | 19.4o |
Various Univ. Zagreb methods
Project page corresponding to these method can be found here.
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
SFU Grey-ball (Original) — ColorCat |
4.2o | 3.2o | 3.5o | 43.7o | |
— SmartColorCat | 4.6o | 3.5o | 3.8o | 46.2o | |
— ColorDog using WP / GW | 5.3o | 3.7o | 4.2o | 46.8o | |
— ColorDog using ColorCat | 4.5o | 2.9o | 3.5o | 46.2o | |
— ColorDog using Sm.ColorCat | 4.8o | 3.1o | 3.7o | 48.7o | |
— ColorAnts | 5.0o | 3.7o | 4.1o | 46.5o | |
SFU Grey-ball (Linear) — ColorCat |
8.7o | 7.1o | 7.4o | 54.4o | |
— SmartColorCat | 8.2o | 6.3o | 6.7o | 54.6o | |
— ColorDog using WP / GW | 10.3o | 7.3o | 8.2o | 53.6o | |
— ColorDog using ColorCat | 8.8o | 6.0o | 7.0o | 54.8o | |
— ColorDog using Sm.ColorCat | 8.5o | 5.6o | 6.6o | 56.2o | |
— ColorAnts | 8.9o | 6.5o | 7.1o | 57.6o |
Using CNNs
Preprint of the article describing this method can be found here.
Data set | Mean error | Median error | Trimean error | Max error | |
---|---|---|---|---|---|
Color Checker (By Shi) — AlexNet+SVR |
4.7o | 3.1o | 3.5o | 29.2o | |
— Deep color constancy | 2.6o | 2.0o | 2.1o | 14.8o | |
Color Checker (by Shi; alt. ground truth) — AlexNet+SVR |
4.9o | 3.1o | 3.6o | 29.1o | |
— Deep color constancy | 2.8o | 2.0o | 2.1o | 18.8o |