|
1 | | -Solve the warnings issue; right now there is a warning ignore in method/__init__.py: |
2 | | - |
3 | 1 | Add 'platt' to calib options in EMQ? |
4 | 2 |
|
5 | 3 | Allow n_prevpoints in APP to be specified by a user-defined grid? |
6 | 4 |
|
7 | | -Add the fix suggested by Alexander? |
8 | | -"For a more general application, I would maybe first establish a per-class threshold value of plausible prevalence |
| 5 | +Add the fix suggested by Alexander: |
| 6 | + |
| 7 | +For a more general application, I would maybe first establish a per-class threshold value of plausible prevalence |
9 | 8 | based on the number of actual positives and the required sample size; e.g., for sample_size=100 and actual |
10 | 9 | positives [10, 100, 500] -> [0.1, 1.0, 1.0], meaning that class 0 can be sampled at most at 0.1 prevalence, while |
11 | 10 | the others can be sampled up to 1. prevalence. Then, when a prevalence value is requested, e.g., [0.33, 0.33, 0.33], |
12 | 11 | we may either clip each value and normalize (as you suggest for the extreme case, e.g., [0.1, 0.33, 0.33]/sum) or |
13 | | -scale each value by per-class thresholds, i.e., [0.33*0.1, 0.33*1, 0.33*1]/sum." |
| 12 | +scale each value by per-class thresholds, i.e., [0.33*0.1, 0.33*1, 0.33*1]/sum. |
14 | 13 | - This affects LabelledCollection |
15 | 14 | - This functionality should be accessible via sampling protocols and evaluation functions |
16 | 15 |
|
17 | | -- [TODO] document confidence in manuals |
| 16 | +- [TODO] Test the return_type="index" in protocols and finish the "distributing_samples.py" example |
18 | 17 | - [TODO] add ensemble methods SC-MQ, MC-SQ, MC-MQ |
19 | | -- [TODO] add HistNetQ |
20 | 18 | - [TODO] add CDE-iteration and Bayes-CDE methods |
21 | 19 | - [TODO] add Friedman's method and DeBias |
22 | 20 | - [TODO] check ignore warning stuff |
|
0 commit comments