Condo descriptives (mean and std) update - #153
Conversation
…- in 03-evaluate.R will likely need to remove when pushed
|
@TimCookCountyDS 3 things will i'm looking at this
|
Just adding that I like to do both of these things (noting the issue in the comment and linking the PR to the issue using the "development" dropdown)! Though I agree with Billy that linking the issue is most important in cases where there's a 1:1 relationship between a PR and an issue. |
wrridgeway
left a comment
There was a problem hiding this comment.
Thanks for adding this for condos!
| # Increase the max size of globals exported to future workers, │ | ||
| # since rlang │ | ||
| # condition-handling functions can be large │ | ||
|
|
There was a problem hiding this comment.
Is this documenting something that's actually happening? If it is, could we clean this formatting up?
There was a problem hiding this comment.
O weird, I thought I removed that before I pushed
There was a problem hiding this comment.
It was just a note to self, will cut it out
Will do- for pre-commit: when I run pre-commit on the server (before I push), I use pre-commit run. Should I be using a different command? |
|
For me after I've installed the pre-commit git hooks ( Is that right @jeancochrane ? |
got - it- done :) |
--- squash and merge, @wrridgeway ? |
Correct! We mention this in our pre-commit docs, though perhaps it could be called out more explicitly, since I've noticed it's a step that may people miss: https://github.com/ccao-data/wiki/blob/master/How-To/Use-pre-commit-to-lint-and-format-your-code.md#installing-pre-commit |
Thanks! I think my mental model was slightly off when I read those- |
|
@Damonamajor would you mind running this with build-and-run model and giving the outputs a quick once over? (I did + checked that the additional columns were added + populated for the new model run- see comment above for new columns and gave the model report a quick once over)- but would you mind a quick spot check just in case I missed anything? (not that I expect any problematic changes- but good to have a 2nd set of eyes on it before I merge) |
|
https://github.com/ccao-data/model-condo-avm/actions/runs/24792538947 I presume we expect to see the changes in model.stats (or something like this) on aws and in the performance report? |
I didn't update the performance reports yet- so the main place I've been keeping track of the changes is updates to the model.performance table - If mean and std should also be propagating to stats (and aren't) lmk, and we can think through it - (Mean and std currently follow the exact logic of the other summary stats functions, so wherever those show up, mean and std should as well). |
|
Seems fine to merge after Damon has confirmed the columns appear as expected. |
|
Looks good to me. Just for reference these are the columns which are in the table for but not in
sale_fmv_mean | sale_fmv_sd | sale_fmv_per_sqft_mean | sale_fmv_per_sqft_sd | prior_far_fmv_mean | prior_far_fmv_sd | prior_far_fmv_per_sqft_mean | prior_far_fmv_per_sqft_sd | prior_near_fmv_mean | prior_near_fmv_sd | prior_near_fmv_per_sqft_mean | prior_near_fmv_per_sqft_sd | estimate_fmv_mean | estimate_fmv_sd | estimate_fmv_per_sqft_mean | estimate_fmv_per_sqft_sd |
Model.stats doesn't exist. It's what I was guessing model.performance was called. |
Adds mean and std to the condo summary stats. (See the gen_agg_stats function in pipeline/03-evaluate.R)- Closes issue #147 .
Matches the condo descriptives to those of the Res-val model. (ccao-data/model-res-avm#458).
New outputs can be found in the model performance tables:
(Adding mean and sd to both lists produces 16 new columns in total):
From sum_fns_list:
┌─────────────────────────────────────────────┐
│ New column │
├─────────────────────────────────────────────┤
│ sale_fmv_mean / sale_fmv_sd │
├─────────────────────────────────────────────┤
│ prior_far_fmv_mean / prior_far_fmv_sd │
├─────────────────────────────────────────────┤
│ prior_near_fmv_mean / prior_near_fmv_sd │
├─────────────────────────────────────────────┤
│ estimate_fmv_mean / estimate_fmv_sd │
└─────────────────────────────────────────────┘
From sum_sqft_fns_list:
┌───────────────────────────────────────────────────────────────┐
│ New column │
├───────────────────────────────────────────────────────────────┤
│ sale_fmv_per_sqft_mean / sale_fmv_per_sqft_sd │
├───────────────────────────────────────────────────────────────┤
│ prior_far_fmv_per_sqft_mean / prior_far_fmv_per_sqft_sd │
├───────────────────────────────────────────────────────────────┤
│ prior_near_fmv_per_sqft_mean / prior_near_fmv_per_sqft_sd │
├───────────────────────────────────────────────────────────────┤
│ estimate_fmv_per_sqft_mean / estimate_fmv_per_sqft_sd │
└───────────────────────────────────────