Validation process

How to use autovalidation to process validation.

  1. Prepare the files and folders in the new submission’s folder (validation_runs)
    1. Autovalidation code

/home/mitch-a/dmis-projects/fphlm/proc/2015_standards_v6.2/validation_runs/autovalidation

  1. Policy files

/home/mitch-a/dmis-projects/fphlm/proc/2015_standards_v6.2/validation_runs/policies

  1. Claim files

/home/mitch-a/dmis-projects/fphlm/proc/2015_standards_v6.2/validation_runs/claim_file

  1. List of policies you plan to run

/home/mitch-a/dmis-projects/fphlm/proc/2015_standards_v6.2/validation_runs/policies.txt

  1. Update demand surge factors
    1. /home/mitch-a/dmis-projects/fphlm/proc/2015_standards_v6.2/demand_surge_factors/catfundPR2007_v6.2_validation_ds/pr_unmatched/env/Results/simulation_ds_all.txt
    2. [1-11].dat
      1. 1. Andrew
      2. 2. Charley
  • 3. Dennis
  1. 4. Erin
  2. 5. Frances
  3. 6. Ivan
  • 8. Jeanne
  • 9. Katrina
  1. 10. Rita
  2. 11. Wilma
  1. autovalidation/Data/Validation/[*R]/Results/Load_all_correct_V5.0_DS.xls
  1. Edit the configure file (Config.xml
    1. <UserDir>/home/mitch-a/dmis-projects/fphlm/proc/2015_standards_v6.2/validation_runs/20160907_validation_HR/[20160907_HR]</UserDir>
    2. specify the folder does not exist
    3. <CollectionDir>/home/mitch-a/dmis-projects/fphlm/proc/2015_standards_v6.2/validation_runs/policies</CollectionDir>
    4. C points to 1.b
    5. <ClaimDir>/home/mitch-a/dmis-projects/fphlm/proc/2015_standards_v6.2/validation_runs/claim_file</ClaimDir>
    6. E points to 1.c
    7. <SourceFile>/home/mitch-a/dmis-projects/fphlm/proc/2015_standards_v6.2/validation_runs/policies.txt</SourceFile>
    8. G points to 1.d
    9. <PRStart>1</PRStart>

<PREnd>73</PREnd>

<HRStart>86</HRStart>

<HREnd>95</HREnd>

<LRStart>74</LRStart>

<LREnd>85</LREnd>

  1. txt should be ordered continuously for each policy type (PR policies, HR policies, and LR policies)
  1. Edit WSCSetup.xml
    1. <WSCRoot>/home/mitch-a/dmis-projects/fphlm/proc/2015_standards_v6.2/validation_runs/20160907_validation_HR/[20160907_HR]/WSC</WSCRoot>
    2. Same folder as specified in configure.xml and add ‘/WSC’ at the end
    3. <RoughTiles>/home/mitch-a/dmis-projects/fphlm/proc/2011_standards_v5.0/met/20120702_filesSentByDrCocke/code.20120702/rough_popwt_2012</RoughTiles>
    4. <DistanceFolder>/home/mitch-a/dmis-projects/fphlm/proc/2011_standards_v5.0/met/20120702_filesSentByDrCocke/code.20120702/distance_popwt_2012</DistanceFolder>
    5. <SwathFiles>/home/mitch-a/dmis-projects/fphlm/proc/2013_standards_v6.0/met/swath_files/baseset_20120806_validation_storms_swaths</SwathFiles>
  2. Edit ILMSetup.xml
    1. <PRFLAG>0</PRFLAG>

<HRFLAG>1</HRFLAG>

<LRFLAG>1</LRFLAG>

  1. Map with the index specified in configure. The java program will provide the options for 1 flag only.
  2. <Matrices>/home/mitch-a/dmis-projects/fphlm/proc/2015_standards_v6.2/data/matrices_curves/v6.2_pr_matrices/</Matrices>
  3. Update matrices for PR, HR, and LR
  1. ./autovalid.sh
    1. Select available option (E.g., process PR policies)
    2. Start with manipulate the running environment.
AutoDataValidation

1. Program Path:
/home/mitch-a/dmis-projects/fphlm/proc/2015_standards_v6.2/validation_runs/autovalidation

2. Configures:

2.1 Config.xml

Keep all the paths not change, except:

UserDir:The directory you create for run validation
CollectionDir: The directory of policies
ClaimDir: The directory of claim files
SourceFile: The list of policy names
UserFileName: Same as the name of SourceFile
PRStart, PREnd, HRStart, HREnd, LRStart, LREnd: the starting and end line number in the source file

2.2 ILMSetup.xml

EmailToNotify: input your email
PRFlag, HRFlag, LRFlag: Set up the type of validation you want to run
Matrices: Update matrices directory for each submission
No Demand Surge applied during ILM
PR policy flag set to 0

2.3 WSCSetup.xml

WSCRoot: <The directory you create for running validation>/WSC
EmailToNotify: input your email
check RoughTiles, DistanceFolder, SwathFiles for each submission

3. Update demand surge factors in Load_all_correct_V5.0_DS.xls using corresponding wind index (last submission examples)

/home/mitch-a/dmis-projects/fphlm/proc/<2013_standards_v6.0>/demand_surge_factors/catfundPR2007_v6.0validation_ds/pr_unmatched/env/Winds

and then find the corresponding factors for each storm in the file:

/home/mitch-a/dmis-projects/fphlm/proc/<2013_standards_v6.0>/demand_surge_factors/catfundPR2007_v6.0validation_ds/pr_unmatched/env/Results/simulation_ds_all.txt 

Post processing manually:

(1)run combine result to get CR combine result, check corresponding files to add missing companies.
(2)use template to create form S4, validation results
/home/mitch-a/dmis-projects/fphlm/proc/2015_standards_v6.2/forms/s4
validation PR: update sheet1, Loss Data Complete, and Loss Data
validation CR: update both sheets
formS4 temp and plot:template for PR and CR plots using highlighted company files
update formS4 using corresponding data

Download PDF
Sidebar