[gradsusr] Combining Multiple .dat files

James T. Potemra jimp at hawaii.edu
Thu Jun 5 14:54:46 EDT 2014


Sara,

How big are these files?  Is it possible your version of GrADS or O/S 
has a file-size limit?  With 84 variables, 2185 time-steps, 27 levels, 
and 426132 lat/lon points you might be reaching some sort of memory limit.

Jim
On 6/4/14 10:17 PM, Sara Fenech wrote:
> Dear all
>
> I am trying to aggregate 4 .dat files using a data descriptor file 
> using  a single DSET entry and setting option to template. I have the 
> following 4 .dat files of hourly data for the corresponding months 
> (2185 datasets in all)
>
> *dom2jun.dat*   (from 00Z01Jun2011 to 23Z30Jun2011) *(720 files)*
> *dom2jul.dat*    (from 00Z01Jul2011 to 23Z30Jul2011) *(720 files)*
> *dom2aug.dat *  (from 00Z31Jul2011 to 23Z29Aug2011) *(720 files)*
> *dom2sept.dat*  (from 00Z30Aug2011 to 00Z31Aug2011) *(25 files)*
>
> Using the following data descriptor file (*dom2JJA.ctl*) I need to 
> open all the .dat files one after the other so as to act as a single 
> file and thus can obtain different parameters for all the time range 
> at once. The only difference between the .dat files is that the time 
> range varies.
>
> The problem is that when I am opening this descriptor file in GrAds 
> and I try to access different parameters, the values are exponentials 
> and do not agree with the values I extract when opening the files 
> individually.
>
> Is there anyone who can spot what I'm doing wrong in my descriptor 
> file please? Thanks a lot and I appreciate all your help
>
> Kind Regards
> Sara
>
> dset ^dom2%ch.dat
> chsub 1 720 jun
> chsub 721 1440 jul
> chsub 1441 2160 aug
> chsub 2161 2185 sep
> options template
> undef 1.e30
> title  OUTPUT FROM WRF V3.2.1 MODEL
> pdef  380 170 lcc  38.429 18.325  190.500   85.500  36.50000  36.50000 
> 16.50000   9600.000   9600.000
> xdef 1068 linear   -4.69692 0.04324324
> ydef  399 linear   28.84252 0.04324324
> zdef   27 linear 1 1
> tdef 2185 linear 00Z01JUN2011 60MN
> VARS   84
> LU_INDEX       1  0  LAND USE CATEGORY (-)
> U             27  0  x-wind component (m s-1)
> V             27  0  y-wind component (m s-1)
> W             27  0  z-wind component (m s-1)
> PH            27  0  perturbation geopotential (m2 s-2)
> PHB           27  0  base-state geopotential (m2 s-2)
> T             27  0  perturbation potential temperature (theta-t0) (K)
> MU             1  0  perturbation dry air mass in column (Pa)
> MUB            1  0  base state dry air mass in column (Pa)
> NEST_POS       1  0  - (-)
> P             27  0  perturbation pressure (Pa)
> PB            27  0  BASE STATE PRESSURE (Pa)
> P_HYD         27  0  hydrostatic pressure (Pa)
> Q2             1  0  QV at 2 M (kg kg-1)
> T2             1  0  TEMP at 2 M (K)
> TH2            1  0  POT TEMP at 2 M (K)
> PSFC           1  0  SFC PRESSURE (Pa)
> U10            1  0  U at 10 M (m s-1)
> V10            1  0  V at 10 M (m s-1)
> QVAPOR        27  0  Water vapor mixing ratio (kg kg-1)
> QCLOUD        27  0  Cloud water mixing ratio (kg kg-1)
> QRAIN         27  0  Rain water mixing ratio (kg kg-1)
> QICE          27  0  Ice mixing ratio (kg kg-1)
> QSNOW         27  0  Snow mixing ratio (kg kg-1)
> QGRAUP        27  0  Graupel mixing ratio (kg kg-1)
> LANDMASK       1  0  LAND MASK (1 FOR LAND, 0 FOR WATER) (-)
> TSLB           2  0  SOIL TEMPERATURE (K)
> SMOIS          2  0  SOIL MOISTURE (m3 m-3)
> SH2O           2  0  SOIL LIQUID WATER (m3 m-3)
> SMCREL         2  0  RELATIVE SOIL MOISTURE (-)
> SEAICE         1  0  SEA ICE FLAG (-)
> XICEM          1  0  SEA ICE FLAG (PREVIOUS STEP) (-)
> SFROFF         1  0  SURFACE RUNOFF (mm)
> UDROFF         1  0  UNDERGROUND RUNOFF (mm)
> IVGTYP         1  0  DOMINANT VEGETATION CATEGORY (-)
> ISLTYP         1  0  DOMINANT SOIL CATEGORY (-)
> VEGFRA         1  0  VEGETATION FRACTION (-)
> GRDFLX         1  0  GROUND HEAT FLUX (W m-2)
> ACGRDFLX       1  0  ACCUMULATED GROUND HEAT FLUX (J m-2)
> SNOW           1  0  SNOW WATER EQUIVALENT (kg m-2)
> SNOWH          1  0  PHYSICAL SNOW DEPTH (m)
> CANWAT         1  0  CANOPY WATER (kg m-2)
> SST            1  0  SEA SURFACE TEMPERATURE (K)
> SSTSK          1  0  SKIN SEA SURFACE TEMPERATURE (K)
> LAI            1  0  Leaf area index (area/area)
> MAPFAC_M       1  0  Map scale factor on mass grid (-)
> MAPFAC_MX      1  0  Map scale factor on mass grid, x direction (-)
> MAPFAC_MY      1  0  Map scale factor on mass grid, y direction (-)
> MF_VX_INV      1  0  Inverse map scale factor on v-grid, x direction (-)
> F              1  0  Coriolis sine latitude term (s-1)
> E              1  0  Coriolis cosine latitude term (s-1)
> SINALPHA       1  0  Local sine of map rotation (-)
> COSALPHA       1  0  Local cosine of map rotation (-)
> HGT            1  0  Terrain Height (m)
> TSK            1  0  SURFACE SKIN TEMPERATURE (K)
> RAINC          1  0  ACCUMULATED TOTAL CUMULUS PRECIPITATION (mm)
> RAINNC         1  0  ACCUMULATED TOTAL GRID SCALE PRECIPITATION (mm)
> SNOWNC         1  0  ACCUMULATED TOTAL GRID SCALE SNOW AND ICE (mm)
> GRAUPELNC      1  0  ACCUMULATED TOTAL GRID SCALE GRAUPEL (mm)
> HAILNC         1  0  ACCUMULATED TOTAL GRID SCALE HAIL (mm)
> CLDFRA        27  0  CLOUD FRACTION (-)
> SWDOWN         1  0  DOWNWARD SHORT WAVE FLUX AT GROUND SURFACE (W m-2)
> GLW            1  0  DOWNWARD LONG WAVE FLUX AT GROUND SURFACE (W m-2)
> OLR            1  0  TOA OUTGOING LONG WAVE (W m-2)
> XLAT           1  0  LATITUDE, SOUTH IS NEGATIVE (degree_north)
> XLONG          1  0  LONGITUDE, WEST IS NEGATIVE (degree_east)
> ALBEDO         1  0  ALBEDO (-)
> ALBBCK         1  0  BACKGROUND ALBEDO (-)
> EMISS          1  0  SURFACE EMISSIVITY (-)
> NOAHRES        1  0  RESIDUAL OF THE NOAH SURFACE ENERGY BUDGET (W m{-2})
> TMN            1  0  SOIL TEMPERATURE AT LOWER BOUNDARY (K)
> XLAND          1  0  LAND MASK (1 FOR LAND, 2 FOR WATER) (-)
> UST            1  0  U* IN SIMILARITY THEORY (m s-1)
> PBLH           1  0  PBL HEIGHT (m)
> HFX            1  0  UPWARD HEAT FLUX AT THE SURFACE (W m-2)
> QFX            1  0  UPWARD MOISTURE FLUX AT THE SURFACE (kg m-2 s-1)
> LH             1  0  LATENT HEAT FLUX AT THE SURFACE (W m-2)
> ACHFX          1  0  ACCUMULATED UPWARD HEAT FLUX AT THE SURFACE (J m-2)
> ACLHF          1  0  ACCUMULATED UPWARD LATENT HEAT FLUX AT THE 
> SURFACE (J m-2)
> SNOWC          1  0  FLAG INDICATING SNOW COVERAGE (1 FOR SNOW COVER) (-)
> SR             1  0  fraction of frozen precipitation (-)
> POTEVP         1  0  accumulated potential evaporation (W m-2)
> SNOPCX         1  0  snow phase change heat flux (W m-2)
> SOILTB         1  0  bottom soil temperature (K)
> ENDVARS
> @ global String comment TITLE =  OUTPUT FROM WRF V3.2.1 MODEL
> @ global String comment START_DATE = 2011-06-01_00:00:00
> @ global String comment SIMULATION_START_DATE = 2011-06-01_00:00:00
> @ global String comment WEST-EAST_GRID_DIMENSION =   381
> @ global String comment SOUTH-NORTH_GRID_DIMENSION =   171
> @ global String comment BOTTOM-TOP_GRID_DIMENSION =    28
> @ global String comment DX =    9600.00
> @ global String comment DY =    9600.00
> @ global String comment GRIDTYPE = C
> @ global String comment DIFF_OPT =     1
> @ global String comment KM_OPT =     4
> @ global String comment DAMP_OPT =     0
> @ global String comment DAMPCOEF =         0.20
> @ global String comment KHDIF =         0.00
> @ global String comment KVDIF =         0.00
> @ global String comment MP_PHYSICS =     6
> @ global String comment RA_LW_PHYSICS =     1
> @ global String comment RA_SW_PHYSICS =     1
> @ global String comment SF_SFCLAY_PHYSICS =     7
> @ global String comment SF_SURFACE_PHYSICS =     7
> @ global String comment BL_PBL_PHYSICS =     7
> @ global String comment CU_PHYSICS =     1
> @ global String comment SURFACE_INPUT_SOURCE =     1
> @ global String comment SST_UPDATE =     0
> @ global String comment GRID_FDDA =     0
> @ global String comment GFDDA_INTERVAL_M =     0
> @ global String comment GFDDA_END_H =     0
> @ global String comment GRID_SFDDA =     0
> @ global String comment SGFDDA_INTERVAL_M =     0
> @ global String comment SGFDDA_END_H =     0
> @ global String comment SF_URBAN_PHYSICS =     0
> @ global String comment FEEDBACK =     0
> @ global String comment SMOOTH_OPTION =     0
> @ global String comment SWRAD_SCAT =         1.00
> @ global String comment W_DAMPING =     0
> @ global String comment MOIST_ADV_OPT =     1
> @ global String comment SCALAR_ADV_OPT =     1
> @ global String comment TKE_ADV_OPT =     1
> @ global String comment DIFF_6TH_OPT =     0
> @ global String comment DIFF_6TH_FACTOR =         0.12
> @ global String comment OBS_NUDGE_OPT =     0
> @ global String comment BUCKET_MM =        -1.00
> @ global String comment BUCKET_J =        -1.00
> @ global String comment PREC_ACC_DT =         0.00
> @ global String comment OMLCALL =     0
> @ global String comment ISFTCFLX =     0
> @ global String comment WEST-EAST_PATCH_START_UNSTAG =     1
> @ global String comment WEST-EAST_PATCH_END_UNSTAG =   380
> @ global String comment WEST-EAST_PATCH_START_STAG =     1
> @ global String comment WEST-EAST_PATCH_END_STAG =   381
> @ global String comment SOUTH-NORTH_PATCH_START_UNSTAG =     1
> @ global String comment SOUTH-NORTH_PATCH_END_UNSTAG =   170
> @ global String comment SOUTH-NORTH_PATCH_START_STAG =     1
> @ global String comment SOUTH-NORTH_PATCH_END_STAG =   171
> @ global String comment BOTTOM-TOP_PATCH_START_UNSTAG =     1
> @ global String comment BOTTOM-TOP_PATCH_END_UNSTAG =    27
> @ global String comment BOTTOM-TOP_PATCH_START_STAG =     1
> @ global String comment BOTTOM-TOP_PATCH_END_STAG =    28
> @ global String comment GRID_ID =     2
> @ global String comment PARENT_ID =     1
> @ global String comment I_PARENT_START =    16
> @ global String comment J_PARENT_START =    18
> @ global String comment PARENT_GRID_RATIO =     5
> @ global String comment DT =      48.00
> @ global String comment CEN_LAT =        38.43
> @ global String comment CEN_LON =        18.33
> @ global String comment TRUELAT1 =        36.50
> @ global String comment TRUELAT2 =        36.50
> @ global String comment MOAD_CEN_LAT =        36.50
> @ global String comment STAND_LON =        16.50
> @ global String comment POLE_LAT =        90.00
> @ global String comment POLE_LON =         0.00
> @ global String comment GMT =       0.00
> @ global String comment JULYR =  2011
> @ global String comment JULDAY =   152
> @ global String comment MAP_PROJ =     1
> @ global String comment MMINLU = USGS
> @ global String comment NUM_LAND_CAT =    24
> @ global String comment ISWATER =    16
> @ global String comment ISLAKE =    -1
> @ global String comment ISICE =    24
> @ global String comment ISURBAN =     1
> @ global String comment ISOILWATER =    14
>
>
>
> _______________________________________________
> gradsusr mailing list
> gradsusr at gradsusr.org
> http://gradsusr.org/mailman/listinfo/gradsusr

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://gradsusr.org/pipermail/gradsusr/attachments/20140605/ad65cea5/attachment-0001.html 


More information about the gradsusr mailing list