<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=ISO-8859-1">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<font face="Dax">Dear Jennifer and James, <br>
<br>
</font>The size file that I generated with my mm5_to_grads.csh is
-><br>
<font face="Dax">[login1 17] /gpfs/projects/XXXXX/XXXXXX/mesoescala/MM5toGrADS
> du -k test.dat <br>
<b>68926752</b> 2013-09-22 11:11 test.dat</font><br>
<br>
I think it can be that grad.exe is bad compiled? Is this file
(test.dat) bad generated? Is it really a problem of file size? how I
fix it?<br>
<font face="Dax">>>>> I'm on a machine that works ->
uname -a<br>
>>>> Linux login1 2.6.16.53-0.16-ppc64 #1 SMP Tue Oct
2 16:57:49 UTC 2007 ppc64 ppc64 ppc64 GNU/Linux</font><br>
<br>
<font face="Dax"><font face="Dax">> When you are using PDEF, the
xsize and ysize come from the first two args in the PDEF entry.
Here is my estimate of what the file size should be: sfc_vars *
x * y * t * 4 bytes = 11* 60 * 60 * 1036 * 4 = 164102400<br>
> plus<br>
> z-varying-vars * z * x * y * t * 4 bytes = 22 * 25 * 60 *60
* 1036 * 4 = 8205120000<br>
> equals 8369222400 bytes. <br>
</font></font><font face="Dax"><font face="Dax"><br>
I paste another GrADS descriptor file, sorry.<br>
</font></font><font face="Dax">I can see the data well, until the
time of step 1064 (set t 1064, then 'd t' it`s ok), but when i
exceeded from 1064 time of step gives me that error ...<br>
<br>
</font><font face="Dax"><font face="Dax"><font face="Dax"><i><font
color="#006600">ga-> set t <b>1065</b><br>
Time values set: 2012:2:15:8 2012:2:15:8 <br>
ga-> d t<br>
Notice: Automatic Grid Interpolation Taking Place<br>
Low Level I/O Error: Seek error on data file <br>
Data file name = test.dat <br>
650 rc=-1 fpos=-2145713296 pfi->fhdr=0<br>
Error occurred when seeking to byte 7081408 <br>
Data Request Error: Error for variable 't'<br>
Error ocurred at column 1<br>
DISPLAY error: Invalid expression <br>
Expression = t</font></i><br>
<br>
</font></font></font><font face="Dax"><font face="Dax"><font
face="Dax"><font face="Dax"><font face="Dax">My full GrADS
descriptor file is OK to </font></font></font></font></font><font
face="Dax"><font face="Dax"><font face="Dax"><font face="Dax"><font
face="Dax"><font face="Dax"><font face="Dax"><font
face="Dax"><b> 8737 </b></font></font></font></font></font></font></font></font><font
face="Dax"><font face="Dax"><font face="Dax"><font face="Dax"><font
face="Dax"><font face="Dax"> time values (one year) </font>-><br>
<br>
</font></font>dset ^test.dat<br>
options big_endian<br>
title MM5 data<br>
undef -9999.<br>
pdef 60 60 lcc 32.63 -112.54 1.00 1.00 30.00
60.00 -110.34 6000. 6000.<br>
xdef 149 linear -112.65 0.0270<br>
ydef 123 linear 32.63 0.0270<br>
zdef 25 levels<br>
0.99689<br>
0.99191<br>
0.98944<br>
0.98818<br>
0.97377<br>
0.94500<br>
0.91000<br>
0.87000<br>
0.82500<br>
0.77500<br>
0.72500<br>
0.67500<br>
0.62500<br>
0.57500<br>
0.52500<br>
0.47500<br>
0.42500<br>
0.37500<br>
0.32500<br>
0.27500<br>
0.22500<br>
0.17500<br>
0.12500<br>
0.07500<br>
0.02500<br>
tdef<b> 8737 </b>linear 00:00Z02JAN2012 60MN<br>
vars 33<br>
rc 0 99 accum conv pcn (cm)<br>
rn 0 99 accum non-c pcn (cm)<br>
ter 0 99 ter elevation (m)<br>
xlat 0 99 cross lat (degree)<br>
xlon 0 99 cross lon (degree)<br>
lu 0 99 land use<br>
t2m 0 99 2 m temperature (K)<br>
q2m 0 99 2m mix ratio (kg/kg)<br>
u10 0 99 10 m u wind (m/sec)<br>
v10 0 99 10 m v wind (m/sec)<br>
pslv 0 99 sea level prs (mb)<br>
u 25 99 u wind (m/s)<br>
v 25 99 v wind (m/s)<br>
w 25 99 vertical vel (m/s)<br>
pp 25 99 prs pert (Pa)<br>
t 25 99 temperature (C)<br>
q 25 99 mixing ratio (kg/kg)<br>
clw 25 99 cloud water (kg/kg)<br>
rnw 25 99 rain water (kg/kg)<br>
rtnd 25 99 rad tend (K/day)<br>
z 25 99 height AGL (m)<br>
h 25 99 geopot height (m)<br>
td 25 99 dewpoint temp (C)<br>
rh 25 99 rel humidity (%)<br>
th 25 99 potential temp (K)<br>
the 25 99 theta-e (K)<br>
prs 25 99 pressure (Pa)<br>
vor 25 99 vorticity (s-1)<br>
pv 25 99 potential vort (pvu)<br>
dbz 25 99 reflectivity (dbz)<br>
div 25 99 divergence (s-1)<br>
dir 25 99 dir (degrees)<br>
tadv 25 99 temp advection (K/s)<br>
endvars<br>
<br>
</font></font><br>
Leopoldo<br>
<br>
<br>
<br>
On Sep 23, 2013, at 3:03 PM, James T. Potemra wrote:<br>
<br>
> <br>
> Leopoldo:<br>
> <br>
> You have a couple problems here. First, your descriptor file
specifies 1036 time values, but you are trying to access t=1064
(?). <br>
You should be sure about the number of time steps in your data
set. <br>
<br>
> Second, as Jennifer suggested, x*y*z*t*4 should be your file
size. In this case you have 22 variables with 25 levels, and 11
with 1; 149 x-points; 123 y-points and 1036 time points. I think
your file should therefore be (22*25+11)*149*123*1036*4 =
426,063,116,368 bytes.<br>
<br>
When you are using PDEF, the xsize and ysize come from the first
two args in the PDEF entry. Here is my estimate of what the file
size should be: <br>
sfc_vars * x * y * t * 4 bytes = 11* 60 * 60 * 1036 * 4 =
164102400<br>
plus<br>
z-varying-vars * z * x * y * t * 4 bytes = 22 * 25 * 60 *60 * 1036
* 4 = 8205120000<br>
equals 8369222400 bytes. <br>
<br>
If you have 1064 time steps instead of 1036 then you would have a
file size of 8595417600 bytes. <br>
<br>
--Jennifer<br>
<br>
<br>
> <br>
> Jim<br>
> <br>
> On 9/23/13 8:24 AM, Leopoldo Alvarez wrote:<br>
>> Hi Jennifer, <br>
>> <br>
>> >> and my data file .dat weighs 32 Gb<br>
>> >A precise file size is required, down to the last
byte. <br>
>> <br>
>> Now my data file .dat weighs 66 Gb<br>
>> 68926752 - 66G 2013-09-22 11:11 test.dat<br>
>> <br>
>> I can see the data well, until the time of step 1064 (set
t 1064, then 'd t' it`s ok), but when i exceeded from 1064 time of
step gives me that error ...<br>
>> <br>
>> My full GrADS descriptor file -><br>
>> <br>
>> dset ^test.dat<br>
>> options big_endian<br>
>> title MM5 data<br>
>> undef -9999.<br>
>> pdef 60 60 lcc 32.63 -112.54 1.00 1.00
30.00 60.00 -110.34 6000. 6000.<br>
>> xdef 149 linear -112.65 0.0270<br>
>> ydef 123 linear 32.63 0.0270<br>
>> zdef 25 levels<br>
>> 0.99689<br>
>> 0.99191<br>
>> 0.98944<br>
>> 0.98818<br>
>> 0.97377<br>
>> 0.94500<br>
>> 0.91000<br>
>> 0.87000<br>
>> 0.82500<br>
>> 0.77500<br>
>> 0.72500<br>
>> 0.67500<br>
>> 0.62500<br>
>> 0.57500<br>
>> 0.52500<br>
>> 0.47500<br>
>> 0.42500<br>
>> 0.37500<br>
>> 0.32500<br>
>> 0.27500<br>
>> 0.22500<br>
>> 0.17500<br>
>> 0.12500<br>
>> 0.07500<br>
>> 0.02500<br>
>> tdef 1036 linear 00:00Z02JAN2012 60MN<br>
>> vars 33<br>
>> rc 0 99 accum conv pcn (cm)<br>
>> rn 0 99 accum non-c pcn (cm)<br>
>> ter 0 99 ter elevation (m)<br>
>> xlat 0 99 cross lat (degree)<br>
>> xlon 0 99 cross lon (degree)<br>
>> lu 0 99 land use<br>
>> t2m 0 99 2 m temperature (K)<br>
>> q2m 0 99 2m mix ratio (kg/kg)<br>
>> u10 0 99 10 m u wind (m/sec)<br>
>> v10 0 99 10 m v wind (m/sec)<br>
>> pslv 0 99 sea level prs (mb)<br>
>> u 25 99 u wind (m/s)<br>
>> v 25 99 v wind (m/s)<br>
>> w 25 99 vertical vel (m/s)<br>
>> pp 25 99 prs pert (Pa)<br>
>> t 25 99 temperature (C)<br>
>> q 25 99 mixing ratio (kg/kg)<br>
>> clw 25 99 cloud water (kg/kg)<br>
>> rnw 25 99 rain water (kg/kg)<br>
>> rtnd 25 99 rad tend (K/day)<br>
>> z 25 99 height AGL (m)<br>
>> h 25 99 geopot height (m)<br>
>> td 25 99 dewpoint temp (C)<br>
>> rh 25 99 rel humidity (%)<br>
>> th 25 99 potential temp (K)<br>
>> the 25 99 theta-e (K)<br>
>> prs 25 99 pressure (Pa)<br>
>> vor 25 99 vorticity (s-1)<br>
>> pv 25 99 potential vort (pvu)<br>
>> dbz 25 99 reflectivity (dbz)<br>
>> div 25 99 divergence (s-1)<br>
>> dir 25 99 dir (degrees)<br>
>> tadv 25 99 temp advection (K/s)<br>
>> endvars<br>
>> <br>
>> <br>
>> El 21/09/13 09:35, Leopoldo Alvarez escribió:<br>
>>> Hi Jennifer, <br>
>>> <br>
>>> My binary data grad.exe file is 210 Kb. and data file
.dat weighs 32 Gb.<br>
>>> xsize*ysize*zsize*tsize*esize*4 , Where I see these
parameters? i don´t know how to fix it, where ?, I need to
recompile ?.<br>
>>> <br>
>>> best regards, <br>
>>> <br>
>>> Leopoldo ÁLVAREZ<br>
>>> Tenerife - Canary Islands<br>
>>> <br>
>>> <br>
>>> <br>
>>> <br>
>>> El 20/09/13 23:13, Leopoldo Alvarez escribió:<br>
>>>> Hi jennifer, <br>
>>>> <br>
>>>> I am running a script (nuevo.gs) to extract info
domain mm5 model data. I use GrADS 2.0.2 version. I use 'options
big_endian' but my data file weighs 32 GB and<br>
>>>> shows multiple mutiple on screen- -><br>
>>>> <br>
>>>> Low Level I/O Error: Seek error on data file <br>
>>>> Data file name = test.dat <br>
>>>> 650 rc=-1 fpos=-172300 pfi->fhdr=0<br>
>>>> <br>
>>>> I think the problem is when running the
mm5_to_grads.csh and creates the .ctl and .dat and not script. I
can see the data well, until the time of step 1062 (set t 1062,
then 'd t' it`s ok), but when i exceeded from 1062 time of step
gives me that error ... How i can run my script saving this
problem???. One clue
<a class="moz-txt-link-freetext" href="http://gradsusr.org/pipermail/gradsusr/2008-April/006883.html">http://gradsusr.org/pipermail/gradsusr/2008-April/006883.html</a><br>
>>>> <br>
>>>> I'm on a machine that works -> uname -a<br>
>>>> Linux login1 2.6.16.53-0.16-ppc64 #1 SMP Tue Oct
2 16:57:49 UTC 2007 ppc64 ppc64 ppc64 GNU/Linux<br>
>>>> <br>
>>>> <br>
>>>> nuevo.gs script<br>
>>>> ***************<br>
>>>> ***************<br>
>>>> 'set lon -110.1829'<br>
>>>> 'set lat 34.6518'<br>
>>>> 'set lev 0.99199'<br>
>>>> <br>
>>>> #8737<br>
>>>> timeend = 4198<br>
>>>> i = 1<br>
>>>> while(i <= timeend)<br>
>>>> 'set t 'i''<br>
>>>> 'q time'<br>
>>>> timehr = substr(result, 8, 3)<br>
>>>> timedy = substr(result, 11, 2)<br>
>>>> timemo = substr(result, 13, 3)<br>
>>>> timeyr = substr(result, 16, 4)<br>
>>>> <br>
>>>> #velocidad viento<br>
>>>> 'tg1=mag(u,v)'<br>
>>>> 'd tg1'<br>
>>>> a.nr1 = subwrd(result,4)<br>
>>>> #direccion viento<br>
>>>> 'd dir'<br>
>>>> a.nr11 = subwrd(result,10)<br>
>>>> # tv de Jeffrey iowa<br>
>>>> 'tv=t+t*0.61*q'<br>
>>>> 'rho=prs/(286.9*tv)'<br>
>>>> 'd rho'<br>
>>>> a.nr = subwrd(result,4)<br>
>>>> 'd t-273.15'<br>
>>>> a.nr2 = subwrd(result,10)<br>
>>>> 'd rh'<br>
>>>> a.nr3 = subwrd(result,10)<br>
>>>> 'd prs/100'<br>
>>>> a.nr4 = subwrd(result,10)<br>
>>>> <br>
>>>> val = timeyr%"-"%timemo%"-"%timedy"-"%timehr"
"%a.nr1" "%a.nr11" "%a.nr" "%a.nr2" "%a.nr3" "%a.nr4<br>
>>>> rec = write('drylake_80v.txt',val, append)<br>
>>>> i = i + 1<br>
>>>> endwhile<br>
>>>> *******************<br>
>>>> *******************<br>
>>>> <br>
>>>> best regards, <br>
>>>> <br>
>>>> Leopoldo ÁLVAREZ<br>
>>>> Tenerife - Canary Islands<br>
>>> <br>
>> <br>
>> <br>
>> <br>
>> _______________________________________________<br>
>> gradsusr mailing list<br>
>> gradsusr at gradsusr.org<br>
>> <a class="moz-txt-link-freetext" href="http://gradsusr.org/mailman/listinfo/gradsusr">http://gradsusr.org/mailman/listinfo/gradsusr</a><br>
> <br>
> _______________________________________________<br>
> gradsusr mailing list<br>
> gradsusr at gradsusr.org<br>
> <a class="moz-txt-link-freetext" href="http://gradsusr.org/mailman/listinfo/gradsusr">http://gradsusr.org/mailman/listinfo/gradsusr</a><br>
<br>
--<br>
Jennifer M. Adams<br>
Center for Ocean-Land-Atmosphere Studies (COLA)<br>
111 Research Hall, Mail Stop 2B3<br>
George Mason University<br>
4400 University Drive<br>
Fairfax, VA 22030 <br>
<br>
</font>
</body>
</html>