<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=ISO-8859-1">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<font face="Dax">Jennifer, <br>
<br>
I'm going to make climatic modeling (>30 years) and I can not
be cutting files for years, buff ... it should work for powerpc
with appropriate arguments ... Can be compiled with gfortran
compiler?<br>
This morning I opened a file of 7.7 Gb...<br>
<br>
Leopoldo<br>
</font>
<div class="moz-forward-container"><br>
<br>
-------- Mensaje original --------
<table class="moz-email-headers-table" border="0" cellpadding="0"
cellspacing="0">
<tbody>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">Asunto:
</th>
<td>[gradsusr] Low Level I/O Error: Seek error on data file
[GrADS] -</td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">Fecha: </th>
<td>Tue, 24 Sep 2013 15:02:30 +0100</td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">De: </th>
<td>Leopoldo Alvarez <a class="moz-txt-link-rfc2396E" href="mailto:lap.bolsa@gmail.com"><lap.bolsa@gmail.com></a></td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">Para: </th>
<td><a class="moz-txt-link-abbreviated" href="mailto:gradsusr@gradsusr.org">gradsusr@gradsusr.org</a></td>
</tr>
</tbody>
</table>
<br>
<br>
<meta http-equiv="content-type" content="text/html;
charset=ISO-8859-1">
<font face="Dax">Dear Jennifer, <br>
<br>
Now I'm more confused because I was able to open a file of 7.7
Gb<br>
8173088 - 7.8G 2013-09-20 09:57 test.dat<br>
Why I can not open the other file ???<br>
</font><font face="Dax"><font face="Dax"><br>
My full GrADS descriptor file is (similar) -><br>
<br>
</font>dset ^test.dat<br>
options big_endian<br>
title MM5 data<br>
undef -9999.<br>
pdef 60 60 lcc 32.63 -112.54 1.00 1.00 30.00
60.00 -110.34 6000. 6000.<br>
xdef 149 linear -112.65 0.0270<br>
ydef 123 linear 32.63 0.0270<br>
zdef 25 levels<br>
0.99689<br>
0.99191<br>
0.98944<br>
0.98818<br>
0.97377<br>
0.94500<br>
0.91000<br>
0.87000<br>
0.82500<br>
0.77500<br>
0.72500<br>
0.67500<br>
0.62500<br>
0.57500<br>
0.52500<br>
0.47500<br>
0.42500<br>
0.37500<br>
0.32500<br>
0.27500<br>
0.22500<br>
0.17500<br>
0.12500<br>
0.07500<br>
0.02500<br>
tdef 1036 linear 00:00Z02JAN2012 60MN<br>
vars 33<br>
rc 0 99 accum conv pcn (cm)<br>
rn 0 99 accum non-c pcn (cm)<br>
ter 0 99 ter elevation (m)<br>
xlat 0 99 cross lat (degree)<br>
xlon 0 99 cross lon (degree)<br>
lu 0 99 land use<br>
t2m 0 99 2 m temperature (K)<br>
q2m 0 99 2m mix ratio (kg/kg)<br>
u10 0 99 10 m u wind (m/sec)<br>
v10 0 99 10 m v wind (m/sec)<br>
pslv 0 99 sea level prs (mb)<br>
u 25 99 u wind (m/s)<br>
v 25 99 v wind (m/s)<br>
w 25 99 vertical vel (m/s)<br>
pp 25 99 prs pert (Pa)<br>
t 25 99 temperature (C)<br>
q 25 99 mixing ratio (kg/kg)<br>
clw 25 99 cloud water (kg/kg)<br>
rnw 25 99 rain water (kg/kg)<br>
rtnd 25 99 rad tend (K/day)<br>
z 25 99 height AGL (m)<br>
h 25 99 geopot height (m)<br>
td 25 99 dewpoint temp (C)<br>
rh 25 99 rel humidity (%)<br>
th 25 99 potential temp (K)<br>
the 25 99 theta-e (K)<br>
prs 25 99 pressure (Pa)<br>
vor 25 99 vorticity (s-1)<br>
pv 25 99 potential vort (pvu)<br>
dbz 25 99 reflectivity (dbz)<br>
div 25 99 divergence (s-1)<br>
dir 25 99 dir (degrees)<br>
tadv 25 99 temp advection (K/s)<br>
endvars<br>
<br>
Leopoldo<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
Dear Jennifer,<br>
<br>
I don´t know how to fix it... :-( mmmh<br>
<br>
ga-> q config<br>
Config: v2.0.2 big-endian readline<br>
Grid Analysis and Display System (GrADS) Version 2.0.2<br>
Copyright (c) 1988-2011 by Brian Doty and the<br>
Institute for Global Environment and Society (IGES)<br>
This program is distributed WITHOUT ANY WARRANTY<br>
See file COPYRIGHT for more information.<br>
<br>
Built Thu Sep 5 12:08:35 BST 2013 for
powerpc64-unknown-linux-gnu<br>
<br>
This version of GrADS has been configured with the following
options:<br>
o Built on a BIG ENDIAN machine<br>
o Athena Widget GUI DISABLED<br>
o Command line editing ENABLED<br>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://tiswww.case.edu/php/chet/readline/rltop.html">http://tiswww.case.edu/php/chet/readline/rltop.html</a><br>
o printim command DISABLED<br>
o GRIB2 interface DISABLED<br>
o NetCDF interface DISABLED<br>
o OPeNDAP gridded data interface DISABLED<br>
o OPeNDAP station data interface DISABLED<br>
o HDF4 and HDF5 interfaces DISABLED<br>
o GeoTIFF and KML/TIFF output DISABLED<br>
o KML contour output ENABLED<br>
o Shapefile interface DISABLED<br>
<br>
For additional information please consult <a
moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://iges.org/grads">http://iges.org/grads</a><br>
<br>
Leopoldo ÁLVAREZ<br>
<br>
<br>
<br>
<br>
<br>
Here the configuration to compile for power pc that I used -><br>
grep Linux .tmpfile ; \<br>
if [ $$? = 0 ]; then echo "Compiling for PowerPC" <br>
; \<br>
( $(CD) src ; $(MAKE)
all \<br>
"RM = $(RM)"
"RM_LIST =<br>
$(RM_LIST)" \<br>
"LN = $(LN)"
"MACH =<br>
IBM" \<br>
"MAKE = $(MAKE)"
"CPP =<br>
/lib/cpp" \<br>
"CPPFLAGS = -I. -C -P -DIBM -DBIT32<br>
-traditional" \<br>
"FC = xlf90 " "FCFLAGS =
-qfree=f90<br>
-qlanglvl=90pure -I../util" \<br>
"LDOPTIONS = "
"CFLAGS = -I.<br>
-DUNDERSCORE" \<br>
"LOCAL_LIBRARIES= " ) ; \<br>
<br>
Leopoldo<br>
<br>
<br>
El 23/09/13 21:35, Leopoldo Alvarez escribió:<br>
> Dear Jennifer and James,<br>
><br>
> The size file that I generated with my mm5_to_grads.csh
is -><br>
> [login1 17]
/gpfs/projects/XXXXX/XXXXXX/mesoescala/MM5toGrADS > du -k<br>
> test.dat<br>
> *68926752* 2013-09-22 11:11 test.dat<br>
><br>
> I think it can be that grad.exe is bad compiled? Is this
file<br>
> (test.dat) bad generated? Is it really a problem of file
size? how I<br>
> fix it?<br>
> >>>> I'm on a machine that works -> uname
-a<br>
> >>>> Linux login1 2.6.16.53-0.16-ppc64 #1 SMP
Tue Oct 2 16:57:49 UTC<br>
> 2007 ppc64 ppc64 ppc64 GNU/Linux<br>
><br>
> > When you are using PDEF, the xsize and ysize come
from the first two<br>
> args in the PDEF entry. Here is my estimate of what the
file size<br>
> should be: sfc_vars * x * y * t * 4 bytes = 11* 60 * 60 *
1036 * 4 =<br>
> 164102400<br>
> > plus<br>
> > z-varying-vars * z * x * y * t * 4 bytes = 22 * 25 *
60 *60 * 1036 *<br>
> 4 = 8205120000<br>
> > equals 8369222400 bytes.<br>
><br>
> I paste another GrADS descriptor file, sorry.<br>
> I can see the data well, until the time of step 1064 (set
t 1064, then<br>
> 'd t' it`s ok), but when i exceeded from 1064 time of step
gives me<br>
> that error ...<br>
><br>
> /ga-> set t *1065*<br>
> Time values set: 2012:2:15:8 2012:2:15:8<br>
> ga-> d t<br>
> Notice: Automatic Grid Interpolation Taking Place<br>
> Low Level I/O Error: Seek error on data file<br>
> Data file name = test.dat<br>
> 650 rc=-1 fpos=-2145713296 pfi->fhdr=0<br>
> Error occurred when seeking to byte 7081408<br>
> Data Request Error: Error for variable 't'<br>
> Error ocurred at column 1<br>
> DISPLAY error: Invalid expression<br>
> Expression = t/<br>
><br>
> My full GrADS descriptor file is OK to *8737 *time values
(one year) -><br>
><br>
> dset ^test.dat<br>
> options big_endian<br>
> title MM5 data<br>
> undef -9999.<br>
> pdef 60 60 lcc 32.63 -112.54 1.00 1.00 30.00
60.00<br>
> -110.34 6000. 6000.<br>
> xdef 149 linear -112.65 0.0270<br>
> ydef 123 linear 32.63 0.0270<br>
> zdef 25 levels<br>
> 0.99689<br>
> 0.99191<br>
> 0.98944<br>
> 0.98818<br>
> 0.97377<br>
> 0.94500<br>
> 0.91000<br>
> 0.87000<br>
> 0.82500<br>
> 0.77500<br>
> 0.72500<br>
> 0.67500<br>
> 0.62500<br>
> 0.57500<br>
> 0.52500<br>
> 0.47500<br>
> 0.42500<br>
> 0.37500<br>
> 0.32500<br>
> 0.27500<br>
> 0.22500<br>
> 0.17500<br>
> 0.12500<br>
> 0.07500<br>
> 0.02500<br>
> tdef*8737 *linear 00:00Z02JAN2012 60MN<br>
> vars 33<br>
> rc 0 99 accum conv pcn (cm)<br>
> rn 0 99 accum non-c pcn (cm)<br>
> ter 0 99 ter elevation (m)<br>
> xlat 0 99 cross lat (degree)<br>
> xlon 0 99 cross lon (degree)<br>
> lu 0 99 land use<br>
> t2m 0 99 2 m temperature (K)<br>
> q2m 0 99 2m mix ratio (kg/kg)<br>
> u10 0 99 10 m u wind (m/sec)<br>
> v10 0 99 10 m v wind (m/sec)<br>
> pslv 0 99 sea level prs (mb)<br>
> u 25 99 u wind (m/s)<br>
> v 25 99 v wind (m/s)<br>
> w 25 99 vertical vel (m/s)<br>
> pp 25 99 prs pert (Pa)<br>
> t 25 99 temperature (C)<br>
> q 25 99 mixing ratio (kg/kg)<br>
> clw 25 99 cloud water (kg/kg)<br>
> rnw 25 99 rain water (kg/kg)<br>
> rtnd 25 99 rad tend (K/day)<br>
> z 25 99 height AGL (m)<br>
> h 25 99 geopot height (m)<br>
> td 25 99 dewpoint temp (C)<br>
> rh 25 99 rel humidity (%)<br>
> th 25 99 potential temp (K)<br>
> the 25 99 theta-e (K)<br>
> prs 25 99 pressure (Pa)<br>
> vor 25 99 vorticity (s-1)<br>
> pv 25 99 potential vort (pvu)<br>
> dbz 25 99 reflectivity (dbz)<br>
> div 25 99 divergence (s-1)<br>
> dir 25 99 dir (degrees)<br>
> tadv 25 99 temp advection (K/s)<br>
> endvars<br>
><br>
><br>
> Leopoldo<br>
><br>
><br>
><br>
> On Sep 23, 2013, at 3:03 PM, James T. Potemra wrote:<br>
><br>
> ><br>
> > Leopoldo:<br>
> ><br>
> > You have a couple problems here. First, your
descriptor file<br>
> specifies 1036 time values, but you are trying to access
t=1064 (?).<br>
> You should be sure about the number of time steps in your
data set.<br>
><br>
> > Second, as Jennifer suggested, x*y*z*t*4 should be
your file size.<br>
> In this case you have 22 variables with 25 levels, and 11
with 1; 149<br>
> x-points; 123 y-points and 1036 time points. I think your
file should<br>
> therefore be (22*25+11)*149*123*1036*4 = 426,063,116,368
bytes.<br>
><br>
> When you are using PDEF, the xsize and ysize come from the
first two<br>
> args in the PDEF entry. Here is my estimate of what the
file size<br>
> should be:<br>
> sfc_vars * x * y * t * 4 bytes = 11* 60 * 60 * 1036 * 4 =
164102400<br>
> plus<br>
> z-varying-vars * z * x * y * t * 4 bytes = 22 * 25 * 60
*60 * 1036 * 4<br>
> = 8205120000<br>
> equals 8369222400 bytes.<br>
><br>
> If you have 1064 time steps instead of 1036 then you would
have a file<br>
> size of 8595417600 bytes.<br>
><br>
> --Jennifer<br>
><br>
><br>
> ><br>
> > Jim<br>
> ><br>
> > On 9/23/13 8:24 AM, Leopoldo Alvarez wrote:<br>
> >> Hi Jennifer,<br>
> >><br>
> >> >> and my data file .dat weighs 32 Gb<br>
> >> >A precise file size is required, down to the
last byte.<br>
> >><br>
> >> Now my data file .dat weighs 66 Gb<br>
> >> 68926752 - 66G 2013-09-22 11:11 test.dat<br>
> >><br>
> >> I can see the data well, until the time of step
1064 (set t 1064,<br>
> then 'd t' it`s ok), but when i exceeded from 1064 time of
step gives<br>
> me that error ...<br>
> >><br>
> >> My full GrADS descriptor file -><br>
> >><br>
> >> dset ^test.dat<br>
> >> options big_endian<br>
> >> title MM5 data<br>
> >> undef -9999.<br>
> >> pdef 60 60 lcc 32.63 -112.54 1.00
1.00 30.00 60.00<br>
> -110.34 6000. 6000.<br>
> >> xdef 149 linear -112.65 0.0270<br>
> >> ydef 123 linear 32.63 0.0270<br>
> >> zdef 25 levels<br>
> >> 0.99689<br>
> >> 0.99191<br>
> >> 0.98944<br>
> >> 0.98818<br>
> >> 0.97377<br>
> >> 0.94500<br>
> >> 0.91000<br>
> >> 0.87000<br>
> >> 0.82500<br>
> >> 0.77500<br>
> >> 0.72500<br>
> >> 0.67500<br>
> >> 0.62500<br>
> >> 0.57500<br>
> >> 0.52500<br>
> >> 0.47500<br>
> >> 0.42500<br>
> >> 0.37500<br>
> >> 0.32500<br>
> >> 0.27500<br>
> >> 0.22500<br>
> >> 0.17500<br>
> >> 0.12500<br>
> >> 0.07500<br>
> >> 0.02500<br>
> >> tdef 1036 linear 00:00Z02JAN2012 60MN<br>
> >> vars 33<br>
> >> rc 0 99 accum conv pcn (cm)<br>
> >> rn 0 99 accum non-c pcn (cm)<br>
> >> ter 0 99 ter elevation (m)<br>
> >> xlat 0 99 cross lat (degree)<br>
> >> xlon 0 99 cross lon (degree)<br>
> >> lu 0 99 land use<br>
> >> t2m 0 99 2 m temperature (K)<br>
> >> q2m 0 99 2m mix ratio (kg/kg)<br>
> >> u10 0 99 10 m u wind (m/sec)<br>
> >> v10 0 99 10 m v wind (m/sec)<br>
> >> pslv 0 99 sea level prs (mb)<br>
> >> u 25 99 u wind (m/s)<br>
> >> v 25 99 v wind (m/s)<br>
> >> w 25 99 vertical vel (m/s)<br>
> >> pp 25 99 prs pert (Pa)<br>
> >> t 25 99 temperature (C)<br>
> >> q 25 99 mixing ratio (kg/kg)<br>
> >> clw 25 99 cloud water (kg/kg)<br>
> >> rnw 25 99 rain water (kg/kg)<br>
> >> rtnd 25 99 rad tend (K/day)<br>
> >> z 25 99 height AGL (m)<br>
> >> h 25 99 geopot height (m)<br>
> >> td 25 99 dewpoint temp (C)<br>
> >> rh 25 99 rel humidity (%)<br>
> >> th 25 99 potential temp (K)<br>
> >> the 25 99 theta-e (K)<br>
> >> prs 25 99 pressure (Pa)<br>
> >> vor 25 99 vorticity (s-1)<br>
> >> pv 25 99 potential vort (pvu)<br>
> >> dbz 25 99 reflectivity (dbz)<br>
> >> div 25 99 divergence (s-1)<br>
> >> dir 25 99 dir (degrees)<br>
> >> tadv 25 99 temp advection (K/s)<br>
> >> endvars<br>
> >><br>
> >><br>
> >> El 21/09/13 09:35, Leopoldo Alvarez escribió:<br>
> >>> Hi Jennifer,<br>
> >>><br>
> >>> My binary data grad.exe file is 210 Kb. and
data file .dat weighs<br>
> 32 Gb.<br>
> >>> xsize*ysize*zsize*tsize*esize*4 , Where I see
these parameters? i<br>
> don´t know how to fix it, where ?, I need to recompile ?.<br>
> >>><br>
> >>> best regards,<br>
> >>><br>
> >>> Leopoldo ÁLVAREZ<br>
> >>> Tenerife - Canary Islands<br>
> >>><br>
> >>><br>
> >>><br>
> >>><br>
> >>> El 20/09/13 23:13, Leopoldo Alvarez escribió:<br>
> >>>> Hi jennifer,<br>
> >>>><br>
> >>>> I am running a script (nuevo.gs) to
extract info domain mm5 model<br>
> data. I use GrADS 2.0.2 version. I use 'options
big_endian' but my<br>
> data file weighs 32 GB and<br>
> >>>> shows multiple mutiple on screen- -><br>
> >>>><br>
> >>>> Low Level I/O Error: Seek error on data
file<br>
> >>>> Data file name = test.dat<br>
> >>>> 650 rc=-1 fpos=-172300 pfi->fhdr=0<br>
> >>>><br>
> >>>> I think the problem is when running the
mm5_to_grads.csh and<br>
> creates the .ctl and .dat and not script. I can see the
data well,<br>
> until the time of step 1062 (set t 1062, then 'd t' it`s
ok), but when<br>
> i exceeded from 1062 time of step gives me that error ...
How i can<br>
> run my script saving this problem???. One clue<br>
> <a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://gradsusr.org/pipermail/gradsusr/2008-April/006883.html">http://gradsusr.org/pipermail/gradsusr/2008-April/006883.html</a><br>
> >>>><br>
> >>>> I'm on a machine that works -> uname
-a<br>
> >>>> Linux login1 2.6.16.53-0.16-ppc64 #1 SMP
Tue Oct 2 16:57:49 UTC<br>
> 2007 ppc64 ppc64 ppc64 GNU/Linux<br>
> >>>><br>
> >>>><br>
> >>>> nuevo.gs script<br>
> >>>> ***************<br>
> >>>> ***************<br>
> >>>> 'set lon -110.1829'<br>
> >>>> 'set lat 34.6518'<br>
> >>>> 'set lev 0.99199'<br>
> >>>><br>
> >>>> #8737<br>
> >>>> timeend = 4198<br>
> >>>> i = 1<br>
> >>>> while(i <= timeend)<br>
> >>>> 'set t 'i''<br>
> >>>> 'q time'<br>
> >>>> timehr = substr(result, 8, 3)<br>
> >>>> timedy = substr(result, 11, 2)<br>
> >>>> timemo = substr(result, 13, 3)<br>
> >>>> timeyr = substr(result, 16, 4)<br>
> >>>><br>
> >>>> #velocidad viento<br>
> >>>> 'tg1=mag(u,v)'<br>
> >>>> 'd tg1'<br>
> >>>> a.nr1 = subwrd(result,4)<br>
> >>>> #direccion viento<br>
> >>>> 'd dir'<br>
> >>>> a.nr11 = subwrd(result,10)<br>
> >>>> # tv de Jeffrey iowa<br>
> >>>> 'tv=t+t*0.61*q'<br>
> >>>> 'rho=prs/(286.9*tv)'<br>
> >>>> 'd rho'<br>
> >>>> a.nr = subwrd(result,4)<br>
> >>>> 'd t-273.15'<br>
> >>>> a.nr2 = subwrd(result,10)<br>
> >>>> 'd rh'<br>
> >>>> a.nr3 = subwrd(result,10)<br>
> >>>> 'd prs/100'<br>
> >>>> a.nr4 = subwrd(result,10)<br>
> >>>><br>
> >>>> val =
timeyr%"-"%timemo%"-"%timedy"-"%timehr" "%a.nr1" "%a.nr11"<br>
> "%a.nr" "%a.nr2" "%a.nr3" "%a.nr4<br>
> >>>> rec = write('drylake_80v.txt',val,
append)<br>
> >>>> i = i + 1<br>
> >>>> endwhile<br>
> >>>> *******************<br>
> >>>> *******************<br>
> >>>><br>
> >>>> best regards,<br>
> >>>><br>
> >>>> Leopoldo ÁLVAREZ<br>
> >>>> Tenerife - Canary Islands<br>
> >>><br>
> >><br>
> >><br>
> >><br>
> >> _______________________________________________<br>
> >> gradsusr mailing list<br>
> >> gradsusr at gradsusr.org<br>
> >> <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="http://gradsusr.org/mailman/listinfo/gradsusr">http://gradsusr.org/mailman/listinfo/gradsusr</a><br>
> ><br>
> > _______________________________________________<br>
> > gradsusr mailing list<br>
> > gradsusr at gradsusr.org<br>
> > <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="http://gradsusr.org/mailman/listinfo/gradsusr">http://gradsusr.org/mailman/listinfo/gradsusr</a><br>
><br>
> --<br>
> Jennifer M. Adams<br>
> Center for Ocean-Land-Atmosphere Studies (COLA)<br>
> 111 Research Hall, Mail Stop 2B3<br>
> George Mason University<br>
> 4400 University Drive<br>
> Fairfax, VA 22030<br>
><br>
<br>
<br>
</font> <br>
</div>
<br>
</body>
</html>