[gradsusr] SREF: "Product Definition Template 9 not handled" error message with g2ctl.pl

Thu Oct 6 09:14:41 EDT 2011

Hi, Kevin --
I agree that the SREF files you are trying to read are highly  
pathological. More technical comments inline...

On Oct 5, 2011, at 11:21 PM, Kevin M Levey wrote:

> WED 05OCT11: 2010PDT
>
> I'm still having difficulty trying to set up a correct CTL file for  
> the Short Range Ensemble Model (SREF) since g2ctl.pl does not  
> correctly display the variables correctly in the file it creates.
>
> A WGRIB2 inventory of the file I am looking at is found here:
>
> MEAN: http://www.ftp.ncep.noaa.gov/data/nccf/com/sref/prod/sref.20111005/15/ensprod/sref.t15z.pgrb212.mean.grib2.idx
> SPREAD: http://www.ftp.ncep.noaa.gov/data/nccf/com/sref/prod/sref.20111005/15/ensprod/sref.t15z.pgrb212.spread.grib2.idx
> PROB:  http://www.ftp.ncep.noaa.gov/data/nccf/com/sref/prod/sref.20111005/15/ensprod/sref.t15z.pgrb212.prob.grib2.idx
>
> I am not sure how to write out the APCP variables - for example:  
> (MEAN)
>
> forecast hour 6:
>
> 179:1695832:d=2011100515:APCP:surface:3-6 hour acc fcst:wt ens-mean
> 180:1700422:d=2011100515:APCP:surface:0-6 hour acc fcst:wt ens-mean
These two records both have the same base time (2011100515) and the  
same end of accumulation period (6hr), so gribmap will match both of  
them to the same time (2011100521), so the record that appears later  
in the grib2 file is the one that will get displayed by GrADS.

>
> at the end of the file :
>
> 2053:18119750:d=2011100515:APCP:surface:84-87 hour acc fcst:wt ens- 
> mean
> 2054:18125217:d=2011100515:APCP:surface:81-87 hour acc fcst:wt ens- 
> mean
> 2055:18131995:d=2011100515:APCP:surface:75-87 hour acc fcst:wt ens- 
> mean
> 2056:18140088:d=2011100515:APCP:surface:63-87 hour acc fcst:wt ens- 
> mean
Similarly, all four of these records will qualify as matches for the  
time step that is 87 hours from start time. The one that will get  
displayed will be record #2056, since it was the last one to match.

> I need to plot the precip mean/spread for precip every 6 hours, 12  
> hours and 24 hours, but have been at this for a week now, and still  
> nowhere near a satisfactory solution.
My suggestion is to use wgrib2 to split the file into pieces, picking  
out the records that have a common accumulation time, e.g. all the 6hr  
accumulations. Then you should have a set of records with unique end  
times that will map uniquely to a time axis as defined by TDEF.

> Likewise with the probability of rainfall exceeding 0.25" etc....
The probability files are going to require some extra work to figure  
out how to map them in a unique way. They may require as many as 4  
additional grib codes and the units field in a GRIB2 variable  
declaration already has 5 elements. That borders on the ridiculous,  
and so a design change may be in order. In any event, it will be a  
while before a GrADS version exists that will be able to handle these  
probability files in their native format. Wesley also pointed out that  
there are some discrepancies between the NCEP encoding of this Product  
Definition Template and the WMO standard. Best suggestion I have is to  
use wgrib2 to rewrite the records of interest into another format  
(e.g. binary), doing your best to preserve whatever metadata you need  
in the filenames and the GrADS descriptor file.

> I was quite competent decoding grib1 and setting up CTL files based  
> on the KPDS values, however, the SREF inventory has me stumped.
Meet the new beast to conquer...
>
> If I know how do get this done, I should be able to create the CTL  
> file for the probability files which is where I had the initial  
> problem last week.
If you succeed, please post your solutions to the forum for the next  
unsuspecting SREF user who comes along...
--Jennifer

>
> Any help with an short example would greatly help me.
>
> Thanks in advance.
>
> Regards,
>
> Kevin M Levey, MSc in Oceans and Atmospheric Sciences (University of  
> Cape Town)
> Vice President of Operations
> CustomWeather, Inc.
> San Francisco, California, USA
>
> "Taking the World by Storm!"
>
> http://www.customweather.com
> http://www.myforecast.com
> http://www.1stweather.com
>
> cell: 415-794-0411
> work: 415-777-3566
> email: klevey at customweather.com
>
> On Sep 27, 2011, at 09/27/11 - 6:28 AM, Jennifer Adams wrote:
>
>> Never mind, I found a sample and will look into whether GrADS can  
>> handle this PDT. --Jennifer
>>
>> On Sep 27, 2011, at 9:02 AM, Jennifer Adams wrote:
>>
>>> What is the URL or FTP address where I can get a sample of this  
>>> SREF file? --Jennifer
>>>
>>> On Sep 26, 2011, at 5:06 PM, Kevin M Levey wrote:
>>>
>>>> MON 26SEP11: 1400PDT
>>>>
>>>> Hi
>>>>
>>>> I'm busy processing SREF GRIB2 model data, specifically: AWIPS  
>>>> grid Regional - CONUS - Double Resolution (Lambert Conformal -  
>>>> 40km) Prob Products (NCEP ....ensprod/ 
>>>> sref.tccz.pgrb212.prob.grib2).
>>>>
>>>> I've had no problems using processing the SPREAD and MEAN files  
>>>> using gtcl.pl (ver:0.0.8.2) and wgrib2 (ver: v0.1.9.2c 3/2011 ),  
>>>> however, am running into issues when processing the probability  
>>>> files.
>>>>
>>>> Firstly, g2ctl.pl throws this:
>>>>
>>>> Warning: g2lib/g2clib jpeg deocde may differ from WMO standard,  
>>>> use use -g2clib 0 for WMO standard
>>>>
>>>> and then running gribmap I get this:
>>>>
>>>> Product Definition Template 9 not handled
>>>>
>>>> As I understand it, wgrib2 doesn't know what to do as the table  
>>>> for SREF is not defined. The CTL file incorrectly shows only a  
>>>> few variables and none of the probability variables as listed on  
>>>> the NCEP site:
>>>>
>>>> http://www.nco.ncep.noaa.gov/pmb/products/sref/sref.t03z.pgrb212.prob.grib2.shtml
>>>>
>>>> I'm somewhat stumped here as to how to correctly process these  
>>>> type files and display the desired variables in GRADS.
>>>>
>>>> Any help would be welcome.
>>>>
>>>> Thanks.
>>>>
>>>> Regards,
>>>>
>>>> Kevin M Levey, MSc in Oceans and Atmospheric Sciences (University  
>>>> of Cape Town)
>>>> Vice President of Operations
>>>> CustomWeather, Inc.
>>>> San Francisco, California, USA
>>>>
>>>> "Taking the World by Storm!"
>>>>
>>>> http://www.customweather.com
>>>> http://www.myforecast.com
>>>> http://www.1stweather.com
>>>>
>>>> cell: 415-794-0411
>>>> work: 415-777-3566
>>>> email: klevey at customweather.com
>>>>
>>>>
>>>> _______________________________________________
>>>> gradsusr mailing list
>>>> gradsusr at gradsusr.org
>>>> http://gradsusr.org/mailman/listinfo/gradsusr
>>>
>>> --
>>> Jennifer M. Adams
>>> IGES/COLA
>>> 4041 Powder Mill Road, Suite 302
>>> Calverton, MD 20705
>>> jma at cola.iges.org
>>>
>>>
>>>
>>> _______________________________________________
>>> gradsusr mailing list
>>> gradsusr at gradsusr.org
>>> http://gradsusr.org/mailman/listinfo/gradsusr
>>
>> --
>> Jennifer M. Adams
>> IGES/COLA
>> 4041 Powder Mill Road, Suite 302
>> Calverton, MD 20705
>> jma at cola.iges.org
>>
>>
>>
>> _______________________________________________
>> gradsusr mailing list
>> gradsusr at gradsusr.org
>> http://gradsusr.org/mailman/listinfo/gradsusr
>
> _______________________________________________
> gradsusr mailing list
> gradsusr at gradsusr.org
> http://gradsusr.org/mailman/listinfo/gradsusr

--
Jennifer M. Adams
IGES/COLA
4041 Powder Mill Road, Suite 302
Calverton, MD 20705
jma at cola.iges.org

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://gradsusr.org/pipermail/gradsusr/attachments/20111006/7d9440a5/attachment-0003.html 