<div dir="ltr"><div><div><div>Sam,<br><br></div> Which version of wgrib2? (wgrib2 -config)<br><br></div> Try increasing the stack size. (bash: ulimit)<br></div><div><br><br></div>Wesley<br><br><div><div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Nov 3, 2016 at 1:32 PM, Sam Wilson <span dir="ltr"><<a href="mailto:sam@surfline.com" target="_blank">sam@surfline.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">
<div>
<div style="color:rgb(0,0,0);font-family:Calibri,sans-serif;font-size:14px">
<span style="font-family:-webkit-standard;font-size:medium;background-color:rgb(255,255,255)">Moorthi and Wesley,</span></div>
<div style="color:rgb(0,0,0);font-family:Calibri,sans-serif;font-size:14px">
<span style="font-family:-webkit-standard;font-size:medium;background-color:rgb(255,255,255)"><br>
</span></div>
<div style="color:rgb(0,0,0);font-family:Calibri,sans-serif;font-size:14px">
<span style="font-family:-webkit-standard;font-size:medium;background-color:rgb(255,254,254)">Thanks very much for the feedback - I attempted using the ncep_norm option with wgrib2, but got a segmentation fault..argh!</span></div>
<div style="color:rgb(0,0,0);font-family:Calibri,sans-serif;font-size:14px">
<span style="font-family:-webkit-standard;font-size:medium;background-color:rgb(255,254,254)"><br>
</span></div>
<div><font face="Calibri,sans-serif">My software installation skills are sub-par, so I will try </font><span style="background-color:rgb(255,255,255)">Moorthi’s option and get back to the group.</span></div>
<div><span style="background-color:rgb(255,255,255)"><br>
</span></div>
<div><span style="background-color:rgb(255,254,254)">Thanks again..</span></div>
<div><span style="background-color:rgb(255,254,254)"><br>
</span></div>
<div><span style="background-color:rgb(254,253,253)">Cheers,</span></div>
<div><span style="background-color:rgb(253,252,252)">Sam</span></div>
<div style="color:rgb(0,0,0);font-family:Calibri,sans-serif;font-size:14px">
<div><br>
</div>
</div>
</div>
<span id="m_-3240781754259390688OLK_SRC_BODY_SECTION" style="color:rgb(0,0,0);font-family:Calibri,sans-serif;font-size:14px">
<div style="font-family:Calibri;font-size:11pt;text-align:left;color:black;BORDER-BOTTOM:medium none;BORDER-LEFT:medium none;PADDING-BOTTOM:0in;PADDING-LEFT:0in;PADDING-RIGHT:0in;BORDER-TOP:#b5c4df 1pt solid;BORDER-RIGHT:medium none;PADDING-TOP:3pt">
<span style="font-weight:bold">From: </span><<a href="mailto:gradsusr-bounces@gradsusr.org" target="_blank">gradsusr-bounces@gradsusr.org</a><wbr>> on behalf of Wesley Ebisuzaki - NOAA Federal <<a href="mailto:wesley.ebisuzaki@noaa.gov" target="_blank">wesley.ebisuzaki@noaa.gov</a>><br>
<span style="font-weight:bold">Reply-To: </span>GrADS Users Forum <<a href="mailto:gradsusr@gradsusr.org" target="_blank">gradsusr@gradsusr.org</a>><br>
<span style="font-weight:bold">Date: </span>Thursday, November 3, 2016 at 5:59 AM<br>
<span style="font-weight:bold">To: </span>GrADS Users Forum <<a href="mailto:gradsusr@gradsusr.org" target="_blank">gradsusr@gradsusr.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [gradsusr] GFS total cloud cover<br>
</div>
<div><br>
</div>
<div>
<div>
<div dir="ltr">
<div>
<div>
<div>Sam,<br>
<br>
</div>
You can get the "0-1 hour ave fcst", "1-2 hour ave fcst", etc<br>
</div>
by using the -ncep_norm option of wgrib2.<br>
<br>
<a href="http://www.cpc.ncep.noaa.gov/products/wesley/wgrib2/ncep_norm.html" target="_blank">http://www.cpc.ncep.noaa.gov/<wbr>products/wesley/wgrib2/ncep_<wbr>norm.html</a><br>
<br>
</div>
Here is a simple script that takes a list of gfs forecast files in order<br>
<br>
<br>
<div>#!/bin/sh<br>
#<br>
# usage $0 (list of gfs grib2 forecast files in order)<br>
#<br>
A=":TCDC:entire atmosphere:"<br>
B=":TCDC:low cloud layer:"<br>
C=":TCDC:middle cloud layer:"<br>
D=":TCDC:high cloud layer:"<br>
<br>
cat $* | wgrib2 - -match "($A|$B|$C|$D)" -set_grib_type c3 \<br>
-if "$A" -ncep_norm $stmp/junk \<br>
-if "$B" -ncep_norm $stmp/junk \<br>
-if "$C" -ncep_norm $stmp/junk \<br>
-if "$D" -ncep_norm $stmp/junk<br>
<br>
<br>
</div>
<div>Wesley<br>
</div>
<div><br>
<div>
<div>
<div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Thu, Nov 3, 2016 at 6:59 AM, Shrinivas Moorthi <span dir="ltr">
<<a href="mailto:shrinivas.moorthi@noaa.gov" target="_blank">shrinivas.moorthi@noaa.gov</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div bgcolor="#FFFFFF">
<div class="m_-3240781754259390688gmail-m_-3920432599695330402moz-cite-prefix">The grib header is correct.<br>
Let us denote the data from 6 hourly output as C1, C2, C3, C4, C5, C6.<br>
<br>
To get hourly mean, then<br>
for hour 1, the mean is C1,<br>
for hour 2, the mean is 2C2-C1<br>
for hour 3, the mean is 3C3-2C2<br>
for hour 4, the mean is 4C4-3C2<br>
for hour 5, the mean is 5C5-4C4<br>
and for hour 6, it is 6C6-5C5<br>
<br>
This pattern repeats every six ours.<br>
I hope this helps.<br>
Moorthi<br>
On 11/02/2016 07:41 PM, Sam Wilson wrote:<br>
</div>
<blockquote type="cite">
<div>
<div>Hi Jeff,</div>
<div><br>
</div>
<div>I plotted a quick and dirty cloud animation using the data - each step is 1 hour from f001 through f015 in the attached.</div>
<div><br>
</div>
<div>It appears that they are averages over time - you can see the bigger jumps at steps 8 and 14 (the transition from 0-6hr avg to 6-7hr and from 6-12hr avg to 12-13hr).</div>
<div><br>
</div>
<div>Marian - thank you for the feedback. Sounds like using the hourly data for cloud cover may not be a good idea, unless someone else has a solution.</div>
<div><br>
</div>
</div>
<div>Thanks,</div>
<div>Sam</div>
<div><br>
</div>
<span id="m_-3240781754259390688gmail-m_-3920432599695330402OLK_SRC_BODY_SECTION">
<div style="font-family:calibri;font-size:11pt;text-align:left;color:black;border-width:1pt medium medium;border-style:solid none none;border-color:rgb(181,196,223) -moz-use-text-color -moz-use-text-color;padding:3pt 0in 0in">
<span style="font-weight:bold">From: </span><<a href="mailto:gradsusr-bounces@gradsusr.org" target="_blank">gradsusr-bounces@gradsusr.org</a><wbr>> on behalf of Jeff Duda <<a href="mailto:jeffduda319@gmail.com" target="_blank">jeffduda319@gmail.com</a>><br>
<span style="font-weight:bold">Reply-To: </span>GrADS Users Forum <<a href="mailto:gradsusr@gradsusr.org" target="_blank">gradsusr@gradsusr.org</a>><br>
<span style="font-weight:bold">Date: </span>Wednesday, November 2, 2016 at 3:21 PM<br>
<span style="font-weight:bold">To: </span>GrADS Users Forum <<a href="mailto:gradsusr@gradsusr.org" target="_blank">gradsusr@gradsusr.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [gradsusr] GFS total cloud cover<br>
</div>
<div><br>
</div>
<div>
<div>
<div dir="ltr">
<div>
<div>
<div>Sam,<br>
</div>
That might just be a wgrib table thing. Have you actually plotted the field over those times? If it's truly an averaged field, you should be able to see some indication of that in the texture and smoothness of the fields as you progress through increasing averaged
times. <br>
<br>
</div>
My guess is that this is just some arbitrary setting in wgrib and does not reflect the true nature of the field. But I could be wrong. If there are any NCEP folks who work on the GFS on this forum, perhaps one of them could set the record straight.<br>
<br>
</div>
Jeff <br>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Wed, Nov 2, 2016 at 4:54 PM, Sam Wilson <span dir="ltr">
<<a href="mailto:sam@surfline.com" target="_blank">sam@surfline.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div style="word-wrap:break-word;color:rgb(0,0,0);font-size:14px;font-family:calibri,sans-serif">
<div>
<div>Thanks for the response Jeff - it’s strange to me as well!</div>
<div><br>
</div>
<div>Running wgrib2 on the data files for forecast hours 001 through 007 gives the following for TCDCclm:</div>
<div><br>
</div>
<div><b>f001:</b></div>
<div>17:7991683:d=<a href="tel:2016110212" value="+12016110212" target="_blank">2016110212</a>:TCDC:e<wbr>ntire atmosphere:<b>0-1</b> hour ave fcst:</div>
<div><b>f002:</b></div>
<div>17:8082626:d=<a href="tel:2016110212" value="+12016110212" target="_blank">2016110212</a>:TCDC:e<wbr>ntire atmosphere:<b>0-2</b> hour ave fcst:</div>
<div><b>f003:</b></div>
<div>17:8059826:d=<a href="tel:2016110212" value="+12016110212" target="_blank">2016110212</a>:TCDC:e<wbr>ntire atmosphere:<b>0-3
</b>hour ave fcst:</div>
<div><b>f004:</b></div>
<div>17:8057865:d=<a href="tel:2016110212" value="+12016110212" target="_blank">2016110212</a>:TCDC:e<wbr>ntire atmosphere:<b>0-4</b> hour ave fcst:</div>
<div><b>f005:</b></div>
<div>17:8119289:d=<a href="tel:2016110212" value="+12016110212" target="_blank">2016110212</a>:TCDC:e<wbr>ntire atmosphere:<b>0-5</b> hour ave fcst:</div>
<div><b>f006:</b></div>
<div>17:8172510:d=<a href="tel:2016110212" value="+12016110212" target="_blank">2016110212</a>:TCDC:e<wbr>ntire atmosphere:<b>0-6</b> hour ave fcst:</div>
<div><b>f007:</b></div>
<div>17:8013825:d=<a href="tel:2016110212" value="+12016110212" target="_blank">2016110212</a>:TCDC:e<wbr>ntire atmosphere:<b>6-7</b> hour ave fcst:</div>
<div><br>
</div>
<div>And it continues on..once the files go to 3 hourly (after hour 120), we have:</div>
<div><br>
</div>
<div><b>f123:</b></div>
<div>17:7687687:d=<a href="tel:2016110212" value="+12016110212" target="_blank">2016110212</a>:TCDC:e<wbr>ntire atmosphere:<b>120-123</b> hour ave fcst:</div>
<div><b>f126:</b></div>
<div>17:7778871:d=<a href="tel:2016110212" value="+12016110212" target="_blank">2016110212</a>:TCDC:e<wbr>ntire atmosphere:<b>120-126</b> hour ave fcst:</div>
<div><b>f129:</b></div>
<div>17:7728042:d=<a href="tel:2016110212" value="+12016110212" target="_blank">2016110212</a>:TCDC:e<wbr>ntire atmosphere:<b>126-129</b> hour ave fcst:</div>
<div><br>
</div>
<div>And finally the 12 hourly files (past hour 240) are all just 12 hour average forecasts:</div>
<div><br>
</div>
<div><b>f252:</b></div>
<div>17:6845416:d=<a href="tel:2016110212" value="+12016110212" target="_blank">2016110212</a>:TCDC:e<wbr>ntire atmosphere:<b>240-252</b> hour ave fcst:</div>
<div><br>
</div>
<div>I did think about the method you suggested (tcdcclm - tcdcclm(t-1)) but stopped there for the reason you mentioned..</div>
<div>
<div><br>
</div>
<div>Strange indeed - unless I’m missing something..</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Sam</div>
</div>
</div>
<div><br>
</div>
<span id="m_-3240781754259390688gmail-m_-3920432599695330402m_1177070826903731705OLK_SRC_BODY_SECTION">
<div style="font-family:calibri;font-size:11pt;text-align:left;color:black;border-width:1pt medium medium;border-style:solid none none;border-color:rgb(181,196,223) -moz-use-text-color -moz-use-text-color;padding:3pt 0in 0in">
<span style="font-weight:bold">From: </span><<a href="mailto:gradsusr-bounces@gradsusr.org" target="_blank">gradsusr-bounces@gradsusr.org</a><wbr>> on behalf of Jeff Duda <<a href="mailto:jeffduda319@gmail.com" target="_blank">jeffduda319@gmail.com</a>><br>
<span style="font-weight:bold">Reply-To: </span>GrADS Users Forum <<a href="mailto:gradsusr@gradsusr.org" target="_blank">gradsusr@gradsusr.org</a>><br>
<span style="font-weight:bold">Date: </span>Wednesday, November 2, 2016 at 2:08 PM<br>
<span style="font-weight:bold">To: </span>GrADS Users Forum <<a href="mailto:gradsusr@gradsusr.org" target="_blank">gradsusr@gradsusr.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [gradsusr] GFS total cloud cover<br>
</div>
<div><br>
</div>
<div>
<div>
<div dir="ltr">
<div>
<div>It seems a little strange to me that the total cloud cover product would be averaged over time. Is that really the case?<br>
<br>
</div>
Anyway, if you really do have an average over overlapping and increasing windows, with nothing else to go on and without applying the equations of motion in reverse, you'd have to assume a linear averaging, so subtraction of subsequent slices of the field (i.e.,
tcdcclm - tcdcclm(t-1)) would give you piecewise temporal averages. However, that method would give you negative cloud cover values which is clearly nonsensical, which again is why I question whether or not that array contains a temporal average. That just
doesn't make a lot of sense.<br>
<br>
</div>
Jeff Duda<br>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Wed, Nov 2, 2016 at 3:27 PM, Sam Wilson <span dir="ltr">
<<a href="mailto:sam@surfline.com" target="_blank">sam@surfline.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div style="word-wrap:break-word;color:rgb(0,0,0);font-size:14px;font-family:calibri,sans-serif">
<div>Hi,</div>
<div><br>
</div>
<div>I’m working with hourly GFS total cloud cover (TCDCclm) and I’m a bit stumped on the following..</div>
<div><br>
</div>
<div>Given TCDCclm for hours 0-1, 0-2, 0-3, 0-4, 0-5, and 0-6, what is the proper way to determine TCDCclm for hours 1-2, 2-3, 3-4, 4-5, and 5-6?</div>
<div><br>
</div>
<div>I may be making the problem more difficult than it is..but wanted to ping this group to be sure.</div>
<div><br>
</div>
<div>
<div>Is there an existing grads script that handles this already and if not, does anyone here have any insight?</div>
</div>
<div><br>
</div>
<div>Thanks so much for your time.</div>
<div><br>
</div>
<div>Best,</div>
<div>Sam</div>
</div>
<br>
______________________________<wbr>_________________<br>
gradsusr mailing list<br>
<a href="mailto:gradsusr@gradsusr.org" target="_blank">gradsusr@gradsusr.org</a><br>
<a href="http://gradsusr.org/mailman/listinfo/gradsusr" rel="noreferrer" target="_blank">http://gradsusr.org/mailman/li<wbr>stinfo/gradsusr</a><br>
<br>
<span class="m_-3240781754259390688gmail-m_-3920432599695330402HOEnZb"></span></blockquote>
<span class="m_-3240781754259390688gmail-m_-3920432599695330402HOEnZb"></span></div>
<span class="m_-3240781754259390688gmail-m_-3920432599695330402HOEnZb"><font color="#888888"><br>
<br clear="all">
<br>
-- <br>
<div class="m_-3240781754259390688gmail-m_-3920432599695330402m_1177070826903731705gmail_signature">
<div dir="ltr">
<div>Jeff Duda<br>
Post-doctoral research associate<br>
University of Oklahoma School of Meteorology<br>
</div>
</div>
</div>
</font></span></div>
</div>
</div>
</span></div>
<br>
______________________________<wbr>_________________<br>
gradsusr mailing list<br>
<a href="mailto:gradsusr@gradsusr.org" target="_blank">gradsusr@gradsusr.org</a><br>
<a href="http://gradsusr.org/mailman/listinfo/gradsusr" rel="noreferrer" target="_blank">http://gradsusr.org/mailman/li<wbr>stinfo/gradsusr</a><br>
<br>
</blockquote>
</div>
<br>
<br clear="all">
<span class="m_-3240781754259390688gmail-HOEnZb"><font color="#888888"><br>
-- <br>
<div class="m_-3240781754259390688gmail-m_-3920432599695330402gmail_signature">
<div dir="ltr">
<div>Jeff Duda<br>
Post-doctoral research associate<br>
University of Oklahoma School of Meteorology<br>
</div>
</div>
</div>
</font></span></div>
<span class="m_-3240781754259390688gmail-HOEnZb"><font color="#888888"></font></span></div>
<span class="m_-3240781754259390688gmail-HOEnZb"><font color="#888888"></font></span></div>
<span class="m_-3240781754259390688gmail-HOEnZb"><font color="#888888"></font></span></span><span class="m_-3240781754259390688gmail-HOEnZb"><font color="#888888"><br>
<fieldset class="m_-3240781754259390688gmail-m_-3920432599695330402mimeAttachmentHeader"></fieldset> <br>
<pre>______________________________<wbr>_________________
gradsusr mailing list
<a class="m_-3240781754259390688gmail-m_-3920432599695330402moz-txt-link-abbreviated" href="mailto:gradsusr@gradsusr.org" target="_blank">gradsusr@gradsusr.org</a><a class="m_-3240781754259390688gmail-m_-3920432599695330402moz-txt-link-freetext" href="http://gradsusr.org/mailman/listinfo/gradsusr" target="_blank">http://<wbr>gradsusr.org/mailman/listinfo/<wbr>gradsusr</a></pre>
</font></span></blockquote>
<span class="m_-3240781754259390688gmail-HOEnZb"><font color="#888888"><br>
<p><br>
</p>
<pre class="m_-3240781754259390688gmail-m_-3920432599695330402moz-signature" cols="72">--
Dr. Shrinivas Moorthi
Research Meteorologist
Global Climate and Weather Modeling Branch
Environmental Modeling Center / National Centers for Environmental Prediction
5830 University Research Court - (W/NP23), College Park MD 20740 USA
Tel:<a href="tel:%28301%29683-3718" value="+13016833718" target="_blank">(301)683-3718</a></pre>
</font></span></div>
<br>
______________________________<wbr>_________________<br>
gradsusr mailing list<br>
<a href="mailto:gradsusr@gradsusr.org" target="_blank">gradsusr@gradsusr.org</a><br>
<a href="http://gradsusr.org/mailman/listinfo/gradsusr" rel="noreferrer" target="_blank">http://gradsusr.org/mailman/li<wbr>stinfo/gradsusr</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</span>
</div>
<br>______________________________<wbr>_________________<br>
gradsusr mailing list<br>
<a href="mailto:gradsusr@gradsusr.org">gradsusr@gradsusr.org</a><br>
<a href="http://gradsusr.org/mailman/listinfo/gradsusr" rel="noreferrer" target="_blank">http://gradsusr.org/mailman/<wbr>listinfo/gradsusr</a><br>
<br></blockquote></div><br></div></div></div></div></div></div>