[gradsusr] GrADS performance vs alternatives?

[Mark Sponsler]

One other consideration is HOW your data is stored. Reading grib files versus reading binary files I believe is inherently quicker. 

Try coverting your grib2 files to binary using wgrib2 before you start running scrpits to produce images.

Just a thought.
Mark

On April 11, 2022 1:33:15 AM PDT, Davide Sacchetti <davide.sacchetti at arpal.liguria.it> wrote:
>I see
>there are different ways to produce png outputs, depending also on grads version
>eg: gxprint, printim, print: you could investigate which method is faster.
>when I have to produce lots of png I divide the number of png processing among the available cpus, but I immagine you already did this
>
>
>On my knowledge it is difficult to read and render data from grib or netcdf faster than grads does, the only chance I imagine is to take advantage of parallelization
>
>
>Davide
>
>
>Dott. Davide Sacchetti
>Dipartimento Stato dell’Ambiente e Tutela dai Rischi Naturali
>U.O. Clima Meteo Idro
>Viale Brigate Partigiane 2, 16129 Genova (I)
>tel: +39 0106437535
>mail: davide.sacchetti at arpal.liguria.it  web: https://www.arpal.liguria.it/homepage/meteo.html
>
>
>
> Da:   Brian Gaze <brianw.gaze at googlemail.com> 
> A:   <gradsusr at gradsusr.org> 
> Inviato:   08/04/2022 19:03 
> Oggetto:   [gradsusr] GrADS performance vs alternatives? 
>
>
>
>Thanks David.
>
>
>The data is stored locally on high speed SSDs.
>
>Any tips with scripting? My professional background is software development so I'm reasonably comfortable working with grads script. However, I've not found many tweaks that make a great deal of difference in terms of performance.
>
>Thanks
>
>
>Brian
>
>
>
>
>On Fri, 8 Apr 2022 at 17:08, <gradsusr-request at gradsusr.org> wrote:
>Send gradsusr mailing list submissions to
>         gradsusr at gradsusr.org
> 
> To subscribe or unsubscribe via the World Wide Web, visit
>         http://gradsusr.org/mailman/listinfo/gradsusr
> or, via email, send a message with subject or body 'help' to
>         gradsusr-request at gradsusr.org
> 
> You can reach the person managing the list at
>         gradsusr-owner at gradsusr.org
> 
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of gradsusr digest..."
> 
> 
> Today's Topics:
> 
>    1. Re: GrADS performance vs alternatives? (Davide Sacchetti)
> 
> 
> ----------------------------------------------------------------------
> 
> Message: 1
> Date: Thu, 7 Apr 2022 18:06:10 +0200
> From: Davide Sacchetti <davide.sacchetti at arpal.liguria.it>
> To: GrADS Users Forum <gradsusr at gradsusr.org>
> Subject: Re: [gradsusr] GrADS performance vs alternatives?
> Message-ID: <51862359-4676 at mbox.arpal.liguria.it>
> Content-Type: text/plain; charset="utf-8"
> 
> the speed may depend on cpu but also on where your data is stored (are your datasets available locally?) and how your script is written ...
> Upon my knowloedge GrADS IS fast, it may be the fastest sw you can find everywhere ...
> Davide
> 
> 
> Dott. Davide Sacchetti
> Dipartimento Stato dell?Ambiente e Tutela dai Rischi Naturali
> U.O. Clima Meteo Idro
> Viale Brigate Partigiane 2, 16129 Genova (I)
> tel: +39 0106437535
> mail:?davide.sacchetti at arpal.liguria.it? web:?https://www.arpal.liguria.it/homepage/meteo.html
> 
> 
> 
>  Da:   Brian Gaze <brianw.gaze at googlemail.com> 
>  A:   <gradsusr at gradsusr.org> 
>  Inviato:   07/04/2022 17:07 
>  Oggetto:   [gradsusr] GrADS performance vs alternatives? 
> 
> 
> 
>                  Questa ? la prima volta che ricevi un'email da questo mittente.         Assicurati che sia qualcuno di cui ti fidi.                
> Hi,
> 
> 
> 
> I've recently started generating ECMWF 50 member ensemble plots using a GrADS script for a large latitude - longitude range. Technically it all works fine, but the issue I'm having is performance. It is dependent of course on CPU speed, but even with a very fast processor each individual graph can take approx 1.5 seconds to render and save.?
> 
> 
> To an extent running instances on multiple cores helps, but generating a range of graphs (e.g. 2m temps, 850hPa temps, MSLP etc...) can take a long time. Perhaps 40 mins or so for a country the size of the United Kingdom.?
> 
> 
> Does anyone have tips for how to optimize performance in the script? Alternatively, is there software available which runs much faster than GrADS script to do the same thing??
> 
> 
> Thanks
> 
> 
> BWG 
> 
> _______________________________________________ 
> gradsusr mailing list 
> gradsusr at gradsusr.org 
>  https://urlsand.esvalabs.com/?u=http%3A%2F%2Fgradsusr.org%2Fmailman%2Flistinfo%2Fgradsusr&e=7312d17f&h=5ee7e1e3&f=y&p=n  
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <http://gradsusr.org/pipermail/gradsusr/attachments/20220407/a20b8590/attachment-0001.html>
> 
> ------------------------------
> 
> Subject: Digest Footer
> 
> _______________________________________________
> gradsusr mailing list
> gradsusr at gradsusr.org
> http://gradsusr.org/mailman/listinfo/gradsusr
> 
> 
> ------------------------------
> 
> End of gradsusr Digest, Vol 145, Issue 2
> ****************************************
> 
>
>_______________________________________________ 
>gradsusr mailing list 
>gradsusr at gradsusr.org 
> https://urlsand.esvalabs.com/?u=http%3A%2F%2Fgradsusr.org%2Fmailman%2Flistinfo%2Fgradsusr&e=7312d17f&h=5ee7e1e3&f=y&p=n  

-- 
Thanks 
Mark Sponsler
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gradsusr.org/pipermail/gradsusr/attachments/20220411/0156691f/attachment.html>