[gradsusr] dods server for CMIP5 data?

Mira Berdahl mberdahl at envsci.rutgers.edu
Fri Nov 16 11:09:08 EST 2012


Hi Haibin,

Just a quick note about CMIP5 downloading - Have you tried logging into
llnl via ftp to find CMIP output?  I have noticed they have most (but not
all) of CMIP5 output there, but the process is faster than doing it via
wget usually.

Just logon with :
ftp cmip5.llnl.gov

Hope this is helpful,
Mira

***********************
PhD Candidate
Rutgers University
New Brunswick, NJ

> Hello Jennifer,
>
> Thanks for your exhaustive explanation. I had a bit hard time yesterday
> to use the web interface and wget to download the data. The search did
> not perform well if using chrome, I always ended up with "garbage" files
> that I do not need.
> When I use IE, everything worked just fine. The other inconvenience I
> came across is that it is not possible to do multiple variables
> searching simultaneously (well, Probably just I did not how to do it).
>
> Regards,
> Haibin
>
> On 11/16/2012 10:13 AM, Jennifer Adams wrote:
>> There is no free lunch when it comes to CMIP5 data. There is a thredds
>> data server running at each data node, but the authentication issues
>> make access a bit awkward. There is also (in some cases) extreme
>> granularity in the files -- some variables have as many as 2000 files
>> to cover the complete time series -- and each file is served
>> separately. Also, there is no standard naming convention for the
>> directory paths on each of those servers, so it is difficult to
>> automate access from one data node to another. For CMIP data, most of
>> the valuable metadata exists as attributes in the data files, and that
>> would likely be lost when accessing and collecting data via OPeNDAP.
>> And OPeNDAP would be very slow, slower than a wget job, that's for
>> sure. The new PeerToPeer system for getting CMIP5 data is working well
>> enough, and it is possible to automate search and download jobs. I
>> speak from personal experience -- I have spent much time over the past
>> year collecting and managing about 30Tb of CMIP5 data.
>> --Jennifer
>>
>> On Nov 15, 2012, at 9:39 PM, Haibin Li wrote:
>>
>>> Hello there,
>>>
>>> Does anyone know whether there is a dods server for recent CMIP5 data
>>> that can be accessed using GrADS?
>>> Thanks.
>>>
>>> Haibin
>>> _______________________________________________
>>> gradsusr mailing list
>>> gradsusr at gradsusr.org <mailto:gradsusr at gradsusr.org>
>>> http://gradsusr.org/mailman/listinfo/gradsusr
>>
>> --
>> Jennifer M. Adams
>> IGES/COLA
>> 4041 Powder Mill Road, Suite 302
>> Calverton, MD 20705
>> jma at cola.iges.org <mailto:jma at cola.iges.org>
>>
>>
>>
>>
>>
>> _______________________________________________
>> gradsusr mailing list
>> gradsusr at gradsusr.org
>> http://gradsusr.org/mailman/listinfo/gradsusr
>
> _______________________________________________
> gradsusr mailing list
> gradsusr at gradsusr.org
> http://gradsusr.org/mailman/listinfo/gradsusr
>




More information about the gradsusr mailing list