[gradsusr] dods server for CMIP5 data?

[Jennifer Adams]

You can get more than one file at a time using wget from an FTP server -- that may be better that the HTTP interface through the various thredds servers, but you are limited by the bandwith and user traffic at llnl.gov. The user authenitcation is always a sticking point, and I'm not sure how the certificates work with FTP, but there are folks in the ESG Federation who can answer those questions. I use a program called "myproxyclient" to automatically renew my certificates. As for the web interface, I believe they recommend Firefox as the best browser to use.  
--Jennifer

On Nov 16, 2012, at 11:11 AM, Haibin Li wrote:

> Hi Mira,
> 
> Thanks. I did try. But I was not able to log in with my ESG account. I 
> sent them email this morning asking for login instruction.
> 
> 
> Haibin
> 
> On 11/16/2012 11:09 AM, Mira Berdahl wrote:
>> Hi Haibin,
>> 
>> Just a quick note about CMIP5 downloading - Have you tried logging into
>> llnl via ftp to find CMIP output?  I have noticed they have most (but not
>> all) of CMIP5 output there, but the process is faster than doing it via
>> wget usually.
>> 
>> Just logon with :
>> ftp cmip5.llnl.gov
>> 
>> Hope this is helpful,
>> Mira
>> 
>> ***********************
>> PhD Candidate
>> Rutgers University
>> New Brunswick, NJ
>> 
>>> Hello Jennifer,
>>> 
>>> Thanks for your exhaustive explanation. I had a bit hard time yesterday
>>> to use the web interface and wget to download the data. The search did
>>> not perform well if using chrome, I always ended up with "garbage" files
>>> that I do not need.
>>> When I use IE, everything worked just fine. The other inconvenience I
>>> came across is that it is not possible to do multiple variables
>>> searching simultaneously (well, Probably just I did not how to do it).
>>> 
>>> Regards,
>>> Haibin
>>> 
>>> On 11/16/2012 10:13 AM, Jennifer Adams wrote:
>>>> There is no free lunch when it comes to CMIP5 data. There is a thredds
>>>> data server running at each data node, but the authentication issues
>>>> make access a bit awkward. There is also (in some cases) extreme
>>>> granularity in the files -- some variables have as many as 2000 files
>>>> to cover the complete time series -- and each file is served
>>>> separately. Also, there is no standard naming convention for the
>>>> directory paths on each of those servers, so it is difficult to
>>>> automate access from one data node to another. For CMIP data, most of
>>>> the valuable metadata exists as attributes in the data files, and that
>>>> would likely be lost when accessing and collecting data via OPeNDAP.
>>>> And OPeNDAP would be very slow, slower than a wget job, that's for
>>>> sure. The new PeerToPeer system for getting CMIP5 data is working well
>>>> enough, and it is possible to automate search and download jobs. I
>>>> speak from personal experience -- I have spent much time over the past
>>>> year collecting and managing about 30Tb of CMIP5 data.
>>>> --Jennifer
>>>> 
>>>> On Nov 15, 2012, at 9:39 PM, Haibin Li wrote:
>>>> 
>>>>> Hello there,
>>>>> 
>>>>> Does anyone know whether there is a dods server for recent CMIP5 data
>>>>> that can be accessed using GrADS?
>>>>> Thanks.
>>>>> 
>>>>> Haibin
>>>>> _______________________________________________
>>>>> gradsusr mailing list
>>>>> gradsusr at gradsusr.org <mailto:gradsusr at gradsusr.org>
>>>>> http://gradsusr.org/mailman/listinfo/gradsusr
>>>> --
>>>> Jennifer M. Adams
>>>> IGES/COLA
>>>> 4041 Powder Mill Road, Suite 302
>>>> Calverton, MD 20705
>>>> jma at cola.iges.org <mailto:jma at cola.iges.org>
>>>> 
>>>> 
>>>> 
>>>> 
>>>> 
>>>> _______________________________________________
>>>> gradsusr mailing list
>>>> gradsusr at gradsusr.org
>>>> http://gradsusr.org/mailman/listinfo/gradsusr
>>> _______________________________________________
>>> gradsusr mailing list
>>> gradsusr at gradsusr.org
>>> http://gradsusr.org/mailman/listinfo/gradsusr
>>> 
>> _______________________________________________
>> gradsusr mailing list
>> gradsusr at gradsusr.org
>> http://gradsusr.org/mailman/listinfo/gradsusr
> 
> _______________________________________________
> gradsusr mailing list
> gradsusr at gradsusr.org
> http://gradsusr.org/mailman/listinfo/gradsusr

--
Jennifer M. Adams
IGES/COLA
4041 Powder Mill Road, Suite 302
Calverton, MD 20705
jma at cola.iges.org



-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://gradsusr.org/pipermail/gradsusr/attachments/20121116/35556aae/attachment-0003.html