2016-02-29

Learning about data before learning with data

I've put together a short and opinionated guide to books about data worth reading. If your favorite book didn't make the list, please leave a comment listing the book and why it is worth including.

You'll find Books for scientists and data scientists under the "Pages" heading at the top of the right column of this blog along with the RDA Video Tutorials page. Can you think of other permanent pages we should create and list there?

2016-02-23

NCAR RDA Sporadic Outages February 25-26, 2016

UPDATE 2015-02-26 14:48 MST: This work is complete and RDA web services are back in operation. Thank-you for your patience.

UPDATE 2016-02-25 16:00 MST:  Work on the development servers is complete.  Work on the production servers will commence on 2016-02-26 at 8:30 MST.
--------
System upgrades and maintenance of the RDA servers will commence at 9:00 MST on Thursday, February 25, 2016.
Both development and production systems will experience periods of downtime during this operation. Work will start with the development systems and once complete, a status update will be sent out. At that time work will begin on the production systems. Another status update will be sent upon completion of operations.
RDA web services will be impacted. Users may not experience outages until work begins on the production servers, most likely in the afternoon MST. However, schedule your data requests to finish before mid-morning Feb 25 to be safe.

Progress updates will be posted here.

2016-02-12

Upcoming improvements to the Globus login process

On February 13, starting at 10 AM CST, Globus will be upgrading its data transfer services and Globus transfers will not be available while this release is deployed to their production environment.  This downtime will affect all Globus data transfers initiated from the RDA website.  Globus services are expected to be back online at approximately 3 PM CST.

Included in the release are upgrades to the Globus authentication and authorization mechanisms which will allow RDA users to access the service using their RDA login e-mail and password.  A separate Globus username and password are no longer required.  To log in using your RDA credentials, select the 'NCAR RDA' organization on the Globus login page, and then follow the instructions to enter in your RDA user e-mail and password.  RDA users who currently have a Globus username and password may continue to log in with their Globus credentials by selecting 'GlobusID' from the list of organizations.

For more information on the upcoming release and improvements, see the Globus blog post at https://www.globus.org/blog/enhanced-login-mechanism-streamlines-access-globus.

2016-02-04

Subsetting to save time and bandwidth

Many people use RDA data to initialize the WRF model.  Some researchers ask for help to cope with bandwidth constraints.

Others may not even be aware that they are running into bandwidth constraints until too late--when they get the "429 Too Many Requests" error after their IP address has been blocked for overuse of RDA resources.

We want to help you get the data you need to do your work.   But you will save time and bandwidth if you keep a few simple points in mind.

2016-02-01

NCAR RDA System Outage February 2-3, 2016

Second UPDATE 18:00 MST Feb 3, 2016: All RDA services are back on line.  We thank you for your patience during this extended outage.

UPDATE Feb 3, 2016: System maintenance continues.  Requests for data on tape (HPSS), data translation, and subsetting jobs will be held until maintenance concludes.  Data downloads of whole files on disk (webfiles) is operational.

RDA services, including data download and data request processing, will be unavailable during system maintenance on Tuesday, February 2, 2016.

Work will start at 7:00 MST and the system should be up by 16:00 MST or earlier. Data request jobs should run automatically after system restart.

We apologize for the inconvenience.