ClimatePipes: User-Friendly Data Access, Data Manipulation, Data Analysis and Visualization of Community Climate Models

Observations unequivocally show that the global climate is changing and the results are dramatic. With the accelerating pace of climate change, the impact of these changes will resonate through a broad range of fields including public health, infrastructure, water resources, and many others. These stakeholders need access to and resources for using climate data that are designed with the non-researcher in mind. Unfortunately, this is impeded by factors such as large data size, lack of adequate metadata, poor documentation, and lack of sufficient computational and visualization resources. The aim of this proposal is to develop ClimatePipes, a platform that will provide mechanisms to make this valuable data available to non-researchers including policy makers, health officials, agriculturalists, and industry leaders. The ClimatePipes cyberinfrastructure will provide state-of-the-art, user-friendly access, analysis, and visualization of data generated from high-resolution, long-term, climate change projections performed as part of the U.S. Global Change Research Program, the DOE-funded ESGF, NSF-funded DataONE, and NASA-funded EOSDIS. ClimatePipes is not a replacement for high-end tools for scientists, but instead provides simple, intuitive, and effective workflows that can be used by non-researchers and non-programmers. It builds on top of existing high-end tools, and is designed to easily leverage functionality added to those tools, thus ensuring state-of-the-art functionality in the years to come. ClimatePipes was successfully developed as a web-based tool that provides workflow and form-based interfaces for accessing, querying, and visualizing interesting datasets from one or more sources. This was integrated with ESGF and tools from UV-CDAT for the purpose of data manipulation and visualization. ClimatePipes demonstrated production of relevant data and visualizations in response to natural language queries. Will focus on implementation of mechanisms for supporting more elaborate and relevant queries, and improvements to the usability, robustness and scalability of the system. In order to support these types of queries, the team will develop a semantic search tool using natural language processing techniques. The team will also add the capability to perform appropriate transformations to bring relevant data into a common reference system. Upon completion of Phase II, ClimatePipes will provide an interface for running computations in the cloud or on a user-provided cluster, to accommodate the compute power required. Further, the team will develop custom visualizations for climate applications, an API, and an appropriate user interface for uploading data to the server for analyses and integration.