15
Tue, Oct
6 New Articles

IBM and NASA Release Open-Source AI Model on Hugging Face for Weather and Climate Applications

Analytics & Cognitive News
Typography
  • Smaller Small Medium Big Bigger
  • Default Helvetica Segoe Georgia Times

New AI foundation model offers insights beyond forecasting for scientists, developers, and businesses to better understand and analyze weather and climate data

IBM today announced a new AI foundation model for a variety of weather and climate use cases, available in open-source to the scientific, developer, and business communities. Developed by IBM and NASA, with contributions from Oak Ridge National Laboratory, the model offers a flexible, scalable way to address a variety of challenges related to short-term weather as well as long-term climate projection.              

Because of its unique design and training regime, the weather and climate foundation model can tackle far more applications than existing weather AI models, as outlined in a paper recently published on arXiv, "Prithvi WxC: Foundation Model for Weather and Climate." Potential applications include creating targeted forecasts based on local observations, detecting and predicting severe weather patterns, improving the spatial resolution of global climate simulations, and improving how physical processes are represented in numerical weather and climate models. In one experiment in the above identified paper, the foundation model accurately reconstructed global surface temperatures from a random sample of only five percent original data, suggesting a broader application to problems in data assimilation.

This model was pre-trained on 40 years of Earth observation data from NASA's Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2). As a foundation model, it has a unique architecture which allows it to be fine-tuned to global, regional, and local scales. This flexibility makes it suited for a range of weather studies.

The foundation model is available for download on Hugging Face, along with two fine-tuned versions of the model that tackle specific scientific and industry-relevant applications. These are:

  • Climate and weather data downscaling: A common meteorological practice is downscaling—inferring high-resolution outputs from low-resolution variables. Typical data inputs include temperature, precipitation, and surface winds, all of which can have varied resolutions. The model can depict both weather and climate data at up to 12x resolution, generating localized forecasts and climate projections. The fine-tuned downscaling model is available on the IBM Granite page on Hugging Face.
  • Gravity wave parameterization: Gravity waves are ubiquitous throughout the atmosphere and can affect many atmospheric processes related to climate and weather, such as cloud formation and aircraft turbulence. Traditionally, existing numerical climate models have not sufficiently captured gravity waves, which leads to uncertainties in terms of how exactly gravity waves can affect climate processes. This weather and climate foundation model can help scientists better estimate gravity wave generation, to improve the accuracy of numerical weather and climate models and constrain uncertainty when simulating future weather and climate events. This gravity wave parameterization model is being released as part of the NASA-IBM Prithvi family of models on Hugging Face.

"Advancing NASA's Earth science for the benefit of humanity means delivering actionable science in ways that are useful to people, organizations, and communities. The rapid changes we're witnessing on our home planet demand this strategy to meet the urgency of the moment," said Karen St. Germain, director of the Earth Science Division of NASA's Science Mission Directorate. "The NASA foundation model will help us produce a tool that people can use: weather, seasonal, and climate projections to help inform decisions on how to prepare, respond, and mitigate." 

"This space has seen the emergence of large AI models that focus on a fixed dataset and single use case — primarily forecasting. We have designed our weather and climate foundation model to go beyond such limitations so that it can be tuned to a variety of inputs and uses," said Juan Bernabe-Moreno, Director of IBM Research Europe (UK and Ireland) and IBM's Accelerated Discovery Lead for Climate and Sustainability. "For example, the model can run both on the entire earth as well as in a local context. With such flexibility on the technology side, this model is well-suited to help us understand meteorological phenomena such as hurricanes or atmospheric rivers, reason about future potential climate risks by increasing the resolution of climate models, and finally inform our understanding of imminent severe weather events."

"As a premier research institution and computing facility, we're focused on supporting teams to make research breakthroughs across many areas of science," said Arjun Shankar, director of the National Center for Computational Sciences at Oak Ridge National Laboratory. "Our collaboration with IBM and NASA to support the creation of the Prithvi weather and climate foundation model was a key part of our goal to bring advanced computing and data to problems of national importance, in this case, for weather and climate applications, which need continued computational science and model skill improvements to be impactful."

IBM has already collaborated with Environment and Climate Change Canada (ECCC) with a view to test the flexibility of the model with additional weather forecasting use cases. With the model, ECCC is exploring very short-term precipitation forecasts using a technique called precipitation nowcasting that ingests real-time radar data as input. The team is also testing the downscaling approach from global model forecasts at 15 km to km-scale resolution.

This weather and climate model is part of a larger collaboration between IBM Research and NASA to use AI technology to explore our planet, and joins the Prithvi family of AI foundation models. Last year, IBM and NASA made the Prithvi geospatial AI foundation model the largest open-source geospatial AI model available on Hugging Face. This geospatial foundation model has since been used by governments, companies, and public institutions to examine changes in disaster patterns, biodiversity, land use, and other geophysical processes. The foundation model and the gravity wave parameterization model can be accessed through the NASA-IBM Hugging Face page and the downscaling model can be accessed through the IBM Granite Hugging Face page. 

IBM is a leading global hybrid cloud and AI, and business services provider, helping clients in more than 175 countries capitalize on insights from their data, streamline business processes, reduce costs and gain the competitive edge in their industries. Nearly 3,000 government and corporate entities in critical infrastructure areas such as financial services, telecommunications and healthcare rely on IBM's hybrid cloud platform and Red Hat OpenShift to affect their digital transformations quickly, efficiently, and securely. IBM's breakthrough innovations in AI, quantum computing, industry-specific cloud solutions and business services deliver open and flexible options to our clients. All of this is backed by IBM's legendary commitment to trust, transparency, responsibility, inclusivity, and service.

For more information, visit: www.ibm.com.

BLOG COMMENTS POWERED BY DISQUS

LATEST COMMENTS

Support MC Press Online

$

Book Reviews

Resource Center

  • SB Profound WC 5536 Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application. You can find Part 1 here. In Part 2 of our free Node.js Webinar Series, Brian May teaches you the different tooling options available for writing code, debugging, and using Git for version control. Brian will briefly discuss the different tools available, and demonstrate his preferred setup for Node development on IBM i or any platform. Attend this webinar to learn:

  • SB Profound WP 5539More than ever, there is a demand for IT to deliver innovation. Your IBM i has been an essential part of your business operations for years. However, your organization may struggle to maintain the current system and implement new projects. The thousands of customers we've worked with and surveyed state that expectations regarding the digital footprint and vision of the company are not aligned with the current IT environment.

  • SB HelpSystems ROBOT Generic IBM announced the E1080 servers using the latest Power10 processor in September 2021. The most powerful processor from IBM to date, Power10 is designed to handle the demands of doing business in today’s high-tech atmosphere, including running cloud applications, supporting big data, and managing AI workloads. But what does Power10 mean for your data center? In this recorded webinar, IBMers Dan Sundt and Dylan Boday join IBM Power Champion Tom Huntington for a discussion on why Power10 technology is the right strategic investment if you run IBM i, AIX, or Linux. In this action-packed hour, Tom will share trends from the IBM i and AIX user communities while Dan and Dylan dive into the tech specs for key hardware, including:

  • Magic MarkTRY the one package that solves all your document design and printing challenges on all your platforms. Produce bar code labels, electronic forms, ad hoc reports, and RFID tags – without programming! MarkMagic is the only document design and print solution that combines report writing, WYSIWYG label and forms design, and conditional printing in one integrated product. Make sure your data survives when catastrophe hits. Request your trial now!  Request Now.

  • SB HelpSystems ROBOT GenericForms of ransomware has been around for over 30 years, and with more and more organizations suffering attacks each year, it continues to endure. What has made ransomware such a durable threat and what is the best way to combat it? In order to prevent ransomware, organizations must first understand how it works.

  • SB HelpSystems ROBOT GenericIT security is a top priority for businesses around the world, but most IBM i pros don’t know where to begin—and most cybersecurity experts don’t know IBM i. In this session, Robin Tatam explores the business impact of lax IBM i security, the top vulnerabilities putting IBM i at risk, and the steps you can take to protect your organization. If you’re looking to avoid unexpected downtime or corrupted data, you don’t want to miss this session.

  • SB HelpSystems ROBOT GenericCan you trust all of your users all of the time? A typical end user receives 16 malicious emails each month, but only 17 percent of these phishing campaigns are reported to IT. Once an attack is underway, most organizations won’t discover the breach until six months later. A staggering amount of damage can occur in that time. Despite these risks, 93 percent of organizations are leaving their IBM i systems vulnerable to cybercrime. In this on-demand webinar, IBM i security experts Robin Tatam and Sandi Moore will reveal:

  • FORTRA Disaster protection is vital to every business. Yet, it often consists of patched together procedures that are prone to error. From automatic backups to data encryption to media management, Robot automates the routine (yet often complex) tasks of iSeries backup and recovery, saving you time and money and making the process safer and more reliable. Automate your backups with the Robot Backup and Recovery Solution. Key features include:

  • FORTRAManaging messages on your IBM i can be more than a full-time job if you have to do it manually. Messages need a response and resources must be monitored—often over multiple systems and across platforms. How can you be sure you won’t miss important system events? Automate your message center with the Robot Message Management Solution. Key features include:

  • FORTRAThe thought of printing, distributing, and storing iSeries reports manually may reduce you to tears. Paper and labor costs associated with report generation can spiral out of control. Mountains of paper threaten to swamp your files. Robot automates report bursting, distribution, bundling, and archiving, and offers secure, selective online report viewing. Manage your reports with the Robot Report Management Solution. Key features include:

  • FORTRAFor over 30 years, Robot has been a leader in systems management for IBM i. With batch job creation and scheduling at its core, the Robot Job Scheduling Solution reduces the opportunity for human error and helps you maintain service levels, automating even the biggest, most complex runbooks. Manage your job schedule with the Robot Job Scheduling Solution. Key features include:

  • LANSA Business users want new applications now. Market and regulatory pressures require faster application updates and delivery into production. Your IBM i developers may be approaching retirement, and you see no sure way to fill their positions with experienced developers. In addition, you may be caught between maintaining your existing applications and the uncertainty of moving to something new.

  • LANSAWhen it comes to creating your business applications, there are hundreds of coding platforms and programming languages to choose from. These options range from very complex traditional programming languages to Low-Code platforms where sometimes no traditional coding experience is needed. Download our whitepaper, The Power of Writing Code in a Low-Code Solution, and:

  • LANSASupply Chain is becoming increasingly complex and unpredictable. From raw materials for manufacturing to food supply chains, the journey from source to production to delivery to consumers is marred with inefficiencies, manual processes, shortages, recalls, counterfeits, and scandals. In this webinar, we discuss how:

  • The MC Resource Centers bring you the widest selection of white papers, trial software, and on-demand webcasts for you to choose from. >> Review the list of White Papers, Trial Software or On-Demand Webcast at the MC Press Resource Center. >> Add the items to yru Cart and complet he checkout process and submit

  • Profound Logic Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application.

  • SB Profound WC 5536Join us for this hour-long webcast that will explore:

  • Fortra IT managers hoping to find new IBM i talent are discovering that the pool of experienced RPG programmers and operators or administrators with intimate knowledge of the operating system and the applications that run on it is small. This begs the question: How will you manage the platform that supports such a big part of your business? This guide offers strategies and software suggestions to help you plan IT staffing and resources and smooth the transition after your AS/400 talent retires. Read on to learn: