News, Technical

R functions for interacting with the EDI Repository API

The EDI Repository API facilitates automated data processing and publication workflows, thereby enabling reproducible and efficient data package management. Four new R functions have been added to the EDIutils R library supporting package reservation (pkg_reserve_id.R), evaluation (pkg_evaluation.R), upload (pkg_upload.R), and update (pkg_update.R). The full suite of PASTA+ API calls from the R environment will be available soon!

News, Technical

EDI behind the curtains

EDI technical staff recently upgraded our virtualization infrastructure to the latest version of VMware’s ESXi software (from version 5 to 6.5). All of EDI’s servers, including those that run the PASTA+ data repository software, operate as virtual clients across six ESXi host systems. These virtual hosts are configured to operate between 6 and 12 clients at one time, with some room left over to shuffle systems  and for testing. The ESXi host systems are located on the campus of the University of New Mexico and connect directly to a dedicated 10Gb/s connection using UNM’s Science DMZ research network. Wide-area Internet connectivity to UNM includes 100Gb/s connections to the DOE Energy Sciences Network (ESNet) and the Western Regional Network, both through the Albuquerque Gigapop. EDI’s data storage capacity is currently at 30TB, with an equivalent 30TB mirror storage device for near-time backups and smaller SSD disks that are used for off-site backup purposes. EDI also uses the AWS Glacier storage as a long-term “cold data” archive.

News, Technical

Experimental use of Sitemaps.org and Schema.org metadata for Search Engine Optimization

The Environmental Data Initiative (EDI) has just released an experimental implementation of the sitemaps.org and schema.org metadata to support search engine discovery and indexing (often called Search Engine Optimization). Sitemaps metadata serves as a table of contents for high-value information found on websites so that search engines may more easily discover relevant web pages to index. For EDI, the sitemaps metadata points to the most recent data package landing pages accessible through the EDI Data Portal and is refreshed hourly. Continue reading “Experimental use of Sitemaps.org and Schema.org metadata for Search Engine Optimization”

News, Technical

Updates from the EDI technical team

The EDI technical team has a few new updates to convey to our community of users.
  1. All data package “landing pages” in our test environment Data Portal are now labeled with a “Test Data Package” watermark so they will not be mistaken for the real McCoy. Only data packages displayed on the primary Data Portal (https://portal.edirepository.org/nis) should be considered bone-fide and a published (with a “real” DOI) data package.
  2. Continue reading “Updates from the EDI technical team”

News, Technical

New informational check released for EDI data portal

The EDI data portal has added a new informational check to the suite of data congruence checks it runs on every data package submitted. This check is information only and the community felt it was valuable, so we released it outside the regular twice-yearly schedule on July 11th, 2018. For detailed information contact info@environmentaldatainitiative.org. Continue reading “New informational check released for EDI data portal”