Creating a content delivery network for general science on the internet backbone using XCaches

¹ University of California San Diego, 9500 Gilman Dr, La Jolla, CA 92093
² University of Nebraska, 1400 R Street, Lincoln, NE 68588
³ University of Chicago, 5801 S Ellis Ave, Chicago, IL 60637
⁴ University of Southern California, Information Sciences Institute, 4676 Admiralty Way, Suite 1001, Marina del Rey, CA 90292
⁵ SLAC National Accelerator Laboratory, 2575 Sand Hill Rd, Menlo Park, CA 94025
⁶ Internet 2, 100 Phoenix Drive, Suite 111 Ann Arbor, MI 48108
⁷ UW Madison, 1210 W. Dayton St, Madison, WI 53706
⁸ Mortgridge Institute, 330 N Orchard St, Madison, WI 53715

^* e-mail: emfajard@ucsd.edu
^** e-mail: dweitzel@unl.edu
^*** e-mail: rynge@isi.edu
^**** e-mail: marian.zvada@cern.ch
^† e-mail: jhicks@internet2.edu
^‡ e-mail: matyas@cs.wisc.edu
^§ e-mail: blin@cs.wisc.edu
^¶ e-mail: paschos@uchicago.edu
^|| e-mail: BBockelman@morgridge.org
^** e-mail: abh@slac.stanford.edu
^†† e-mail: fkw@ucsd.edu
^‡‡ e-mail: isfiligoi@sdsc.edu

Published online: 16 November 2020

Abstract

A general problem faced by opportunistic users computing on the grid is that delivering cycles is simpler than delivering data to those cycles. In this project XRootD caches are placed on the internet backbone to create a content delivery network. Scientific workflows in the domains of high energy physics, gravitational waves, and others profit from this delivery network to increases CPU efficiency while decreasing network bandwidth use.