A Trial Deployment of a Reliable Network-Multicast Application across Internet2
Data Analytics, Compression, and Management
Performance/Productivity Measurement and Evaluation
TimeThursday, 12 November 20203:15pm - 3:40pm EDT
DescriptionA continuing trend in many scientific disciplines is the growth in the volume of data collected by scientific instruments and the desire to rapidly and efficiently distribute this data to the scientific community. Transferring these large data sets to a geographically distributed research community consumes significant network bandwidth. As both the data volume and number of subscribers grows, reliable network multicast is a promising approach to reduce the rate of growth of the bandwidth needed to support efficient data distribution. In prior work, we identified a need for reliable network multicast, scientists engaged in atmospheric research subscribing to meteorology file-streams. Specifically, University Cooperation Atmospheric Research (UCAR) uses Local Data Manager (LDM) to disseminate the data. This work describes a trial deployment, in which eight university campuses are connected via corresponding regional Research-and-Education Networks (RENs) and Internet2. Using this deployment, we evaluated the new version of LDM, LDM7, which uses network multicast with a reliable transport protocol, and leverages Layer-2 (L2) multipoint Virtual LAN (VLAN). A performance monitoring system was deployed to collect real-time performance of LDM7, which showed that our proof-of-concept prototype worked significantly better than the current production LDM, LDM6, in two ways: (i) LDM7 can distribute file streams faster than LDM6. With six subscribers, an almost 22-fold improvement was observed with LDM7 at the 100 Mbps. And (ii) to achieve a similar performance, LDM7 significantly reduces the need for bandwidth, which is an around 90\% bandwidth saving for LDM7 to achieve 20 Mbps average throughput across four subscribers.