BEGIN:VCALENDAR
VERSION:2.0
PRODID:Linklings LLC
BEGIN:VTIMEZONE
TZID:America/New_York
X-LIC-LOCATION:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:19700308T020000
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:19701101T020000
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTAMP:20210402T160558Z
LOCATION:Track 4
DTSTART;TZID=America/New_York:20201112T132000
DTEND;TZID=America/New_York:20201112T134500
UID:submissions.supercomputing.org_SC20_sess210_ws_indis109@linklings.com
SUMMARY:Application Aware Software Defined Flows of Workflow Ensembles
DESCRIPTION:SCinet, Workshop\n\nApplication Aware Software Defined Flows o
 f Workflow Ensembles\n\nPapadimitriou, Lyons, Wang, Thareja, Tanaka...\n\n
 Computational science depends on complex, data intensive applications oper
 ating on datasets from a variety of scientific instruments. A major challe
 nge is the integration of data into the scientist’s workflow. Recent advan
 ces in dynamic, networked cloud resources provide the building blocks to c
 onstruct reconfiguration, end-to-end infrastructure that can increase scie
 ntific productivity, but applications are not taking advantage of them. In
  our previous work, we introduced DyNamo, that enabled CASA scientists to 
 improve the efficiency of their operations and effortlessly leverage capab
 ilities of the cloud resources available to them that previously remained 
 underutilized. However, the provided workflow automation did not satisfy a
 ll the operational requirements of CASA. Custom scripts were still in prod
 uction to manage workflow triggering, while multiple layer2 connections wo
 uld have to be allocated to maintain network QoS requirements.\n\nIn this 
 work, we enhance the DyNamo system with ensemble workflow management capab
 ilities, end-to-end infrastructure monitoring tools, as well as more advan
 ced network manipulation mechanisms.  To accommodate CASA’s operational ne
 eds we also extended the newly integrated Pegasus Ensemble Manager with fi
 le and time based triggering functionality, that improves managing workflo
 w ensembles. Additionally, Virtual Software Defined Exchange (vSDX) capabi
 lities have been extended, enabling link adaptation, flow prioritization a
 nd traffic control between endpoints. We evaluate the effects of the DyNam
 o's vSDX policies by using two CASA workflow ensembles competing for netwo
 rk resources, and we show that traffic shaping of the ensembles can lead t
 o a fairer use of the network links.\n\nTag: Big Data, Data Analytics, Com
 pression, and Management, Datacenter, Networks, Performance/Productivity M
 easurement and Evaluation, SCinet, Software-defined networking\n\nRegistra
 tion Category: Workshop Reg Pass
END:VEVENT
END:VCALENDAR