Invited Talk: Hybrid Network Modeling and Simulation for Scale

Hybrid Network Modeling and Simulation for Scale (大规模网络混合建模与仿真技术)

2nd Global Future Network Development Summit
第二届全球未来网络发展峰会
Nanjing, China
May 11-12, 2018

Abstract

Modeling and simulation (M&S) plays an important role in the design analysis and performance evaluation of complex systems. Many of these systems, such as computer networks, involve a large number of interrelated components and processes. Complex behaviors emerge as these components and processes inter-operate across multiple scales at various granularities. M&S must be able to provide sufficiently accurate results while coping with the scale and complexity. This talk will focus on some novel techniques in high-performance network modeling and simulation. One is hybrid network traffic modeling, which can offload the computationally intensive bulk traffic calculations to the background onto GPU, while leaving detailed simulation of network transactions in the foreground on CPU. The other is distributed network emulation with simulation symbiosis, which uses an abstract network model to coordinate distributed emulation instances with superimposed traffic model to represent large-scale network scenarios.

中文摘要:建模与模拟(Modeling and Simulation, M&S)在复杂系统的设计分析与性能评估中发挥着重要作用。这些系统中的很多(如计算机网络)涉及大量相关的组件和流程。随着这些组件和流程在不同粒度的多个尺度上进行交互操作,复杂行为就会相应出现。 M&S必须能够在应对规模和复杂性的同时提供足够准确的结果。这次演讲将集中讨论高性能网络建模和模拟中的一些新技术。一种是混合网络流量建模,它可以将计算密集型的大量流量计算转移到GPU后台上,同时在CPU前台留下网络事务的详细模拟。另一种是采用与模拟协同的分布式网络仿真,它采用抽象网络模型、通过叠加的流量模型来协调分布式仿真实例,以表示大规模的网络场景。

Invited Talk: High-Performance Modeling and Simulation

High-Performance Modeling and Simulation of Computer Networks

Universidade Federal de São Carlos (UFSCar)
São Carlos, Brazil
March 12, 2018

Abstract

Modeling and simulation (M&S) plays an important role in the design analysis and performance evaluation of complex systems. Many of these systems, such as computer networks, involve a large number of interrelated components and processes. Complex behaviors emerge as these components and processes inter-operate across multiple scales at various granularities. M&S must be able to provide sufficiently accurate results while coping with the scale and complexity. My talk will focus on some novel techniques in high-performance network modeling and simulation. One is hybrid network traffic modeling, which can offload the computationally intensive bulk traffic calculations to the background onto GPU, while leaving detailed simulation of network transactions in the foreground on CPU. The other is distributed network emulation with simulation symbiosis, which uses an abstract network model to coordinate distributed emulation instances with superimposed traffic model to represent large-scale network scenarios.

Invited Talk: Introducing FIU CAESCIR

Introducing FIU CAESCIR

2017 Annual CIRI PI Meeting
University of Illinois, Urbana-Champaign, IL, USA
October 19, 2017

Abstract

This talk gives an introduction to the Center for Advancing Education and Research on Critical Infrastructure Resilience (CAESCIR), a new project sponsored by the Department of Homeland Security (DHS) at the Florida International University (FIU).

Slides

Talk: Virtual Time Machine for Reproducibility

Virtual Time Machine for Large-Scale Reproducible Distributed Emulation

2017 GEFI Workshop
Rio de Janeiro, Brazil
October 26, 2017

Abstract

Cyber-infrastructure and meta-cloud testbeds, such as GENI, CloudLab, and Chameleon, are shared facilities that can be configured to provide a diverse and yet controllable environment for testing network protocols and distributed applications. Combined with emulation capabilities, these testbeds provide automated tools for allocating resources, instantiating applications, and collecting measurements. To facilitate reproducibility, they provide support for re-creating the execution environment between experiment runs. A major issue, however, with reproducibility on these systems is the lack of accurate control of time, especially when the experiment faces resource oversubscription. Virtual time management has been proposed for scheduling time dilated virtual machines to increase time fidelity. We hereby propose a unified resource and time scheme on cyber-infrastructure and meta-cloud testbeds to enable large-scale, high-capacity, high-fidelity, reproducible distributed emulation.

Slides

Invited Talk: Faster and Better Hybrid Testbeds for Future Network Research

Faster and Better Hybrid Testbeds for Future Network Research

June 1, 2017

Future Network Theory and Application Laboratory (FNL)
Beijing University of Posts and Telecommunications, Beijing, China
Host: Professor Tao Huang (黄韬)

Abstract: Modeling and simulation (M&S) plays an important role in the design analysis and performance evaluation of computer networks. The ability to execute large-scale simulation on high-end computing systems has enabled us to model detailed and complex network behaviors. However, the difficulty in reproducing realistic large-scale network phenomena goes beyond designing efficient parallel algorithms. This talk will cover some of the recent high-performance network modeling and simulation techniques, particularly in the context of developing testbeds for future network research. We will focus specifically on our recent research in real-time simulation, hybrid network traffic modeling, and symbiotic simulation and emulation.

Invited Talk: High-Performance Modeling and Simulation of Computer Networks

High-Performance Modeling and Simulation of Computer Networks

May 26, 2017

Department of Computer Science
Tsinghua University, Beijing, China
Host: Professor Zhihui Du (都志辉)

Abstract: Modeling and simulation (M&S) plays an important role in the design analysis and performance evaluation of complex systems. Many of these systems, such as computer networks, involve a large number of interrelated components and processes. Complex behaviors emerge as these components and processes inter-operate across multiple scales at various granularities. M&S must be able to provide sufficiently accurate results while coping with the scale and complexity.

My talk will focus on two novel techniques in high-performance network modeling and simulation. The first is a GPU-assisted hybrid network traffic modeling method. The hybrid approach offloads the computationally intensive bulk traffic calculations to the background onto GPU, while leaving detailed simulation of network transactions in the foreground on CPU. Our experiments show that the CPU-GPU hybrid approach can achieve significant performance improvement over the CPU-only approach.

The second technique is a distributed network emulation method based on simulation symbiosis. Mininet is a container-based emulation environment that can study networks consisted of virtual hosts and OpenFlow-enabled virtual switches on Linux. It is well-known, however, that experiments using Mininet may lose fidelity for large-scale networks and heavy traffic load. The proposed symbiotic approach uses an abstract network model to coordinate distributed Mininet instances with superimposed traffic to represent large-scale network scenarios.

Invited Talk: High-Performance Modeling and Simulation of Computer Networks

High-Performance Modeling and Simulation of Computer Networks

April 26, 2017

Laboratory of Information, Networking and Communication Sciences (LINCS), Paris, France
Host: Professor Dario Rossi

Abstract: Modeling and simulation (M&S) plays an important role in the design analysis and performance evaluation of complex systems. Many of these systems, such as computer networks, involve a large number of interrelated components and processes. Complex behaviors emerge as these components and processes inter-operate across multiple scales at various granularities. M&S must be able to provide sufficiently accurate results while coping with the scale and complexity.
My talk will focus on two novel techniques in high-performance network modeling and simulation. The first is a GPU-assisted hybrid network traffic modeling method. The hybrid approach offloads the computationally intensive bulk traffic calculations to the background onto GPU, while leaving detailed simulation of network transactions in the foreground on CPU. Our experiments show that the CPU-GPU hybrid approach can achieve significant performance improvement over the CPU-only approach.
The second technique is a distributed network emulation method based on simulation symbiosis. Mininet is a container-based emulation environment that can study networks consisted of virtual hosts and OpenFlow-enabled virtual switches on Linux. It is well-known, however, that experiments using Mininet may lose fidelity for large-scale networks and heavy traffic load. The proposed symbiotic approach uses an abstract network model to coordinate distributed Mininet instances with superimposed traffic to represent large-scale network scenarios.

Invited Talk: Extending PrimoGENI for Symbiotic Distributed Network Emulation

Extending PrimoGENI for Symbiotic Distributed Network Emulation

March 13, 2017

GENI Regional Workshop (GRW), held in conjunction with GEC25 Miami, Florida, USA

The talk includes recent development in hybrid at-scale network experimentation, which extends the previous PrimoGENI project.

[slides]

Invited Talk: Symbiotic Modeling and High-Performance Simulation

Symbiotic Modeling and High-Performance Simulation

January 19, 2017

Department of Computer Science, Colorado School of Mines
Host: Professor Tracy Camp

Abstract: Modeling and simulation plays an important role in the design analysis and performance evaluation of complex systems. Many of these systems, such as the internet and high-performance computing systems, involve a huge number of interrelated components and processes. Complex behaviors emerge as these components and processes inter-operate across multiple scales at various granularities. Modeling and simulation must be able to provide sufficiently accurate results while coping with the scale and the complexity of these systems. My talk will focus on some of our latest advances in high-performance modeling and simulation techniques. I will focus on two specific case studies, one on network emulation and the other on high-performance computing (HPC) modeling.
In the first case, I will present a novel distributed network emulation mechanism based on modeling symbiosis. Mininet is a container-based emulation environment that can study networks consisted of virtual hosts and OpenFlow-enabled virtual switches on Linux. It is well-known, however, that experiments using Mininet may lose fidelity for large-scale networks and heavy traffic load. We propose a symbiotic approach, where an abstract network model is used to coordinate the distributed emulation instances superimposed to represent the target network. In doing so, we can effectively study the behavior of real implementation of network applications on large-scale networks in a distributed environment.
In the second case, I will present our latest work on performance modeling of HPC architectures and applications. In collaboration with the Los Alamos National Laboratory, we have developed a highly efficient simulator, called Performance Prediction Toolkit (PPT), which can facilitate rapid and accurate performance prediction of large-scale scientific applications on existing and future HPC architectures.