research-article

A live storage migration mechanism over wan and its performance evaluation

Authors:

Takahiro Hirofuchi,

Hidemoto Nakada,

Hirotaka Ogawa,

Satoshi Itoh, and

Satoshi SekiguchiAuthors Info & Claims

VTDC '09: Proceedings of the 3rd international workshop on Virtualization technologies in distributed computing

June 2009

Pages 67 - 74

https://doi.org/10.1145/1555336.1555348

Published: 15 June 2009 Publication History

Abstract

Live migration of virtual machines is a key technology for the next generation of IaaS cloud services, contributing to dynamic portability and mobility of VM-based services among datacenters. The practical use of live migration, however, is still limited inside a single datacenter. In WAN environments, network latencies cause inevitable I/O performance degradation of remotely-shared storage between source and destination sites; which is required to continue disk access of VMs before/after live migration. In our previous work, we proposed a transparent, relocatable I/O mechanism for VM migration, which enables VM disk images to be completely migrated to remote nodes without any modification of virtual machine monitors. In this paper, we present detailed performance evaluation of the proposed system, emulating a realistic WAN environment between remote datacenters. Experiments showed the proposed system achieved feasible I/O performance for various workloads including I/O intensive applications. Its background copy mechanism efficiently prefetches not-yet-cached blocks by exploiting the available bandwidth of WAN, thereby minimizing temporary performance degradation of the migrating VM system.

References

[1]

Bonnie++. http://sourceforge.net/projects/bonnie/.

[2]

R. Bradford, E. Kotsovinos, A. Feldmann, and >H. Schiöberg. Live wide-area migration of virtual machines including local persistent state. In Proceedings of the 3rd International Conference on Virtual Execution Environments, pages 169--179. ACM Press, 2007.

Digital Library

[3]

P. T. Breuer, A. M. Lopez, and A. G. Ares. The network block device, 1999.

[4]

R. Card, T. Ts'o, and S. Tweedie. Design and implementation of the second extended filesystem. In Proceedings of the First Dutch International Symposium on Linux, 1995.

[5]

C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proceedings of the 2nd Symposium on Networked Systems Design and Implementation, pages 273--286. USENIX Association, 2005.

Digital Library

[6]

S. Hemminger. Network emulation with NetEm. In Proceedings of the Sixth Australia's National Linux Conference (LCA2005), 2005.

[7]

T. Hirofuchi, H. Nakada, H. Ogawa, S. Itoh, and S. Sekiguchi. A live storage migration mechanism over wan for relocatable virtual machine services on clouds. In Proceedings of the International Workshop on Cloud Computing (Cloud 2009), (Acceped), May 2009.

Digital Library

[8]

T. Hirofuchi, T. Yokoi, T. Ebara, Y. Tanimura, H. Ogawa, H. Nakada, Y. Tanaka, and S. Sekiguchi. A multi-site virtual cluster system for wide area networks. In Proceedings of the First USENIX Workshop in Large-Scale Computing. USENIX Association, 2008.

Digital Library

[9]

M. Kozuch, M. Satyanarayanan, T. Bressound, and Y. Ke. Efficient state transfer for Internet suspend/resume. Technical Report IRP-TR-02-03, Intel Research Pittsburgh, May 2002.

[10]

Y. Luo, B. Zhang, X. Wang, Z. Wang, and Y. Sun. Live and incremental whole-system migration of virtual machines using block-bitmap. In Proceedings of Cluster 2008: IEEE International Conference on Cluster Computing. IEEE Computer Society, 2008.

[11]

M. F. X. J. Oberhumer. LZO -- a real-time data compression library. http://www.oberhumer.com/opensource/lzo/.

[12]

C. P. Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M. S. Lam, and M. Rosenblum. Optimizing the migration of virtual computers. ACM SIGOPS Operating System Review, 36(SI):377--390, 2002.

Digital Library

[13]

J. Satran, K. Meth, C. Sapuntzakis, M. Chadalapaka, and E. Zeidner. Internet Small Computer Systems Interface (iSCSI). RFC 3720, Apr. 2004.

Digital Library

[14]

M. Satyanarayanan, J. J. Kistler, P. Kumar, M. E. Okasaki, E. H. Siegel, and D. C. Steere. Coda: A highly available file system for a distributed workstation environment. IEEE Transactions on Computers, 39(4):447--459, 1990.

Digital Library

[15]

Sun Microsystems. NFS: Network file system protocol specification. RFC 1094, Mar. 1989.

Digital Library

[16]

S. C. Tweedie. Journaling the Linux ext2fs filesystem. LinuxExpo '98, 1998.

[17]

VMware, Inc. VMware Storage VMotion: Non-disruptive, live migration of virtual machine storage. (Product Datasheet).

Cited By

Sayal M(2023)Private Storage Cloud for Facilitate the Functions of OrganizationsInternational Journal of Information technology and Computer Engineering10.55529/ijitc.36.43.51(43-51)Online publication date: 23-Sep-2023
https://doi.org/10.55529/ijitc.36.43.51
(2018)Applications nature aware virtual machine provisioning in cloudInternational Journal of Ad Hoc and Ubiquitous Computing10.1504/IJAHUC.2018.08957927:2(93-107)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1504/IJAHUC.2018.089579
Zhang FLiu GFu XYahyapour R(2018)A Survey on Virtual Machine Migration: Challenges, Techniques, and Open IssuesIEEE Communications Surveys & Tutorials10.1109/COMST.2018.279488120:2(1206-1243)Online publication date: Oct-2019
https://doi.org/10.1109/COMST.2018.2794881
Show More Cited By

Index Terms

A live storage migration mechanism over wan and its performance evaluation
1. Information systems
  1. Information storage systems
    1. Storage management
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        File systems management
        Memory management

Recommendations

Efficient live migration of virtual machines using shared storage
VEE '13

Live migration of virtual machines (VM) across distinct physical hosts is an important feature of virtualization technology for maintenance, load-balancing and energy reduction, especially so for data centers operators and cluster service providers. ...
Read More
Efficient live migration of virtual machines using shared storage
VEE '13: Proceedings of the 9th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments

Live migration of virtual machines (VM) across distinct physical hosts is an important feature of virtualization technology for maintenance, load-balancing and energy reduction, especially so for data centers operators and cluster service providers. ...
Read More
Traffic-sensitive live migration of virtual machines
CCGRID '15: Proceedings of the 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing

In this paper we address the problem of network contention between the migration traffic and the Virtual Machine (VM) application traffic for the live migration of co-located Virtual Machines. When VMs are migrated with pre-copy, they run at the source ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VTDC '09: Proceedings of the 3rd international workshop on Virtualization technologies in distributed computing

June 2009

82 pages

ISBN:9781605585802

DOI:10.1145/1555336

General Chair:
Kate Keahey
University of Chicago and Argonne National Laboratory, USA
,
Program Chair:
Renato Figueiredo
University of Florida, USA

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 June 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICAC '09

Sponsor:

ICAC '09: 6th International Conference on Autonomic Computing

June 15, 2009

Barcelona, Spain

Acceptance Rates

Overall Acceptance Rate 5 of 10 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

35
Total Citations
View Citations
990
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Other Metrics

View Author Metrics

Citations

Cited By

Sayal M(2023)Private Storage Cloud for Facilitate the Functions of OrganizationsInternational Journal of Information technology and Computer Engineering10.55529/ijitc.36.43.51(43-51)Online publication date: 23-Sep-2023
https://doi.org/10.55529/ijitc.36.43.51
(2018)Applications nature aware virtual machine provisioning in cloudInternational Journal of Ad Hoc and Ubiquitous Computing10.1504/IJAHUC.2018.08957927:2(93-107)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1504/IJAHUC.2018.089579
Zhang FLiu GFu XYahyapour R(2018)A Survey on Virtual Machine Migration: Challenges, Techniques, and Open IssuesIEEE Communications Surveys & Tutorials10.1109/COMST.2018.279488120:2(1206-1243)Online publication date: Oct-2019
https://doi.org/10.1109/COMST.2018.2794881
Shen ZJia QSela GSong WWeatherspoon HVan Renesse R(2017)SupercloudACM Transactions on Computer Systems10.1145/313203835:2(1-33)Online publication date: 4-Oct-2017
https://dl.acm.org/doi/10.1145/3132038
Shen ZJia QSela GRainero BSong Wvan Renesse RWeatherspoon H(2016)Follow the Sun through the CloudsProceedings of the Seventh ACM Symposium on Cloud Computing10.1145/2987550.2987561(141-154)Online publication date: 5-Oct-2016
https://dl.acm.org/doi/10.1145/2987550.2987561
Yang CShih WHuang CJiang FChu W(2016)On construction of a distributed data storage system in cloudComputing10.1007/s00607-014-0399-498:1-2(93-118)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.1007/s00607-014-0399-4
Raghavendra Achar Santhi Thilagam PMeghana Niha Fathima Haris BHarshita Bhat Ekta K(2016)Dynamic Resource Allocation for Multi-tier Applications in CloudProceedings of Fifth International Conference on Soft Computing for Problem Solving10.1007/978-981-10-0448-3_79(939-950)Online publication date: 15-Mar-2016
https://doi.org/10.1007/978-981-10-0448-3_79
Giacobbe MCelesti AFazio MVillari MPuliafito A(2015)Evaluating a cloud federation ecosystem to reduce carbon footprint by moving computational resourcesProceedings of the 2015 IEEE Symposium on Computers and Communication (ISCC)10.1109/ISCC.2015.7405500(99-104)Online publication date: 6-Jul-2015
https://dl.acm.org/doi/10.1109/ISCC.2015.7405500
Ahmad RGani AHamid SShiraz MYousafzai AXia F(2015)A survey on virtual machine migration and server consolidation frameworks for cloud data centersJournal of Network and Computer Applications10.1016/j.jnca.2015.02.00252:C(11-25)Online publication date: 1-Jun-2015
https://dl.acm.org/doi/10.1016/j.jnca.2015.02.002
Ahmad RGani AAb. Hamid SShiraz MXia FMadani S(2015)Virtual machine migration in cloud data centersThe Journal of Supercomputing10.1007/s11227-015-1400-571:7(2473-2515)Online publication date: 1-Jul-2015
https://dl.acm.org/doi/10.1007/s11227-015-1400-5
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents