Course: Science Cloud Summer School 2012

Abstract

The Science Cloud Summer School targets education and training of graduate students and the fostering of a community around a topic that has increasing interest and relevance: the use of cloud computing technologies in science - including infrastructure-as-a-service and platform-as-a-service. Because cloud computing systems and technologies provide a considerable departure from traditional models and evolve at a rapid pace, this event would provide a basis for students to immerse in a focused, intensive curriculum to learn fundamentals and experiment with these technologies in practice. We will cover topics of interest to students with both application and computer science focus.

Official Tumblr Web Site
Forum: http://archive.futuregrid.org/forums/fg-class-and-tutorial-forums/summer...
FutureGrid Account Creation: http://archive.futuregrid.org/projects/241/register
Participants: http://archive.futuregrid.org/projects/241/participants
Videos: http://archive.futuregrid.org/gallery/sciencecloudsummerschool2012

For an alternative view without the boxes on the right see here.

Presentations from Day 1

Day 1: Monday July 30 INTRODUCTION
all day	Signing up for a FutureGrid Account Prerequisit to participate in the Lab Sessions	Gregor von Laszewski Fugang Wang Shariff Isalm Tak-lon Wu others TBD	Indiana University	html [1]
11:00am - 12:00pm	Introduction	Geoffrey Fox	Indiana University	PPTX [2]
12:00pm - 1:00pm	Application: Biology on the Cloud	Michael Schatz	Cold Spring Harbor	PPT [3]
1:00pm - 1:30pm	Infrastructure Used: FutureGrid	Geoffrey Fox	Indiana University	PPTX [4]
1:30pm - 2:30pm	Lunch Break
2:30pm - 3:30pm	Introduction to virtual high performance computing clusters	Thomas J. Hacker	Purdue University	PPTX [5]
3:30pm - 4:30pm	Nimbus: Infrastructure Cloud Computing for Science Resources used: hotel, 40 servers sierra, 17 servers	Kate Keahey	University of Chicago, Argonne National Laboratory	PPTX [6]
4:30pm - 5:00pm	Afternoon Break
5:00pm - 5:45pm	Nimbus Infrastructure: Hands-on Using Infrastructure Clouds Resources used: hotel, 40 servers sierra, 17 servers	John Bresnahan	University of Chicago, Argonne National Laboratory	html [7]
5:45pm - 6:45pm	Nimbus Platform: Managing Deployments in Multi-Cloud Environments Resources used: hotel, 40 servers sierra, 17 servers	John Bresnahan, Mike Wilde, Kate Keahey	University of Chicago, Argonne National Laboratory	PPTX [8]
6:45pm - 7:00pm	Wrap-Up Session

Presentations from Day 2

Day 2: Tuesday July 31
all day	Signing up for a FutureGrid Account Prerequisit to participate in the Lab Sessions	Gregor von Laszewski Fugang Wang Shariff Isalm Tak-lon Wu others TBD	Indiana University	html [1]
11:00am - 12:00pm	Running MapReduce in Non-Traditional Environments	Abhishek Chandra	University of Minnesota	PPTX [9]
12:00pm - 1:30pm	Virtual Clusters Supporting MapReduce in Cloud Lab Session: Reproducible Environment for Scientific Applications Resources used: laptop, virtualbox, india, eucalyptus	Jonathan Klinginsmith Tak-Lon Wu	Indiana University	PPTX [10] PPTX [11] HTML [12]
1:30pm - 2:30pm	Lunch Break
2:30pm - 4:30pm	MapReduce and NOSQL Cloud Storage Resources used: laptop, virtualbox, india, eucalyptus	Jerome Mitchell, Xiaoming Gao	Indiana University	PPTX [13] HTML [14] HTML [15]
4:30pm - 5:00pm	Afternoon Break
5:00pm - 7:00pm	Data Mining with Twister Iterative MapReduce	Judy Qiu	Indiana University	PPTX [16] PPTX [17]
6:45pm - 7:00pm	Wrap-Up Session

Presentations from Day 3

Day 3: August 1, ACADEMIC AND COMMERCIAL CLOUD INFRASTRUCTURE
all day	Signing up for a FutureGrid Account Prerequisit to participate in the Lab Sessions	Gregor von Laszewski Fugang Wang Shariff Isalm Tak-lon Wu others TBD	Indiana University	html [1]
11:00am - 1:00pm	Building Scalable Data Intensive Applications on the Cloud with Makeflow and WorkQueue	Douglas Thain	Notre Dame	html [18]
1:00pm - 2:00pm	Lunch Break
2:30pm - 3:30pm	Commercial IaaS/PaaS I: AWS for Scientists	Jamie Kinney	Amazon Web Services	PDF [19]
3:30pm - 4:30pm	Commercial IaaS/PaaS II: Azure and Twister4Azure	Thilina Gunarathne	Indiana University	PPTX PPTX [20]
4:30pm - 5:00pm	Afternoon Break
5:00pm - 5:45pm	Networking and Clouds	Martin Swany	Indiana University	PDF [21]
5:45pm - 6:45pm	IaaS in Action II: OpenStack, , Indiana University IaaS in Action II: FutureGrid RAIN: Dynamic Provisioning on Bare Metal and IaaS in a Federated Cloud Follow allong demos, lab can be done in self study	Gregor von Laszewski, Javier Diaz	Indiana University	PPT [22] PPT [23] PPTX [24]
6:45pm - 7:00pm	Wrap-Up Session Create a new FutureGrid Project Status of FutureGrid FutureGrid Metrics FutureGrid Manual (Table of Contents) MyHadoop Other Tutorials What's up in the FutureGrid Portal Add your Portrait

Presentations from Day 4

Day 4: August 2, CYBERINFRASTRUCTURE/HPC AND CLOUDS: TECHNOLOGY AND APPLICATIONS
all day	Signing up for a FutureGrid Account Prerequisit to participate in the Lab Sessions	Gregor von Laszewski Fugang Wang Shariff Isalm Tak-lon Wu others TBD	Indiana University	html [1]
11:00am - 1:15pm	Federating HPC, Cyberinfrastructure and Clouds using CometCloud I Resources used: hotel, 40 servers sierra, 17 servers	Manish Parashar	Rutgers University	HTML [25]
1:15pm - 2:15pm	Lunch Break
2:30pm - 4:15pm	Federating HPC, Cyberinfrastructure and Clouds using CometCloud II Resources used: hotel, 40 servers sierra, 17 servers	Manish Parashar	Rutgers University
4:15pm - 4:45pm	Afternoon Break
4:45pm - 5:45pm	Magellan: Evaluating Cloud Computing for Science	Lavanya Ramakrishnan	Lawrence Berkeley National Laboratory	PDF [26]
5:45pm - 6:45pm	Scientific Workflows in the Cloud	Gideon Juve	USC	PPT [27]
6:45pm - 7:00pm	Wrap-Up Session

Presentations from Day 5

Day 5: August 3, EDUCATION APPLICATIONS AND ADVANCED TECHNOLOGY
all day	Signing up for a FutureGrid Account Prerequisit to participate in the Lab Sessions	Gregor von Laszewski Fugang Wang Shariff Isalm Tak-lon Wu others TBD	Indiana University	html [1]
11:00am - 12:00pm	Cloud Technology: Virtual Private Clusters: Virtual Appliances and Networks in the Cloud	Renato Figueiredo	University of Florida	PPT [28]
12:00pm - 1:00pm	Applications of Cloud: DOE Systems Biology Knowledgebase	Rick Stevens	Argonne and University of Chicago	PPT [29]
1:00pm - 1:30pm	Survey
1:30pm - 2:30pm	Lunch Break
2:30pm - 3:30pm	Cloud Technology: Cloud Security: New Challenges and New Opportunities	XiaoFeng Wang	Indiana University	PPTX [30]
3:30pm - 4:30pm	Applications of Cloud: The iPlant Collaborative: Science in the Cloud for Plant Biology	Dan Stanzione	TACC	PDF [31]
4:30pm - 5:00pm	Afternoon Break
5:00pm - 5:45pm	Cloud Technology: GPU on Clouds	Andrew J. Younge	Indiana University	PPTX [32]
5:45pm - 6:00pm	Wrap-Up Session

References

[fg-2063] von Laszewski, G., J. Bresnahan, and F. Wang,
"Signing up for a FutureGrid Account",
Science Cloud Summer School 2012, vol. 2012, no. 07/2012, Bloomington, FutureGrid Portal, 2012.
[fg-2064] Fox, G.,
"Introduction",
Science Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.
[fg-2065] Schatz, M.,
"Application: Biology on the Cloud",
Science Cloud Summer School 2012, Bloomington, IN, Cold Spring Harbor, 07/2012.
[fg-2066] Fox, G.,
"Infrastructure Used: FutureGrid",
Science Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.
[fg-2067] Hacker, T.,
"Introduction to virtual high performance computing clusters",
Science Cloud Summer School 2012, Bloomington, IN, Purdue University, 07/2012.
[fg-2068] Bresnahan, J., and K. Keahey,
"Nimbus: Introduction to IaaS Cloud Computing for Science",
Science Cloud Summer School 2012, Bloomington, IN, University of Chicago/Argonne National Laboratory, 07/2012.
[fg-2069] Bresnahan, J.,
"Nimbus Infrastructure: Hands-on Using IaaS Clouds",
Science Cloud Summer School 2012, Bloomington, IN, University of Chicago/Argonne National Laboratory, 07/2012.
[fg-2070] Bresnahan, J., K. Keahey, and M. Wilde,
"Nimbus Platform: Managing Deployments in Multi-Cloud Environments",
Science Cloud Summer School 2012, Bloomington, IN, University of Chicago/Argonne National Laboratory, 07/2012.
[fg-2071] Chandra, A.,
"Running MapReduce in Non-Traditional Environments",
Science Cloud Summer School 2012, Bloomington, IN, University of Minnesota, 07/2012.
[fg-2072] Klinginsmith, J.,
"Virtual Clusters Supporting MapReduce in Cloud",
Science Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.
[fg-2125] Wu, T. - L.,
Lab Session: Reproducible Environment for Scientific Applications,
, Bloomington, IN, 07/2012.
[fg-2129] Wu, T. - L.,
"Tutorial: Reproducible Environment for Scientific Applications",
Science Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.
[fg-2104] Mitchell, J.,
"Good Ole Hadoop! How We Love Thee!",
Virtual Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.
[fg-2133] Li, H., and J. Qiu,
"Hands on Tutorial: Pig ",
Virtual Cloud Summer School 2012, Bloomington, IN, 07/2012.
[fg-2110] Gunarathne, T., and H. Li,
"HBase Hands-on Prerequisites and Resources",
Virtual Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.
[fg-2101] Li, H., and J. Qiu,
"High Level Language: Pig Latin",
Virtual Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.
[fg-2112] Qiu, J., and B. Zhang,
Data Mining with Twister Iterative MapReduce,
, Submitted.
[fg-2075] Thain, D.,
"Building Scalable Data Intensive Applications on the Cloud with Makeflow and WorkQueue",
Science Cloud Summer School 2012, Bloomington, IN, Notre Dame, 07/2012.
[fg-2076] Kinney, J.,
"Commercial IaaS/PaaS I: AWS for Scientists",
Science Cloud Summer School 2012, Bloomington, IN, Amazon Web Services, 07/2012.
[fg-2077] Gunarathne, T.,
"Commercial IaaS/PaaS II: Windows Azure and Twister4Azure",
Science Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.
[fg-2078] Swany, M.,
"Networking and Clouds",
Science Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.
[fg-2079] von Laszewski, G., and J. Diaz,
"IaaS in Action II: Eucalyptus OpenStack",
Science Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.
[fg-2080] von Laszewski, G., and J. Diaz,
"IaaS in Action II: RAIN Dynamic Provisioning on Bare Metal and IaaS",
Science Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.
[fg-2081] von Laszewski, G., and J. Diaz,
"IaaS in Action II: fg-move: Moving Resources Between Federated Clouds and Bare Metal",
Science Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.
[fg-2082] Parashar, M., and M. AbdelBaky,
"Federating HPC, Cyberinfrastructure and Clouds using CometCloud",
Science Cloud Summer School 2012, Bloomington, IN, Rutgers University, 07/2012.
[fg-2083] Ramakrishnan, L.,
"Magellan: Evaluating Cloud Computing for Science",
Science Cloud Summer School 2012, Bloomington, IN, Lawrence Berkeley National Laboratory, 07/2012.
[fg-2084] Juve, G.,
"Scientific Workflows in the Cloud",
Science Cloud Summer School 2012, Bloomington, IN, USC, 07/2012.
[fg-2085] Figueiredo, R.,
"Cloud Technology: Virtual Private Clusters: Virtual Appliances and Networks in the Cloud",
Science Cloud Summer School 2012, Bloomington, IN, University of Florida, 07/2012.
[fg-2086] Stevens, R.,
"Applications of Cloud: DOE Systems Biology Knowledgebase",
Science Cloud Summer School 2012, Bloomington, IN, Argonne and University of Chicago, 07/2012.
[fg-2087] Wang, X. F.,
"Cloud Technology: Cloud Security: New Challenges and New Opportunities",
Science Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.
[fg-2088] Stanzione, D.,
"Applications of Cloud: The iPlant Collaborative: Science in the Cloud for Plant Biology",
Science Cloud Summer School 2012, Bloomington, IN, TACC, 07/2012.
[fg-2089] Younge, A. J.,
"Cloud Technology: GPU on Clouds",
Science Cloud Summer School 2012, Bloomington, IN, Indiana University, 07/2012.

Intellectual Merit

This tutorial will educate members of the community.

Broader Impact

This tutorial will educate members of the community.

Use of FutureGrid

FutureGrid will be used to support the hands on sessions

Scale Of Use

Due to the many users we will focus on the start of many small environments. Users may have to team up into teams of two in case we have too many users.

Publications

[fg-2133] Li, H., and J. Qiu, "Hands on Tutorial: Pig ", 07/2012
[fg-2129] Wu, T. - L., "Tutorial: Reproducible Environment for Scientific Applications", Indiana University, 07/2012
[fg-2125] Wu, T. - L., "Lab Session: Reproducible Environment for Scientific Applications", 07/2012
[fg-2112] Qiu, J., and B. Zhang, "Data Mining with Twister Iterative MapReduce",
[fg-2110] Gunarathne, T., and H. Li, "HBase Hands-on Prerequisites and Resources", Indiana University, 07/2012
[fg-2104] Mitchell, J., "Good Ole Hadoop! How We Love Thee!", Indiana University, 07/2012
[fg-2102] Klinginsmith, J., and T. - L. Wu, "Virtualbox Appliance Installation Guide",
[fg-2101] Li, H., and J. Qiu, "High Level Language: Pig Latin", Indiana University, 07/2012
[fg-2089] Younge, A. J., "Cloud Technology: GPU on Clouds", Indiana University, 07/2012
[fg-2088] Stanzione, D., "Applications of Cloud: The iPlant Collaborative: Science in the Cloud for Plant Biology", TACC, 07/2012
[fg-2087] Wang, X. F., "Cloud Technology: Cloud Security: New Challenges and New Opportunities", Indiana University, 07/2012
[fg-2086] Stevens, R., "Applications of Cloud: DOE Systems Biology Knowledgebase", Argonne and University of Chicago, 07/2012
[fg-2085] Figueiredo, R., "Cloud Technology: Virtual Private Clusters: Virtual Appliances and Networks in the Cloud", University of Florida, 07/2012
[fg-2084] Juve, G., "Scientific Workflows in the Cloud", USC, 07/2012
[fg-2083] Ramakrishnan, L., "Magellan: Evaluating Cloud Computing for Science", Lawrence Berkeley National Laboratory, 07/2012
[fg-2082] Parashar, M., and M. AbdelBaky, "Federating HPC, Cyberinfrastructure and Clouds using CometCloud", Rutgers University, 07/2012
[fg-2081] von Laszewski, G., and J. Diaz, "IaaS in Action II: fg-move: Moving Resources Between Federated Clouds and Bare Metal", Indiana University, 07/2012
[fg-2080] von Laszewski, G., and J. Diaz, "IaaS in Action II: RAIN Dynamic Provisioning on Bare Metal and IaaS", Indiana University, 07/2012
[fg-2079] von Laszewski, G., and J. Diaz, "IaaS in Action II: Eucalyptus OpenStack", Indiana University, 07/2012
[fg-2078] Swany, M., "Networking and Clouds", Indiana University, 07/2012
[fg-2077] Gunarathne, T., "Commercial IaaS/PaaS II: Windows Azure and Twister4Azure", Indiana University, 07/2012
[fg-2076] Kinney, J., "Commercial IaaS/PaaS I: AWS for Scientists", Amazon Web Services, 07/2012
[fg-2075] Thain, D., "Building Scalable Data Intensive Applications on the Cloud with Makeflow and WorkQueue", Notre Dame, 07/2012
[fg-2074] Qiu, J., "Data Mining with Iterative MapReduce: Twister & Twister4Azure", Indiana University, 07/2012
[fg-2073] Gao, X., H. Li, and T. Gunarathne, "MapReduce and NOSQL Cloud Storage", Indiana University, 07/2012
[fg-2072] Klinginsmith, J., "Virtual Clusters Supporting MapReduce in Cloud", Indiana University, 07/2012
[fg-2071] Chandra, A., "Running MapReduce in Non-Traditional Environments", University of Minnesota, 07/2012
[fg-2070] Bresnahan, J., K. Keahey, and M. Wilde, "Nimbus Platform: Managing Deployments in Multi-Cloud Environments", University of Chicago/Argonne National Laboratory, 07/2012
[fg-2069] Bresnahan, J., "Nimbus Infrastructure: Hands-on Using IaaS Clouds", University of Chicago/Argonne National Laboratory, 07/2012
[fg-2068] Bresnahan, J., and K. Keahey, "Nimbus: Introduction to IaaS Cloud Computing for Science", University of Chicago/Argonne National Laboratory, 07/2012
[fg-2067] Hacker, T., "Introduction to virtual high performance computing clusters", Purdue University, 07/2012
[fg-2066] Fox, G., "Infrastructure Used: FutureGrid", Indiana University, 07/2012
[fg-2065] Schatz, M., "Application: Biology on the Cloud", Cold Spring Harbor, 07/2012
[fg-2064] Fox, G., "Introduction", Indiana University, 07/2012
[fg-2063] von Laszewski, G., J. Bresnahan, and F. Wang, "Signing up for a FutureGrid Account", FutureGrid Portal,
[fg-2049] "Public Forum for the Summer School 2012",
[fg-2044] "Agenda for the Science Cloud Summer School 2012",

Project Number: FG-241

Project Lead: Gregor von Laszewski

Project Manager: Fugang Wang

Institution: Indiana University

Project Status: Closed

View Project Details

Project Members

Aaron Todd

Aaron Trefler

Abhik Seal

Abhirup Chakraborty

Adetunji Anthony Adeleke

Ahmad Hosseinizadeh

Alexander Pacheco

Ali Dashti

Alka Gupta

Anand Singh

Andrew Cho

Anna Pechenkina

Aparna Tiwari

Aram Saloot

Arkarachai Fungtammasan

Barbara Ann O'Leary

Behnam Azimi

Benjamin Ong

Bhupender Thakur

Bill Brouwer

Binbin Wang

Blake Stamps

Caglar Koylu

Charles Welzig

Chin Hua Kong

Christopher Kallas

Chun-Yuan Huang

Chunyu Chen

Clayton Davis

Colleen Lindell

Cory Gaston

Daniel Dauhajre

Daniel LaPine

Daniel Parker

Daniel Standage

Darius Ferguson

David Stack

Deepak Gupta

Dena Izadi

Devesh Shrestha

Dirk Colbry

Douglas Cook

Drew Montag

Dushyant Arora

Edward Byrne

Edward Lau

Elena Slobounov

Elnaz Esmaeilzadeh Seylabi

Elvira Caldwell

Epaphras Matsangaise

Euisung Jung

Fei Xue

Feifan Liu

Fugang Wang

Galen Arnold

Gebretensae Tzadu

Geoffrey Fox

George Otto

Gideon Juve

Glenn K. Lockwood

Guangchen Ruan

Hai Jin

Harsh Savla

Hoofar Pourzand

Hu Wang

Hui Li

Hui Yang

Jack Gundrum

James Fox

Jamika Baltrop

Jason Piwarski

Javier Diaz Montes

Jay Urbain

Jayesh Kawli

Jeaime Powell

Jeffrey Borck

Jerry Ebalunode

Jiaan Zeng

Jing Hong

Jun Lai

Jun Wan

Jung Lee

Junjun Xin

Justus Nyagwencha

Kailash Nagarkoti

Karen Coulter

Karissa McKElvey

Karthik Mallekav Nagaraj

Katherine Fitch

Kathryn Traxler

Kei Hang Katie Chan

Klaus Driesslein

Kourosh Ravvaz

Kuchumbi Hayden

L. Scott Johnson

Le-Shin Wu

Lei Shi

Linda McMahan

Lixun Zhang

Mark Hornick

Massimo Canonico

Matthew Quandahl

Matthew Route

Matthew Spellings

Meenu Pandey

Michael Ziegler

Ming Zeng

Mohammad Tohid

Mohammad Ali Namdarghanbari

Mohsen Lesani

Monthien Satimanon

Muhammed Hassan

N Khalid Ahmed

Na Jin Seo

Narcis Madern

Nikolai Sergueev

Nitin Kumar

Patrina Bly

Peng Chen

Peng Gao

Philip Crotwell

Prakashan Korambath

Qiyang Hu

Quan Zhou

Rahul Joglekar

Ralf Kotulla

Ramesh Prasad

Raminderjeet Singh

Raunaq Malhotra

Rebeca Campos

Richard Wheeler

Robert Marine

Rui Du

Sagar Budavi

Saliya Ekanayake

Samanthule Nola

Sameer AbuAsal

Sameer Asal

Samuel Bingham

Saurabh Malviya

Scott McCaulay

Selvi Kadirvel

Sergey Tarima

Shao-Ching Huang

Shubhada Karavinkoppa

Si Chen

Sneha Shekatkar

Soichi Hayashi

Suresh Marru

Swati Nagde

Tae Heon Kim

Tajendra Singh

Tak-Lon Wu

Terrence Barrette

Thilina Gunarathne

Thomas Lee

Thomas Omwando

Tiannan Yang

Tianwei Zhang

Ting Lei

Tracy Yu

Troi Williams

Vembu Subramanian

Venu Bangalore Parameshwara Setty

Viknes Balasubramanee

Viplav Khadke

Wenbo Shen

Wenjie Sha

Xi Zhu

Xiande Wang

Xiaolu Zhou

Xiaowen Wang

Yang Ruan

Yao Hu

Ye Fang

Yi Shi

Yilan Zhang

Yin Wang

Yisi Zhang

Yong-Yeol Ahn

Yuan Huang

Yue Hu

Yun Jiang

Zhe Wan

Zhengqi He

Zong Peng

FutureGrid Experts

Andrew Younge

Barbara Ann O'Leary

Bingjing Zhang

David Gignac

Fugang Wang

Gary Miksik

Gregor von Laszewski

Hyungro Lee

Javier Diaz Montes

Jerome Mitchell

John Bresnahan

Jonathan Klinginsmith

Judy Qiu

Koji Tanaka

Mauricio Tsugawa

Saliya Ekanayake

Sharif Islam

Tak-Lon Wu

Thilina Gunarathne

Ti Leggett

Xiaoming Gao