Description
The course will introduce this domain and cover the topics of data centers, virtualization, cloud storage, and programming models. As an introduction, we will discuss the motivating factors, benefits, challenges, and service models. Modern data centers enable many of the economic and technological benefits of the cloud paradigm; hence, we will describe several concepts behind data center design and management. Next, we will focus on virtualization as a key cloud technique for offering software, computation and storage services. We will study how CPU, memory and I/O resources are virtualized, with examples from Xen and VMWare, and present real use cases such as Amazon EC2. Subsequently, students will learn about different cloud storage concepts including data distribution, durability, consistency and redundancy. HDFS, PVFS, HBASE, Cassandra and S3 will be presented as case studies. Students will understand the details of the MapReduce programming model and gain a broad overview of alternative programming models such as Pregel, and GraphLab.
Students will work with Amazon Web Services, use them to rent and provision compute resources and then program and deploy applications that run on these resources. In addition, students will work with cloud storage systems and learn to develop applications in the MapReduce programming paradigm.
General Information
Announcements
Dear Cloud Computing Alums,
We hope you are doing well.
If you have not graduated already, we are looking for students who are interested in becoming TAs for the cloud computing course in the Fall of 2014.
If you are interested, please fill this form asap.
Regards,
Majd
The following is the team ranking of the performance for the submitted web services evaluated during the live-test for the Twitter analytics project:
Up_in_the_Air (Winner)
cracking
Essex1104
MatrixHacker
CCCats
Sun
42
Apollo
pushpushpush
HMZ
Bottie_CC
supercloud
CloudDragon
fighting
MZW
SJTU
CloudMatrix
CloudWalker
suncompute
TeBoring
lwl
Awan
Epsilon
absolutepanda
passion
KU-Cloud
LWS
RVF
adiaos
CoolShine
CloudCrawlers
15619infinity
Alvin
Waydream
Stratus
ThreeRookies
BegNoSay
RuCh
Acloud
DMB007
Patronus
Z-Warriors
HowIMetYourCloud
DoomsdayBunnies
AP13
MHS00MSE
As you can see from the relative performance chart, team Up_in_the_Air is the clear winner. Congratulations!
We are also very happy with many of the team submissions. Well done and we hope you learned a lot because that's what really matters!
Happy Holidays!
Dear 15-319/15-619 students,
We hoped you have enjoyed the course, and working with Amazon Web Services.
As of Sunday Dec 15th, 2013, your personal AWS account will be "unlinked" from CMU's paying account, and all AWS charges incurred on or after Dec 16th will be your responsibility - charged to the Credit Card that you have on file when you first created the account. If your account does not have a Credit Card on file, it will go into suspended state.
The choice is up to you if you want to keep your personal account open with AWS.
If you wish to close the account, go to the "Manage Your Account" page, then click the "Cancel Your Account" link near the bottom.
To prevent further charges to your account, be sure to look in the following locations on the AWS console:
- EC2
Terminate Instances (not just Stop)
Remove Elastic IPs, Placement Groups
Delete Volumes, Snapshots
Elastic Load Balancer (CLI tools)
- Remove all Auto-Scaling Groups, Load Balancers
- S3
Remove files/buckets
Mac & Windows users: CyberDuck offers S3 compatible GUI file transfers
If you don't have enough space on AFS, Box offers 50GB of online capacity for CMU users.
- DynamoDB
Delete all tables (along with notifications).
- CloudWatch
Remove Alarms and Metrics
- Elastic MapReduce (EMR)
Make sure any Job Flows are not scheduled to run automatically.
- Simple Notification Service
Delete all Topics
If you have any other questions about the account, please email me directly - jboles@qatar.cmu.edu
Regards,
--Jason Boles
Hello Students,
We have completed grading Language Model Generation on OLI, and you should have received emails from your respective TAs to terminate your clusters. Please verify and terminate your clusters ASAP if all is OK.
Regards,
Suhail
Dear Students,
The last module of Project 4 is due on Friday, December 6th at 11:59PM Pittsburgh. Check OLI for the deadline.
Please make sure that your systems are available to grade at that time. The TAs will get in touch when it is time to terminate them.
Do not keep your systems running from now as this will chew into the course budget and risk a grade penalty.
If you have any questions, please ask.
Regards,
Majd
Dear Students,
We will be evaluating the submissions of students who have completed the last checkpoint of the course "Language Model Generation" as soon as they appear on the system. Please ensure that your cluster is kept alive for grading. You will receive an email from a TA asking you to terminate your cluster as soon as its graded.
Hi,
Because I have to travel on Wed morning, my TA hour this week is canceled. Sorry for the late notification and inconvenience...
Thanks,
Jiangjie (Becket) Qin
Hello Students,
Some have noticed that in AWS Console -> My Account -> Account Activity page, that you are seeing dollar ($) amounts greater than zero. This is normal because the course credits/coupons have been used, so AWS will now send bill to CMU. (previously coupons matched usage, so summary = $0.00)
As long as you successfully linked your account at the beginning of the semester, you should not see any bills to your personal credit card. (If it's not linked, you'd already have received bills for September and October as well).
If you do see a charge from AWS, please email me directly - jboles@qatar.cmu.edu .
Hope that clarifies things.
regards,
--Jason Boles
Name | Office Hours | |
---|---|---|
Chaomin Yu | When? Where? | |
Ge Gao | When? Where? | |
Yuefeng Zhou | When? Where? | |
Majd F. Sakr | When? Where? | |
Jason Boles | When? Where? | |
Yicheng Qin | When? Where? | |
Becket Qin | When? Where? | |
Neha Kapoor | When? Where? | |
Mingyuan Li | When? Where? | |
Zhiyu Xie | When? Where? | |
Tim Brown | When? Where? | |
Dejian Fang | When? Where? | |
Daniel Del Duca | When? Where? | |
Mohammed Suhail Rehman | When? Where? | |
Cathy Bishop | When? Where? |