Apache Cloud Computing Edition - SVN - The Apache Software

60 Pages·2009·1.19 MB·English

by  Steve Loughran

Apache
Cloud Computing Edition
Steve Loughran
Julio Guijarro
Robert Burrell Donkin
Why move to the cloud?
Good
• Cost
• Outsourcing hardware problems
• Move from capital to pay-as-you-go
• To handle Petabytes of data
• For a business plan that might work
Bad: to avoid the operations team
2 10 April 2009
What is a cloud application?
• The program that is run
• The code/data needed to run it in a datacentre
• Anything needed to configure, monitor and
manage the system
3 10 April 2009
This is not a cloud application
Application
servers
replication
protocol
DB Master DB Slave
Enterprise Java on Highly Available servers
4 10 April 2009
JavaEE is not a cloud application
Browser
Browser
Travel expenses
Browser server too busy.
Travel expenses
server too busy.
Travel expenses
server too busy.
App Server
App Server
JSP JSP JSP
IIOP
The
Session Session Message Session
Bean Bean Bean Bean
WS-* "Enterprise"
Entity Bean
Entity Bean
Entity Bean
Entity Bean
RDBMS
5 10 April 2009
Things must change!
• Web UI for users, affiliates, marketing, operations
• Agile machine management is part of the API
• Scale up -and down
• Live upgrade of running system
• Persistence with key-value stores
• A Petabyte filesystem is part of the application
• MapReduce jobs close the loop
• Developers deploy to the cloud to test
6 10 April 2009
The agile will survive
REST APIs
Chrome Mozilla IE iPhone
Your friends Your friends
Your friends are You are having
are having are having more fun than Affiliate View
having more fun
more fun more fun your
than you
than you than you friends David Hasslehof
keywords cost
more today
Diskless front
Marketing view
end
David Hasslehof is
Memcached very popular today
JSP?
PHP?
Scatter/gather? Developer View
Message Queue?
Pig job completed
Tuple Space? resource
with errors
manager
Ops View
92% servers up
Back End
Network OK
Cost: $63/hour
HBase/Cassandra/
CouchDB
Cloud Owner View
MapReduce
Customer #17 is
Lucene
using lots of disk
HDFS or ... space. Normal
HDD failure rate
8 10 April 2009
EC2 as the cloud provider
• S3 for persistence, public downloads
• SimpleDB provides key-value storage, but query
costs unpredictable.
• Typica for EC2 services API
http://code.google.com/p/typica/
• AWS IP rental or Dyndns for hostnames
• No billing or test APIs
• No image management services
No standard Apache Stack
9 10 April 2009
Sun, IBM, HP as the cloud providers
• S3 -like filestore
• EC2 and Sun RESTy APIs
• Unknown queue and keystore services
• More secure networking?
• Billing and monitoring?
• Testing?
• Image management services?
No standard Apache Stack
10 10 April 2009