Magento Hosting Performance and Server-less Configuration

UPDATE: We’ve just released a Quickstart Version of Magento 1.6 Community Edition. Scalable Magento Hosting in under 5 minutes: 

 

We’ve just completed a series of Magento cloud hosting benchmarks using Blitz.io’s* benchmarking tool. We scaled the infrastructure up and down to accommodate various traffic levels, then tested across a range of pages** for an out-of-the-box Magento Demo Site hosted on Pagoda Box. Each page-type received roughly 20% of the total traffic for each test, and results were verified through additional Siege Tests.*** Finally, learn about hosting Magento on Pagoda Box, or see the Magento configurations we used to achieve these results.

NOTE: Benchmarks and Total Prices include 500MB MySQL DB and 200MB Memcache, for $64 and $25 respectively. Prices per Month.

Here are the results:

Requests per hour	Requests per min	Concurrent Users	200MB RAM Web	Total Price
41,580	693	24	1–$0	$89
72,900	1,215	36	2–$25	$114
98,100	1,635	48	3–$50	$139
122,340	2,039	60	4–$76	$165
135,180	2,253	72	5–$101	$190

693 Pageviews per Minute – $89/mo
Constant Traffic (24 concurrency, 1 instance, 60 Seconds)

Gradual Traffic (1-24 concurrency, 1 instance, 60 Seconds)

1,215 Pageviews per Minute – $114/mo
Constant Traffic (36 concurrency, 2 instances, 60 Seconds)

Gradual Traffic (1-36 concurrency, 2 instances, 60 Seconds)

1,635 Pageviews per Minute – $139/mo
Constant Traffic (48 concurrency, 3 instances, 60 Seconds)

Gradual Traffic (1-48 concurrency, 3 instances, 60 Seconds)

2,039 Pageviews per Minute – $165/mo
Constant Traffic (60 concurrency, 4 instances, 60 Seconds)

Gradual Traffic (1-60 concurrency, 4 instances, 60 Seconds)

2,253 Pageviews per Minute – $190/mo
Constant Traffic (72 concurrency, 5 instances, 60 Seconds)

Gradual Traffic (1-72 concurrency, 5 instances, 60 Seconds)

*Blitz.io Notes:
We utilized the free option for Blitz.io’s benchmarking service. We ran two tests. The first maintained constant concurrency for 60 seconds, while the second began with 1 concurrent user and increased to the specified target over a 60 second period (see each graph for peak concurrency). Tests were conducted from California to Texas, so performance times reflect external network latency. Here is a sample of the blitz.io command we used for the tests:

-p 1-72:60 -r california -T 4000 -v:cookie list[ca9932cd70a6912652015a4ff65e504d, 4c654c1d1be591351bec3f1490258422] -v:urls list[index.php,furniture.html,ottoman.html,about-magento-demo-store,checkout/cart/add?product=51] -b “my-cookie=#{cookie}” http://magento-demo.pagodabox.com/#{urls}

**Magento Demo Hosting Site Notes:
Benchmarks are for Magento’s Community Edition Demo site, Version 1.5.1.0 (no additional modules, like full page caching). Pages include Home Page, Catalog Page, Product Page, CMS Page, and Add to Cart (producing a DB write).

***Siege Test Notes:
The Blitz tests only ran for 1 minute each. To verify the results over a longer period, we also ran 10 minute Siege tests against 2 pages: a heavier catalog page and a lighter CMS page.

Against the heavier Catalog page:
1,366.8 pageviews per minute over a 10 min period, or 82,014 pageviews per hour.

Transactions:                          13669 hits
Availability:                             100.00 %
Elapsed time:                           599.92 secs
Data transferred:                   78.23 MB
Response time:                        2.64 secs
Transaction rate:                   22.78 trans/sec
Throughput:                            0.13 MB/sec
Concurrency:                          60.24
Successful transactions:       13669
Failed transactions:              0
Longest transaction:             15.43
Shortest transaction:            0.40

Against the lighter CMS page:
4,495.2 pageviews per minute over a 10 min period, or 269,712 pageviews per hour.

Transactions:                          44952 hits
Availability:                             100.00 %
Elapsed time:                           599.15 secs
Data transferred:                   154.16 MB
Response time:                        0.46 secs
Transaction rate:                   75.03 trans/sec
Throughput:                            0.26 MB/sec
Concurrency:                          34.15
Successful transactions:       44952
Failed transactions:              0
Longest transaction:             5.55
Shortest transaction:            0.02

Obligatory Disclaimer:
Anyone who’s ever tested anything knows that results vary. We’ve used a default Magento install, without full page cache, hit various page-types (including 20% db writes), and provided details from a 3rd party test to provide as much transparency as possible. You should test your own implementation to get results specific to your Magento ecommerce site… and let us know what you find.