Project VersionsSearchTable Of Contents
Previous topicNext topicThis Page |
Hello World Benchmark¶How the benchmarks were performed?¶We created a “Hello World” benchmark seeking to identify the smallest load overhead of each framework. Many people don’t like this kind of benchmark because real-world applications require more complex features or structures. However, these tests identify the minimum time spent by each framework to perform a simple task. Such a task represents the mimimum requirement for every framework to process a single request. More specifically, the benchmark only measures the time it takes for a framework to start, run an action and free up resources at the end of the request. Any PHP application based on an MVC architecture will require this time. Due to the simplicity of the benchmark, we ensure that the time needed for a more complex request will be higher. A controller and a view have been created for each framework. The controller “say” and action “hello”. The action only sends data to the view which displays it (“Hello!”). Using the “ab” benchmark tool we sent 2000 requests using 10 concurrent connections to each framework. What measurements were recorded?¶These were the measurements we record to identify the overall performance of each framework:
Pariticipant Frameworks¶
Results¶Yii (YII_DEBUG=false) Version yii-1.1.13¶# ab -n 2000 -c 10 http://localhost/bench/helloworld/yii/index.php?r=say/hello
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Server Software: Apache/2.2.22
Server Hostname: localhost
Server Port: 80
Document Path: /bench/helloworld/yii/index.php?r=say/hello
Document Length: 61 bytes
Concurrency Level: 10
Time taken for tests: 2.081 seconds
Complete requests: 2000
Failed requests: 0
Write errors: 0
Total transferred: 508000 bytes
HTML transferred: 122000 bytes
Requests per second: 961.28 [#/sec] (mean)
Time per request: 10.403 [ms] (mean)
Time per request: 1.040 [ms] (mean, across all concurrent requests)
Transfer rate: 238.44 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 10 4.3 9 42
Processing: 0 0 1.0 0 24
Waiting: 0 0 0.8 0 17
Total: 3 10 4.3 9 42
Percentage of the requests served within a certain time (ms)
50% 9
66% 11
75% 13
80% 14
90% 15
95% 17
98% 21
99% 26
100% 42 (longest request)
Symfony Version 2.1.6¶# ab -n 2000 -c 10 http://localhost/bench/Symfony/web/app.php/say/hello/
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Server Software: Apache/2.2.22
Server Hostname: localhost
Server Port: 80
Document Path: /bench/Symfony/web/app.php/say/hello/
Document Length: 16 bytes
Concurrency Level: 5
Time taken for tests: 1.848 seconds
Complete requests: 1000
Failed requests: 0
Write errors: 0
Total transferred: 249000 bytes
HTML transferred: 16000 bytes
Requests per second: 541.01 [#/sec] (mean)
Time per request: 9.242 [ms] (mean)
Time per request: 1.848 [ms] (mean, across all concurrent requests)
Transfer rate: 131.55 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 9 4.8 8 61
Processing: 0 0 0.6 0 15
Waiting: 0 0 0.6 0 15
Total: 4 9 4.8 8 61
Percentage of the requests served within a certain time (ms)
50% 8
66% 9
75% 11
80% 12
90% 15
95% 18
98% 22
99% 30
100% 61 (longest request)
CodeIgniter 2.1.0¶# ab -n 2000 -c 10 http://localhost/bench/codeigniter/index.php/say/hello
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Server Software: Apache/2.2.22
Server Hostname: localhost
Server Port: 80
Document Path: /bench/helloworld/codeigniter/index.php/say/hello
Document Length: 16 bytes
Concurrency Level: 10
Time taken for tests: 1.888 seconds
Complete requests: 2000
Failed requests: 0
Write errors: 0
Total transferred: 418000 bytes
HTML transferred: 32000 bytes
Requests per second: 1059.05 [#/sec] (mean)
Time per request: 9.442 [ms] (mean)
Time per request: 0.944 [ms] (mean, across all concurrent requests)
Transfer rate: 216.15 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 9 4.1 9 33
Processing: 0 0 0.8 0 19
Waiting: 0 0 0.7 0 16
Total: 3 9 4.2 9 33
Percentage of the requests served within a certain time (ms)
50% 9
66% 10
75% 11
80% 12
90% 14
95% 16
98% 21
99% 24
100% 33 (longest request)
Kohana 3.2.0¶# ab -n 2000 -c 10 http://localhost/bench/helloworld/kohana/index.php/say/hello
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Server Software: Apache/2.2.22
Server Hostname: localhost
Server Port: 80
Document Path: /bench/helloworld/kohana/index.php/say/hello
Document Length: 15 bytes
Concurrency Level: 10
Time taken for tests: 2.324 seconds
Complete requests: 2000
Failed requests: 0
Write errors: 0
Total transferred: 446446 bytes
HTML transferred: 30030 bytes
Requests per second: 860.59 [#/sec] (mean)
Time per request: 11.620 [ms] (mean)
Time per request: 1.162 [ms] (mean, across all concurrent requests)
Transfer rate: 187.60 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 11 5.1 10 64
Processing: 0 0 1.9 0 39
Waiting: 0 0 1.4 0 35
Total: 3 11 5.3 11 64
Percentage of the requests served within a certain time (ms)
50% 11
66% 13
75% 15
80% 15
90% 17
95% 18
98% 24
99% 31
100% 64 (longest request)
Fuel 1.2.1¶# ab -n 2000 -c 10 http://localhost/bench/helloworld/fuel/public/say/hello
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Server Software: Apache/2.2.22
Server Hostname: localhost
Server Port: 80
Document Path: /bench/helloworld/fuel/public/say/hello
Document Length: 16 bytes
Concurrency Level: 10
Time taken for tests: 2.742 seconds
Complete requests: 2000
Failed requests: 0
Write errors: 0
Total transferred: 418000 bytes
HTML transferred: 32000 bytes
Requests per second: 729.42 [#/sec] (mean)
Time per request: 13.709 [ms] (mean)
Time per request: 1.371 [ms] (mean, across all concurrent requests)
Transfer rate: 148.88 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 13 6.0 12 79
Processing: 0 0 1.3 0 22
Waiting: 0 0 0.8 0 21
Total: 4 14 6.1 13 80
Percentage of the requests served within a certain time (ms)
50% 13
66% 15
75% 17
80% 17
90% 19
95% 24
98% 30
99% 38
100% 80 (longest request)
Cake 2.1.3¶# ab -n 10 -c 5 http://localhost/bench/cake/say/hello
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient).....done
Server Software: Apache/2.2.22
Server Hostname: localhost
Server Port: 80
Document Path: /bench/cake/say/hello
Document Length: 16 bytes
Concurrency Level: 5
Time taken for tests: 30.051 seconds
Complete requests: 10
Failed requests: 0
Write errors: 0
Total transferred: 1680 bytes
HTML transferred: 160 bytes
Requests per second: 0.33 [#/sec] (mean)
Time per request: 15025.635 [ms] (mean)
Time per request: 3005.127 [ms] (mean, across all concurrent requests)
Transfer rate: 0.05 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 2 3.6 0 11
Processing: 15009 15020 9.8 15019 15040
Waiting: 9 21 7.9 25 33
Total: 15009 15022 8.9 15021 15040
Percentage of the requests served within a certain time (ms)
50% 15021
66% 15024
75% 15024
80% 15032
90% 15040
95% 15040
98% 15040
99% 15040
100% 15040 (longest request)
Zend Framework 1.11.11¶# ab -n 2000 -c 10 http://localhost/bench/helloworld/zendfw/public/index.php
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Server Software: Apache/2.2.22
Server Hostname: localhost
Server Port: 80
Document Path: /bench/helloworld/zendfw/public/index.php
Document Length: 16 bytes
Concurrency Level: 10
Time taken for tests: 5.641 seconds
Complete requests: 2000
Failed requests: 0
Write errors: 0
Total transferred: 418000 bytes
HTML transferred: 32000 bytes
Requests per second: 354.55 [#/sec] (mean)
Time per request: 28.205 [ms] (mean)
Time per request: 2.820 [ms] (mean, across all concurrent requests)
Transfer rate: 72.36 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 27 9.6 25 89
Processing: 0 1 3.0 0 70
Waiting: 0 0 2.9 0 70
Total: 9 28 9.6 26 90
Percentage of the requests served within a certain time (ms)
50% 26
66% 28
75% 32
80% 34
90% 41
95% 46
98% 55
99% 62
100% 90 (longest request)
Laravel 3.2.5¶# ab -n 2000 -c 10 http://localhost/bench/helloworld/laravel/public/say/hello
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Server Software: Apache/2.2.22
Server Hostname: localhost
Server Port: 80
Document Path: /bench/helloworld/laravel/public/say/hello
Document Length: 15 bytes
Concurrency Level: 10
Time taken for tests: 4.090 seconds
Complete requests: 2000
Failed requests: 0
Write errors: 0
Total transferred: 1665162 bytes
HTML transferred: 30045 bytes
Requests per second: 489.03 [#/sec] (mean)
Time per request: 20.449 [ms] (mean)
Time per request: 2.045 [ms] (mean, across all concurrent requests)
Transfer rate: 397.61 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 20 7.6 19 92
Processing: 0 0 2.5 0 53
Waiting: 0 0 2.5 0 53
Total: 6 20 7.6 19 93
Percentage of the requests served within a certain time (ms)
50% 19
66% 21
75% 23
80% 24
90% 29
95% 34
98% 42
99% 48
100% 93 (longest request)
Nette 2.0.4¶# ab -n 2000 -c 10 http://localhost/bench/helloworld/nette/www/index.php
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Server Software: Apache/2.2.22
Server Hostname: localhost
Server Port: 80
Document Path: /bench/helloworld/nette/www/index.php
Document Length: 24963 bytes
Concurrency Level: 10
Time taken for tests: 7.750 seconds
Complete requests: 2000
Failed requests: 200
(Connect: 0, Receive: 0, Length: 200, Exceptions: 0)
Write errors: 0
Total transferred: 50370200 bytes
HTML transferred: 49926200 bytes
Requests per second: 258.07 [#/sec] (mean)
Time per request: 38.749 [ms] (mean)
Time per request: 3.875 [ms] (mean, across all concurrent requests)
Transfer rate: 6347.24 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 38 13.1 34 115
Processing: 0 1 4.7 0 99
Waiting: 0 0 4.5 0 98
Total: 15 39 13.2 34 116
Percentage of the requests served within a certain time (ms)
50% 34
66% 38
75% 46
80% 50
90% 58
95% 64
98% 75
99% 82
100% 116 (longest request)
Phalcon Version 0.8.0¶# ab -n 2000 -c 10 http://localhost/bench/helloworld/phalcon/index.php?_url=/say/hello
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient)
Server Software: Apache/2.2.22
Server Hostname: localhost
Server Port: 80
Document Path: /bench/helloworld/phalcon/index.php?_url=/say/hello
Document Length: 16 bytes
Concurrency Level: 10
Time taken for tests: 0.789 seconds
Complete requests: 2000
Failed requests: 0
Write errors: 0
Total transferred: 418000 bytes
HTML transferred: 32000 bytes
Requests per second: 2535.82 [#/sec] (mean)
Time per request: 3.943 [ms] (mean)
Time per request: 0.394 [ms] (mean, across all concurrent requests)
Transfer rate: 517.56 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 4 1.7 3 23
Processing: 0 0 0.2 0 6
Waiting: 0 0 0.2 0 6
Total: 2 4 1.7 3 23
Percentage of the requests served within a certain time (ms)
50% 3
66% 4
75% 4
80% 4
90% 5
95% 6
98% 8
99% 14
100% 23 (longest request)
Graphs¶The first graph shows how many requests per second each framework was able to accept. The second shows the average time across all concurrent requests. Conclusion¶The compiled nature of Phalcon offers extraordinary performance that outperforms all other frameworks measured in these benchmarks. |