Comments on: Benchmark followup: Google-code Edition

By: jesse

jesse — Mon, 24 Dec 2007 19:21:47 +0000

Steve,

Yes, I have - some of the work for this was turned into an article which was published this month for Python magazine, after the holidays, I’ll be throwing more over the wall.

By: Steve

Steve — Mon, 24 Dec 2007 15:52:33 +0000

Jesse,

Have you come up with any “numbers” or results from your investigations?

Thanks!

By: Doug Napoleone

Doug Napoleone — Mon, 17 Sep 2007 16:46:34 +0000

Quite off topic, but I would recommend ‘If you give a Moose a Muffin’ as well as the other books by that author. (Oh and the entire series from the author of ‘Click Clack Moo’.)

By: jesse

jesse — Mon, 17 Sep 2007 00:47:51 +0000

Thanks for the information - one of the key things that was brought up to me in private is to make sure that if “we” found “something” that was attractive, that we should make sure that projects like web.py/django/TG/etc could take advantage of it.

As for:

“Because of the way the web servers can distribute requests across multiple processes, one can very easily make use of multiple processors and cores with no change to applications.”

You’re dead on - and I had forgotten that very valid point in this discussion.

I’ve added your information and links to the wiki

By: Graham Dumpleton

Graham Dumpleton — Mon, 17 Sep 2007 00:43:07 +0000

Please also consider referencing the existing solutions for Python web frameworks that have been round for many years. In particular, multi process web servers such as Apache where Python can be embedded within the server processes using mod_python or mod_wsgi. Other possible solutions are daemon mode of mod_wsgi, mod_fastcgi, mod_fcgid and mod_scgi modules for Apache. These allow multiple daemon processes to be created and to some degree managed by Apache, and to which HTTP requests can be proxied for processing. Other web servers such as lighttpd and nginx also support fastcgi functionality.

Because of the way the web servers can distribute requests across multiple processes, one can very easily make use of multiple processors and cores with no change to applications.

For my original response to comments made by Guido in this Parallel Python discussion outlining these solutions see:

http://blog.dscpl.com.au/2007/09/parallel-python-discussion-and-modwsgi.html

An older blog entry:

http://blog.dscpl.com.au/2007/07/web-hosting-landscape-and-modwsgi.html

also describes why the Python GIL is not as big a deal in Python web applications hosted under Apache as some think it is.

By: jessenoller.com - Have GIL: Want Benchmarks.

jessenoller.com - Have GIL: Want Benchmarks. — Mon, 17 Sep 2007 00:40:44 +0000

[...] A thing of Note: I’ve spawned an initial google code project to explore the alternatives/benchmarks. Read about it here. [...]