use uwsgi instead of paste #471

joka · 2013-06-30T16:17:19Z

Conflicts: CHANGES.txt

phihag · 2013-07-01T00:01:49Z

python/buildout.cfg

+
+    # remove exiting links 
+    rm ${:prefix}/bin/python 
+    for i in $(ls ${:prefix}/bin/*[23].*); do


This looks really unstable. Why do we need to remove the files in the first place? And why can't we match python* here?

phihag · 2013-07-01T00:07:08Z

For me, this fails with:

$ bin/adhocpy -c 'import zlib;print(zlib.__file__)'
/home/phihag/inavm/adhocracy_buildout/python/python-2.7/lib/python2.7/lib-dynload/zlib.so
$ bin/uwsgi --ini-paste etc/adhocracy.ini
[uWSGI] getting INI configuration from etc/adhocracy.ini
Mon Jul  1 02:00:18 2013 - *** Starting uWSGI 1.9.12 (64bit) on [Mon Jul  1 02:00:18 2013] ***
Mon Jul  1 02:00:18 2013 - compiled with version: 4.4.5 on 01 July 2013 01:56:27
Mon Jul  1 02:00:18 2013 - os: Linux-2.6.32-5-amd64 #1 SMP Sun Sep 23 10:07:46 UTC 2012
Mon Jul  1 02:00:18 2013 - nodename: adhocracy
Mon Jul  1 02:00:18 2013 - machine: x86_64
Mon Jul  1 02:00:18 2013 - clock source: unix
Mon Jul  1 02:00:18 2013 - pcre jit disabled
Mon Jul  1 02:00:18 2013 - detected number of CPU cores: 2
Mon Jul  1 02:00:18 2013 - current working directory: /home/phihag/inavm/adhocracy_buildout
Mon Jul  1 02:00:18 2013 - writing pidfile to /home/phihag/inavm/adhocracy_buildout/var/uwsgi.pid
Mon Jul  1 02:00:18 2013 - detected binary path: /home/phihag/inavm/adhocracy_buildout/parts/uwsgi/bin/uwsgi
Mon Jul  1 02:00:18 2013 - your memory page size is 4096 bytes
Mon Jul  1 02:00:18 2013 - detected max file descriptor number: 1024
Mon Jul  1 02:00:18 2013 - lock engine: pthread robust mutexes
Mon Jul  1 02:00:18 2013 - uWSGI http bound on adhocracy.lan:5001 fd 4
Mon Jul  1 02:00:18 2013 - uwsgi socket 0 bound to TCP address 127.0.0.1:40253 (port auto-assigned) fd 3
Mon Jul  1 02:00:18 2013 - Python version: 2.7.5 (default, Jun 14 2013, 14:08:18)  [GCC 4.4.5]
Mon Jul  1 02:00:18 2013 - Set PythonHome to /home/phihag/inavm/adhocracy_buildout
zipimport.ZipImportError: can't decompress data; zlib not available
Mon Jul  1 02:00:18 2013 - VACUUM: pidfile removed.

which is curious, since both my system Python and the adhocracy Python have zlib installed.

phihag · 2013-07-01T00:08:39Z

buildouts/uwsgi.cfg

+recipe = collective.recipe.template
+output = ${buildout:bin-directory}/uwsgi
+input = inline:
+    #!/bin/bash


This should be /bin/sh - the file is not dependent on bash at all, or is it?

This should be /bin/sh - the file is not dependent on bash at all, or is it?

its not working with sh.

phihag · 2013-07-01T00:50:37Z

When I install multiple times (just run ./build.sh), this build uwsgi every time, unlike all other dependencies. Are we by accident deleting any output files or so?

nidico · 2013-07-01T00:57:49Z

@phihag: Can you try to run bin/uwsgi with explicit LD_LIBRARY_PATH="${buildout:directory}/python/python-2.7/lib/"? We're doing the same because of libjpeg in the paster supervisor commands.

phihag · 2013-07-01T01:05:50Z

python/buildout.cfg

-    ln -vfs ${buildout:directory}/python-2.7/bin/python2.7 $DEST;     
-update-command = ${:command}
+    # Symlink include, lib directory, uwsgi needs this there
+    ln -s ${buildout:directory}/python-2.7/include ${:prefix}/include


We should also pass in the -f and -T options here, since we're symlinking a directory. In fact, is that the rationale for the rms above? If so, just adding -fT and removing the rms will suffice.

phihag · 2013-07-01T01:08:35Z

@nidico Fixed the installation problem in e49fd89 ; python needed to be re-compiled.

phihag · 2013-07-01T01:15:13Z

With the changes, uwsgi starts and serves the correct page, but still mentions

Mon Jul  1 03:11:48 2013 - unable to stat() true, events will be triggered as soon as the file is created

This looks like one of the options we set isn't actually boolean.

phihag · 2013-07-01T01:17:49Z

buildouts/uwsgi.cfg

+##############################################################################
+
+[domains]
+uwsgi = 127.0.0.1


Are these two entries used anywhere? It seems like we're simply using {main:port} (as we should)

phihag · 2013-07-01T01:34:37Z

etc/adhocracy.ini.in

@@ -7,8 +7,6 @@
 ############################################################## 

 [DEFAULT]
-{% if parts.adhocracy.debug == 'True' %}debug = True  {% end %}


How is this related to uwsgi?

This debug flag does not work with mutliprocess WSGI-servers such as uwsgi

Its better to use the domains/ports parts only for server hosts/ports settings and the adhocracy part for adhocracy configuration: * adhocracy.host is now domains.wsgi * port.main is now ports.wsgi * domains.main is no adhocracy.domain

touch-reload = true is throws: "unable to stat() true, events will be triggered as soon as the file is created"

joka · 2013-07-03T11:44:57Z

This looks like one of the options we set isn't actually boolean.

fixed

joka · 2013-07-03T11:45:58Z

@phihag: Can you try to run bin/uwsgi with explicit LD_LIBRARY_PATH="${buildout:directory}/python/python-2.7/lib/"? We're doing the same because of libjpeg in the paster supervisor commands.

bin/uwsgi sets LD_LIBRARY_PATH now

joka · 2013-07-03T12:56:37Z

updated uwsgi to 1.9.13 to enable support of what?

allow to extent the "LD_LIBRARY_PATH"

nidico · 2013-07-03T13:06:44Z

ah :)

joka · 2013-07-03T13:35:55Z

Testet build.sh with Debian 7.1 netboot image, OK

joka · 2013-07-03T13:38:12Z

When I install multiple times (just run ./build.sh), this build uwsgi every time, unlike all other dependencies. Are we by accident deleting any output files or so?

no, the recipe minitage.recipe.du was the reason, fixed.

joka · 2013-07-03T13:43:37Z

For me, this fails with:

$ bin/adhocpy -c 'import zlib;print(zlib.file)'
/home/phihag/inavm/adhocracy_buildout/python/python-2.7/lib/python2.7/lib-dynload/zlib.so
$ bin/uwsgi --ini-paste etc/adhocracy.ini
[uWSGI] getting INI configuration from etc/adhocracy.ini
...
zipimport.ZipImportError: can't decompress data; zlib not available
Mon Jul 1 02:00:18 2013 - VACUUM: pidfile removed.

Can you try again or give me an VM to investigate this?

joka · 2013-07-09T15:09:29Z

@phihag do you still have problems?

joka added 12 commits June 20, 2013 16:12

run adhocarcy with uwsgi instead of paster

b94c667

updated changelog

a03f4c3

use virtualenv to create python executables, uwsgi needs this

d293ff2

improved uwsgi conf

8fda21d

set LD_LIBRARY_PAT right to make PIL work

60feb81

improved uwsgi conf

3b121e3

nicer uwsgi conf

cd49610

added script to open an interactive python shell with "IPDB()".

9439517

Merge branch 'develop' into feature_444_use_uwsgi_instead_of_paste

439ca1c

Merge branch 'develop' into feature_444_use_uwsgi_instead_of_paste

038bf75

Conflicts: CHANGES.txt

link lib and include directory instead of using virtualenv

b712f26

cleanup

4dc5398

phihag reviewed Jul 1, 2013
View reviewed changes

[build.sh] Rebuild Python if lib/ is missing

e49fd89

Remove hardcoded path

eb4e135

phihag reviewed Jul 1, 2013
View reviewed changes

phihag added 2 commits July 1, 2013 03:24

Fix gitignore: lib is a symlink, not a directory

398038b

Fix listen

0d75019

phihag reviewed Jul 1, 2013
View reviewed changes

joka added 8 commits July 2, 2013 16:59

Fix: uwsgi process is forking off

7582ed3

Cleanup linking the python binaries and lib directory

b72920a

Fix: buildout vars "etc-directory" and "var-directory" do not exists

3091da4

Fix: error message when starting uwsgi

977b45e

touch-reload = true is throws: "unable to stat() true, events will be triggered as soon as the file is created"

Fix: uwsgi recompiles all the time

85f6388

compile uwsgi without xml support to remove the libxml dependency

88d0937

updated uwsgi to 1.9.13 to enable support of

92ad97a

Fix: uwsgi start script does not run mit 'bin/sh'

fd03c1c

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

use uwsgi instead of paste #471

use uwsgi instead of paste #471

joka commented Jun 30, 2013

phihag Jul 1, 2013

phihag commented Jul 1, 2013

phihag Jul 1, 2013

joka Jul 3, 2013

phihag commented Jul 1, 2013

nidico commented Jul 1, 2013

phihag Jul 1, 2013

phihag commented Jul 1, 2013

phihag commented Jul 1, 2013

phihag Jul 1, 2013

phihag Jul 1, 2013

joka Jul 2, 2013

joka commented Jul 3, 2013

joka commented Jul 3, 2013

joka commented Jul 3, 2013

nidico commented Jul 3, 2013

joka commented Jul 3, 2013

joka commented Jul 3, 2013

joka commented Jul 3, 2013

joka commented Jul 9, 2013

use uwsgi instead of paste #471

Are you sure you want to change the base?

use uwsgi instead of paste #471

Conversation

joka commented Jun 30, 2013

phihag Jul 1, 2013

Choose a reason for hiding this comment

phihag commented Jul 1, 2013

phihag Jul 1, 2013

Choose a reason for hiding this comment

joka Jul 3, 2013

Choose a reason for hiding this comment

phihag commented Jul 1, 2013

nidico commented Jul 1, 2013

phihag Jul 1, 2013

Choose a reason for hiding this comment

phihag commented Jul 1, 2013

phihag commented Jul 1, 2013

phihag Jul 1, 2013

Choose a reason for hiding this comment

phihag Jul 1, 2013

Choose a reason for hiding this comment

joka Jul 2, 2013

Choose a reason for hiding this comment

joka commented Jul 3, 2013

joka commented Jul 3, 2013

joka commented Jul 3, 2013

nidico commented Jul 3, 2013

joka commented Jul 3, 2013

joka commented Jul 3, 2013

joka commented Jul 3, 2013

joka commented Jul 9, 2013