Skip to Content.
Sympa Menu

perfsonar-user - Re: [perfsonar-user] Wsgi pscheduler module and logger modules

Subject: perfSONAR User Q&A and Other Discussion

List archive

Re: [perfsonar-user] Wsgi pscheduler module and logger modules


Chronological Thread 
  • From: "Liu, Dengfeng (NIH/CIT) [C]" <>
  • To: Andrew Lake <>, "" <>
  • Subject: Re: [perfsonar-user] Wsgi pscheduler module and logger modules
  • Date: Tue, 25 Apr 2017 14:25:02 +0000
  • Accept-language: en-US
  • Authentication-results: es.net; dkim=none (message not signed) header.d=none;es.net; dmarc=none action=none header.from=nih.gov;
  • Ironport-phdr: 9a23:rMqCxRIeOp+2zTLnydmcpTZWNBhigK39O0sv0rFitYgfLPXxwZ3uMQTl6Ol3ixeRBMOAuqwC17Cd7P+ocFdDyK7JiGoFfp1IWk1NouQttCtkPvS4D1bmJuXhdS0wEZcKflZk+3amLRodQ56mNBXdrXKo8DEdBAj0OxZrKeTpAI7SiNm82/yv95HJbQhFgDuwbal9IRmoognctMsbipZ+J6gszRfEvmFGcPlMy2NyIlKTkRf85sOu85Nm7i9dpfEv+dNeXKvjZ6g3QqBWAzogM2Au+c3krgLDQheV5nsdSWoZjBxFCBXY4R7gX5fxtiz6tvdh2CSfIMb7Q6w4VSik4qx2RhDokiMHPCMn/m/RhMJ7kaZXrAuhqhB6xYPffYObO+dkfq7Ffd0UW3dPXtpfWSJCDIOzbYoPAPYOMutDtYbxu0cCoAGiCQWwBO7izCJDiH/s3a091uQsCQ/K0gohH9ITqHjfsdv7O7kUUeC6wqnH0zPDb/xL0jv58IbGcRIvreqSULxzb8TdzFQkGAfbg1qWp4DuIjSY2fkTvGid4OpgW/ygi2goqw1rpjivx9osh5LPhoIUylDI7yp5wIErJdChTkNwfN2qEINIui2HKYd7QdkuT39mtSon0LELvYK3cDIXxJg52xLTc+KLfomU7h/hUeuRLyl0iGx5dL+6iBu+7Eutx+jzW8WqzFpGsi9In9zPu3wRyRPe6M2KSvVy80u/xzqDzx3f5+FFLEwumqfXN4Qtz7w0m5YJrEjOEDH6lUPrh6GMbEok4PKn6+H/b7XmuJCcM4h0hxn4MqQvmsywHfo3MhMBXmmV4+u91L3u8Vf5QLVXlfI6iK/ZsJHaJcgBqa65BBFV3p4i6xa5ETimzMwVkWQZIF9GYh6LkYbkN0zULP38EfuzmUmgnCl3y/zeO73uGJTNLnzNkLf7erZ97lZRxxctwtBZ6JJUBK8OIPT8WkPrsNzYDwI5Pheyw+bmCNVxzIweWWWRAqOBKqPdrUeI5v4zI+mLfIIVoCjyK+Ir5/71in85n0USfbOw0ZsKc3C3AO5mLl6dYXrtmdcBDXwKshQkQOzrjl2CTSBcZ2y0X60i+jE3FpiqApneSYCw0/S923KSGJFMa38OLlmPHD+8foOISt8Bc2SUL9M31nROTbW7RZQm0xi08RLhxqBPL+zI9zceuI65ktV5+qebwQk/7zJvCMKUySSQVGxutmIOWzIs2q1j+wpwxkrVgoZihPkNX/hS+rcBfgo8OpDRyeMyS/bTekXqX+vIAGWNd5/uVT08SN0/ztkBJUJ8Bv2kjxCF0C20VexG34eXDYA5p/qPl0P6INxwnjOb2Q==
  • Ironport-phdr: 9a23:W4UKjxPWokxhfTrEFG0l6mtUPXoX/o7sNwtQ0KIMzox0I/T5rarrMEGX3/hxlliBBdydsKMYzbKO+4nbGkU4qa6bt34DdJEeHzQksu4x2zIaPcieFEfgJ+TrZSFpVO5LVVti4m3peRMNQJW2aFLduGC94iAPERvjKwV1Ov71GonPhMiryuy+4ZPebgFHiTanfb9+MAi9oBnMuMURnYZsMLs6xAHTontPdeRWxGdoKkyWkh3h+Mq+/4Nt/jpJtf45+MFOTav1f6IjTbxFFzsmKHw65NfqtRbYUwSC4GYXX3gMnRpJBwjF6wz6Xov0vyDnuOdxxDWWMMvrRr86QzSi67pgRgHuhikJKjU19Hjbh8x1gK9dvRmvpQFww5TMbY+VKvRwY7/dc90ZS2pPXMlRVjBODYynYoQVE+YNIfxVo5Xhq1YOqxa1GAmiBPnoyj9NnnL606s00+U8EQ3ewQcuEcwBsHLbrNX7KqgSV++1x7TMwTvbbP1Y2yzx5ZbLfB4/pP2HQLZ/fNTXxkUhCgjIiUifppLjPzOa2OQCrW6b7+V6WeKrim4nthp8oj6uxscskIXJiYUVyk7d+Ch/3Y07JsW4RVZmbdOkEZZcrS6XO5dsTs4gR2xkojs2x70ItJKjYiQHyYgryhzaZvyJbYSE/A7vWeOeLDtlh39ofb2yiwiu/US8z+DxU8q53EpUoSdHl9TMuH8A2wLN5sSfV/dw/kas1SyA2gzP8O1JI0Q5mbDGJ5Mv3LI9kIcYv17ZES/sgkr2ibebdkAj+ue19evqeq7mppqAN49sjQH+L7gultS/AesmNggOWHCW9vii273450H5RrRKjv0snqnWt5DaO9wXpq+/AwBLzoYu8wuzAjen3dgCknQLMEhJdRCDgoTzJl3DIP71Ae+6g1u2kTdrw/7GPqfmApXINnXMjanufbBy605S1gUzy99f64hQCrEAPfL+QUnxtN3YDhMjPAy0xPjnBM1n1owCQWKPHrOZMKTKvF+Q+O0vOeeMZJQSuDb7Mfcl/efijWIimVADZ6mkxpoXaHakHvt4OUWZZ2TjgssfHWsQoAUxUfHqgkWYUTFPf3ayQ7485jYjBY28C4fMW4Csjaef0yegBJFWYH5JCkzfWUvvIqyCV+0Bd2q2K8xs2mgNU7SwY4I6kxejqFm+g/B/I/Da4SoevIimycN4/cXSkw0/7zp5E57b3m2QBSkghm4SSSQx2qll5FFmx02r0K5kjuZeGMAJof5FT1FpG4TbyrkwL9HvHkrtc9GGRlugTZ3mJxARCfkQ/55GUG1IUZ32gh3F0CSnBbBTk72WLJo18uTT2GandJU18GrPyKR01wpuecBIL2Dzw/Ny
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:99

Andy;

The puppet module caused the problem. Now the testing working but we saw many throughput test result over 10gbps on a 10G NIC..........


Dengfeng Liu

NIH/CIT/NSS
3014967328(o)
3018302642(c)




From: Andrew Lake <>
Sent: Monday, April 24, 2017 1:44 PM
To: Liu, Dengfeng (NIH/CIT) [C];
Subject: Re: [perfsonar-user] Wsgi pscheduler module and logger modules
 
Hi,

Do you have any configuration management software running (puppet, ansible, cfengine, etc)? That file used to get added by pre-2.1 versions of esmond on install and only on install. There are no scripts that I can think of at the moment that we ship or have shipped that would recreate it. 

Thanks,
Andy



On April 24, 2017 at 12:43:40 PM, Liu, Dengfeng (NIH/CIT) [C] () wrote:

The file /etc/httpd/conf.d/apache-esmond.conf exists and after I remove it, that file got created automatically after some time. 

Dengfeng



From: Andrew Lake <>
Sent: Monday, April 24, 2017 11:22 AM
To: ; Liu, Dengfeng (NIH/CIT) [C]; Mark Feit
Subject: Re: [perfsonar-user] Wsgi pscheduler module and logger modules
 
Hi,

Any chance you have anything else setup that uses mond_wsgi (e.g. globus/gridftp) on that host? or does /etc/httpd/conf.d/apache-esmond.conf exists and what are its contents if so (it shouldn't exists so if it does that might be a pointer to the problem)?

To answer your question more fully yes, on CentOS 6 there are two versions of python used by perfSONAR, the stock python 2.6 that is the system default and a version of python 2.7 that it from the CentOS SCL repo. SCL stansd for Software Collections and is repo where slightly newer version of software is provided that require some special steps to use. The Python 2.7 version is needed for esmond, which in turn pulls in some other SCL requirements like the python 2.7 version of mod_wsgi. For this reason, we quarantine esmond, python27 and python27-mod_wsgi off into httpd24 instead of the stock httpd where everything else runs. This is actually the default CentOS SCL setup for running these types of things. We then have the stock httpd process act as a reverse proxy to the httpd24 instance for all /esmond requests. Not ideal, but what we have to do to get the right versions for the tools. One advantage of moving to CentOS 7 is that all this nonsense goes away. It ships with python 2.7 as the default and everything uses that.

Hope that helps,
Andy



On April 24, 2017 at 10:53:32 AM, Liu, Dengfeng (NIH/CIT) [C] () wrote:

Seems the python home is using /usr/lib/esmond, which is 2.7, but for pscheduler is using 2.6.6.


Dengfeng





From: Liu, Dengfeng (NIH/CIT) [C]
Sent: Monday, April 24, 2017 9:49 AM
To: Mark Feit;
Cc: Andrew Lake
Subject: Re: [perfsonar-user] Wsgi pscheduler module and logger modules
 

also which version of python this wsgi is using? Seems for centos 6, python has multiple version come with perfsonar.


Dengfeng Liu

NIH/CIT/NSS
3014967328(o)
3018302642(c)




From: <> on behalf of Liu, Dengfeng (NIH/CIT) [C] <>
Sent: Friday, April 21, 2017 5:12 PM
To: Mark Feit;
Cc: Andrew Lake
Subject: Re: [perfsonar-user] Wsgi pscheduler module and logger modules
 

seems ok, rpm -V python-libs gives no output.


if comment out the import logging, error will show in log:

Traceback (most recent call last):
  File "/var/www/pscheduler-server/pscheduler-api-server.wsgi", line 10, in <module>
    from pschedulerapiserver import application
  File "./pschedulerapiserver/__init__.py", line 5, in <module>
ImportError: No module named pscheduler
Traceback (most recent call last):
  File "/var/www/pscheduler-server/pscheduler-api-server.wsgi", line 10, in <module>
    from pschedulerapiserver import application
  File "./pschedulerapiserver/__init__.py", line 5, in <module>
ImportError: No module named pscheduler

Dengfeng Liu

NIH/CIT/NSS
3014967328(o)
3018302642(c)




From: Mark Feit <>
Sent: Friday, April 21, 2017 4:59 PM
To: Liu, Dengfeng (NIH/CIT) [C];
Cc: Andrew Lake
Subject: Re: [perfsonar-user] Wsgi pscheduler module and logger modules
 

Liu, Dengfeng (NIH/CIT) [C] writes:

 

My upgrade shows error:

  File "/var/www/pscheduler-server/pscheduler-api-server.wsgi", line 5, in <module>
    import logging
ImportError: No module named logging


that gives http access problem.

Anyone saw this issue?

 

That sounds like something is missing from your system. 

 

The logging module is part of the standard Python library, and it might be that pScheduler is the first part of perfSONAR to use it.  If you’re on a CentOS system, this module would be in the python-libs RPM; you can run “rpm -V python-libs” to verify that everything in that module is in place.

 

--Mark

 




Archive powered by MHonArc 2.6.19.

Top of Page