perfsonar development work

[Loukik Kudarimoti <>]

Vedrin Jeliazkov wrote:
> Hi Loukik, All,
>
> Loukik Kudarimoti 
> <>
>  wrote:
>
> <snip>
>  
>   
> > Joe, since you probably have the highest number of interface 
> > configurations, would it be possible for you to install the recent 
> > snapshot as well? Of course, once the tests are done, the service can be 
> > uninstalled. Another option could be to mail me your config file and I 
> > can use it for test purposes (I can modify all the keys to point to the 
> > same dummy rrd file).
> >     
>
> If we take into consideration the fact that the services evolve, and the
> format of some messages and/or config files changes, I would rather prefer to
> see an automated benchmarking suite attached to each service version. Ideally,
> it should be produced, maintained and used by service developers in the first
> place in order to make sure that the current code delivers the expected
> performance in terms of response time, memory consumption, and scalability
> (simultaneous requests, number of endpoints). We should definitely not mix
> benchmarking with quality assurance and deployment. The benchmarking should
> happen during code development, and quality assurance should be carried out
> during release management, not only after that. It is essential to keep
> development-benchmarking cycles short (hours, days, instead of weeks or even
> months). Just my 2 cents...
>
>   
I couldn't agree more :) I have heard that the reason for lack of such 
efforts is that there are manpower constraints. Nicolas, can you please 
comment?

Loukik.
> Best regards,
> Vedrin
>
>
>
>