Shibboleth Developers

[Walter Hoehn <>]

It might be a good idea if we talked about this on the next call.  I  
do see the validity of having simple end-to-end tests.  However, I  
don't think it makes sense to duplicate everything that exists in the  
current test suite.

-Walter


On Nov 10, 2005, at 8:41 AM, Will Norris wrote:

> On Nov 9, 2005, at 2:02 PM, Howard Gilbert wrote:
>
> > A JUnit based IntegrationTest is now checked into /tests/ 
> > edu.internet2.middleware.shibboleth.integration. It uses classes  
> > in /tests/edu.internet2.middleware.shibboleth.runner and  
> > configuration files accessed as resources from /testresources.
> >
> > To run it in Eclipse, change your project to add /testresources as  
> > a "source" directory in the Windows-Preferences-Java-Build Path.  
> > Yes there is no actual java source in this directory, but  
> > declaring it to be a source causes the configuration files to be  
> > copied to the generated classes where they are available as  
> > resources during execution of the test.
> >
> > Right clicking on IntegrationTest and choosing Run as - JUnit Test  
> > runs the three test cases. All tests execute the IdP, SP, and  
> > Filter in sequence. One test does a POST with Attribute Push, one  
> > does a POST with Attribute Query, and one does an Artifact signon.
> >
> > There is extensive commentary in IntegrationTest, which should  
> > serve as a model and documentation of how to run the tests. There  
> > is not, however, an exhaustive set of functional checks and test  
> > assertions. There is, however, some effort to exercise a lot of  
> > features and the debugging trace shows the correct operation of  
> > some ARP and AAP processing.
> >
> > Although this can be used for automated testing, it also serves as  
> > a good platform for debugging new features or changes. Right click  
> > and choose Debug as instead of Run as to run everything under the  
> > debugger.
>
> Perhaps I'm misunderstanding what this tests, but is this not  
> testing basically the same thing as the blackbox IdP stuff checked  
> in last month? (tests/edu.i2.middleware.shibboleth.idp.(AA|SSO) 
> Test).  That DOES contain a fairly exhaustive set of tests.  Just  
> "Run As -> Junit Test".
>
> More of a simple project management question, but what was the  
> rationale behind /testresources as opposed to keeping everything  
> together in /data ?
>
>
> --
> Will Norris
> Information Technology
> The University of Memphis