Jesse Weaver RDF Management Approaches Joshua Taylor 2

Question is for the Presentation: Jesse Weaver RDF Management Approaches
Question is asked by: Joshua Taylor
The Question is: In 4 Experimental Results the authors write, "As our primary interest is the basic performance of the approaches (rather than caching or learning strategies), we performed cold runs, i.e. destroyed the database in-beween each two consecutive runs, and always restarted it before evaluating a query." Is this realistic? Clearly it means that caching and learning strategies will not influence the result, but if those are typical of database systems, would it not make for a better evaluation if they had cold runs in addition to "warm" runs where caching and learning strategies could affect performance? If the differences were not significant, then the authors would have shown that, and if the differences were, and those uses are more typical, then the comparison would be more useful.

Answer

I wholeheartedly agree.

Question asked	In 4 Experimental Results the author … In 4 Experimental Results the authors write, "As our primary interest is the basic performance of the approaches (rather than caching or learning strategies), we performed cold runs, i.e. destroyed the database in-beween each two consecutive runs, and always restarted it before evaluating a query." Is this realistic? Clearly it means that caching and learning strategies will not influence the result, but if those are typical of database systems, would it not make for a better evaluation if they had cold runs in addition to "warm" runs where caching and learning strategies could affect performance? If the differences were not significant, then the authors would have shown that, and if the differences were, and those uses are more typical, then the comparison would be more useful. then the comparison would be more useful.
Question asked by	Joshua Taylor +
Question for the Presentation	Jesse Weaver RDF Management Approaches +