Our TREC proposal for OpenSearch has been accepted! TREC OpenSearch will be run in a the same vein as CLEF LL4IR and use the same infrastructure.
OpenSearch is a new evaluation paradigm for IR. The experimentation platform is an existing search engine. Researchers have the opportunity to replace components of this search engine and evaluate these components using interactions with real, unsuspecting users of this search engine.
Read more on the TREC OpenSearch website.