Editing CXCSCMU GroupWiki (section)

=== Incremental validation ===
Conducting incremental validation of an open-source repository is highly recommended so that we can be sure that all components are performing as expected. 

* Evaluate the performance of outputs 
** Evaluate quickly published outputs and check if performance agrees with what they claim.
** For example, an “output” refers to the predicted rank in a retrieval task on a dev set.
* Evaluate performance on published artefacts
** For example, if trained embeddings are available, validate performance on that using a prediction step of the downloaded trained model. 
** Unlikely to be available due to large file sizes (see: inference step).
* Run inference (forward) pass
** To obtain predictions on downstream task 
** Follow open-source instructions for this step.
** Check if performance agrees with performance claims. 
* Run training 
** Required if you are further fine-tuning the model (or parts thereof)  
** Follow up with inference