Editing CXCSCMU GroupWiki (section)

=== Mitigation / Debugs when validation fails ===
Some reasons why code doesn't work and possible solutions. 

* Code is not written to open-source standards 
** Code may have worked for authors, but it is not generally usable
** Sometimes fixes are easy – check-in/out directories
* Code is from a while ago 
** Check package versions that authors use, and replicate in venv if possible 
** If intending to fine-tune model for future use, you probably want to update the code -- see documentation on any breaking updates 
* Missing components needed 
** Probably the authors also based their project off someone else’s – can do some digging to see if the missing component is anywhere else on the internet
* Everything runs without error, but results are just not replicable 😡 
** Check data processing (lookout for corrupted / truncated files)
** Check model parameters (especially optimization parameters) 
** Check that “default” parameters in args correspond to optimal values they report in the paper 

Always a good idea to check github issues and see if you problem is a "known" problem, and if there are any workarounds.