specter (scientific paper embeddings using citation-informed transformer)

This model is specifically trained for scientific papers and takes into account citation information to better capture paper semantics.