If your goal is to reproduce or understand such a pipeline:

This article dives deep into the mechanics, advantages, and practical applications of WALS Roberta sets configured for extra quality.

Now go ahead: set your tolerance to 1e-7, crank the rank to 512, and watch your RoBERTa soar to extra quality.