OPT-IML (OPT + Instruction Meta-Learning) is a set of instruction-tuned versions of OPT, on a collection of ~2000 NLP tasks gathered from 8 NLP benchmarks, called OPT-IML Bench.
We provide two model versions:
OPT-IML trained on 1500 tasks with several tasks held-out for purposes of downstream evaluation, and OPT-IML-Max trained on all ~2000 tasks
Visit Official Website