Peter AlbertGuide: Finetune GPT-NEO (2.7 Billion Parameters) on one GPUGPT-NEO is a series of languages model from EleutherAI, that tries to replicate OpenAI’s GPT-3 language model. EleutherAI’s current models…Apr 10, 20212Apr 10, 20212
Peter AlbertGuide: Finetune GPT2 (1.5 B)Finetune GPT2-XL (1.5 Billion Parameters, the biggest model) on a single 16 GB VRAM V100 Google Cloud instance with Huggingface…Mar 28, 2021Mar 28, 2021