Training GPT2-MEDIUM from scratch on Colab. UPDATE: 6–5–2023: float32 fix (no mixed precision — error) and Chained-generation with unlimited length with directed prompt injection (see the other video from Todor’s youtube channel)
An update for my Youtube tutorial and notebook from 2021, after I discovered the code needed a little tweek to run again. I also added the code for the unlimited-length generation with hidden prompt injection.
The same idea could be applied for any generative model, if you have control of it and can inject prompt in the context when later to be hidden from the output.
GPT2, Collaboratory
#gpt2 #colab #python #promptengineering
0 коментара:
Post a Comment