writeup.ai
- Original article
- https://senrigan.io/blog/how-writeupai-runs-behind-the-scenes/#h%5F6068056784021570782144062
Glossary
|
|
Examples of usage of GPT-2
https://github.com/allenai/lm-explorer
Read this in eww
article | review |
---|---|
GPT-2 Neural Network Poetry - Gwern.net | http://mullikine.github.io/posts/review-of-gewn-gpt2/ |
The website when viewed with a GUI browser, although impressive, is distracting.
The website was built with hackyll
, a static site generator employing haskell
.
|
|
Straight-forward once you understand ML jargon.
Studying GPT-2
Preprocessing
|
|
ndjson
Each line corresponds to an independent json
file.
Training
gradient checkpointing
to handle memory issues
GPU memory is often the limiting factor for modern neural network architectures.
https://medium.com/tensorflow/fitting-larger-networks-into-memory-583e3c758ff9
Backend
https://github.com/jeffshek/open
$MYGIT/jeffshek/open
Glossary
|
|
Emacs setup
|
|
Caddy setup
|
|
I guess the web server hosts django on =8008
and the caddy
command below simple outputs
errors to stdout
.
When Caddyfile
is present this should just work
|
|
Django setup
|
|
Docker setup
|
|
Thanks for reading!
If this article appears incomplete, it may be intentional. Try prompting for a continuation.
If this article appears incomplete, it may be intentional. Try prompting for a continuation.