KaliYuga's Library of AI Google Colab Notebooks [Updated Dec 28, 2021]

Hi guys! As some of you know, I've been involved in creating AI art for almost two years. When I'm not building my own models, I use a lot of different Google Colab notebooks in my art. Even though there are a lot of really excellent notebooks available, tracking them down can be a challenge. I haven't seen a really comprehensive list of the ones used by the nascent AI art community, so I figured I'd put one together and give more people the freedom to create. This post will continue to grow as I find new notebooks, and as new methods are created. If you find any I've missed or have created any, let me know and I'll add them!

Table of Contents

  1. The Big Sleep
  2. VQGAN + Clip
    2a. VQGAN+CLIP with Video Features
  3. Clip-Guided Diffusion
  4. Styledream Notebook
  5. Pixray PixelDraw
  6. Real-ESRGAN Practical Image Restoration
  7. ruDALLE [Added Nov 2, 2021; Updated Nov 3, 2021]
  8. Looking Glass AI

1. The Big Sleep

image.png
A Beautiful House by BigSleep

Description: The original Clip-guided AI Colab tool; uses Clip to guide BigGAN. Fairly outdated.
Author: Adverb (advadnoun on Twitter)
Notebook Link


2. VQGAN + Clip

image.png
Gordian Gallery by KaliYuga, 2021

Description: By far the most widely-used of the Clip-guided methods; uses Clip to guide VQGAN.
Author: Katherine Crowson (RiversHaveWings on twitter)
Notebook Link (The notebook is in Spanish, but is easily translated to English using Chrome).


2a. VQGAN+CLIP with Video Features

Description: What it says on the tin! VQGAN + Clip with added video features and also some really good demystifications of parameters.
Author: @jotakrevs
Notebook Link


3. Clip-Guided Diffusion

image.png
Psychic Sermon in the Temple of the Mind by KaliYuga, 2021

Description: Produces absolutely unbelievable results, but very slow and resource-heavy. Uses Clip to guide a Diffusion model.
Author: Katherine Crowson (RiversHaveWings on twitter)
Notebook Link


4. Styledream Notebook

image.png
Portraits of DC heroes in the style of Alex Ross *by .hack//HAMBRE

Description: Portraits only! Clip-guided StyleGAN model.
Author: Ariel Ekgren (ArYoMo on twitter)
Notebook Link


5. Pixray PixelDraw

image.png
A synthwave great white shark by Viktor Alm

Description: A fork of NerdyRodent's fork of RiversHaveWings'VQGAN + Clip Notebook; uses VQGAN + Clip to produce pretty impressive pixel art.
Author:Dribnet
Notebook Link
Extra! You can also start with an initial image in a different version of Pixray; if you use an image originally created by pixray, the results can be pretty trippy! For example:

image.png
Via the Colab Notebook's demo params

Other bits and pieces of this project can be found here.


6. Real-ESRGAN Practical Image Restoration

image.png
Examples via the Colab Notebook

Description: A demo of Real-ESRGAN,which repairs many types of image degradation and also upscales the image 4x.
Authors: Xintao Wang, Liangbin Xie, Chao Dong, Ying Shan
Notebook Link


7. ruDALLE

image.png

Description: A Fully-Trained, Accessible, Multi-Billion-Parameter Answer to OpenAI's DALL-E Model (in Russian)
Authors: Sber AI and Sber Devices
Notebook Link
Bonus: A faster Colab notebook for free users


8. Looking Glass AI

image.png

Description: An Accessible One-Shot Finetuner For RuDalle
Authors: AI_Curio and Others
Notebook Link

H2
H3
H4
3 columns
2 columns
1 column
12 Comments