Link Diary March 2023
My march in links.
While finding resources on GPT ...
It's a frickin' rabbit hole …
The famous ChatGPT:
https://openai.com/blog/chatgpt
Training good AI is expensive:
https://techcrunch.com/2022/12/30/theres-now-an-open-source-alternative-to-chatgpt-but-good-luck-running-it/
Tons of training data may come as JSON
Slim data storage "JSON Lines"
Text dumps to train a language model
Text collections to train AI
GPT Alternatives anywhere?
ChatGPT Alternatives:
https://nlpcloud.com/chatgpt-open-source-alternatives.html
OpenSource GPT JAX:
https://pile.eleuther.ai/
nanoGPT: A very small GPT waiting to be trained:
https://github.com/karpathy/nanoGPT
Pretrained GPT-2 models are also available:
https://huggingface.co/gpt2/tree/main
Supporting software
Facebook Library to determine language:
https://github.com/facebookresearch/fastText
A talktive Language Model
Facebook's LLaMA, a probably illegal training with ChatGPT becomes Alpaca, the talktive Language model.
Runs at home, but don't expect ChatGPT level.
https://github.com/cocktailpeanut/dalai
Stable Diffusion WebUI
https://github.com/AUTOMATIC1111/stable-diffusion-webui
More options than the Simple Diffusion UI.
You can add models like this one: Modern Disney Style and have fun with it.
https://huggingface.co/nitrosocke/mo-di-diffusion
InvokeAI
Another stable diffusion frontend.
https://github.com/invoke-ai/InvokeAI/releases/tag/v2.3.1.post2
Images seem to be better. Multiple special pretrained models available directly.
I had to create the "outputs" folder before the WebUI could be started.
Deepfakes
I digged a little looking to find a open source program to do deepfakes.
TL;DR: https://github.com/iperov/DeepFaceLive
Software to make Deepfakes:
https://fossbytes.com/best-deepfake-apps-list/
Brief article on DeepFakes technology:
https://www.forbes.com/sites/lutzfinger/2022/09/08/overview-of-how-to-create-deepfakesits-scarily-simple/
Transfer animation
https://github.com/AliaksandrSiarohin/first-order-model
And the paper for it
https://aliaksandrsiarohin.github.io/first-order-model-website/
DeepFaceLab project:
https://github.com/iperov/DeepFaceLab
Animate images:
https://www.d-id.com/
Faceswap:
https://faceswap.dev/
Installing Faceswap:
https://forum.faceswap.dev/viewtopic.php?f=4&t=68
Voice cloning with Tortoise TTS
Simple Backup with rsync
# -> to sync folderX into folderY/folderX rsync -avc /the/source/folderX /the/target/folderY/
Digital Comic Book Readers for Linux
Got a comic as part of a bundle and was wonderung with what I can enjoy the CBZ file format.
Learn Ubuntu the latest nodejs version
I wanted to install Strapi on my cloudatcost machine for experimenting.
Unfortunately the nodejs version of my selected Ubuntu 22.04 was at 12.x even after an apt get update; apt get upgrade
. 16.x was the minimum requirement, 18.x recommended.
This is what I found:
sudo apt purge nodejs libnode72 libnode-dev curl -sL https://deb.nodesource.com/setup_18.x -o nodesource_setup.sh sudo bash ./nodesource_setup.sh sudo apt install -y nodejs
https://www.digitalocean.com/community/tutorials/how-to-install-node-js-on-ubuntu-22-04
Moving a local git repository to remote
… keeping all commits and branches …
git remote add origin git@github.com:user/repo.git git push --all origin git push --tags origin
https://gist.github.com/niksumeiko/8972566
Problem was the existing "main" branch in my case which I could neither merge nor rebase properly… which I then circumvented by renaming mine and pushing this instead.
git branch -m main develop
Remember SSH passwords with ssh-agent
Prerequisite:
- you can already log in with your SSH key by entering a passphrase - every time.
- You use the .ssh/config file to define which user and key is used for which domain.
sudo apt install "openssh-server" eval `ssh-agent` ssh-add ~/.ssh/my-private-key ssh myserver.com
View SSL Certificate
# full openssl s_client -showcerts -connect keinerweiss.de:443 # only dates openssl s_client -connect keinerweiss.de:443 2>/dev/null | openssl x509 -noout -dates
https://ma.ttias.be/how-to-read-ssl-certificate-info-from-the-cli/
https://linuxhandbook.com/check-certificate-openssl/
Video Picks
https://developer.apple.com/videos/play/wwdc2022/10037/
- Provider returned HTTP Status 401 for
- All resolution methods failed
Stable diffusion: Foto to art
- Provider returned HTTP Status 401 for
- All resolution methods failed
- Provider returned HTTP Status 403 for
- All resolution methods failed
Learning ARK
Discussion