IN HIATUS UNTIL FURTHER NOTICE
Jan 31, 2024
Feb 14 (Canceled)
Purpose of this site: Share links on topics we talk about
IN HIATUS UNTIL FURTHER NOTICE
Jan 31, 2024
Feb 14 (Canceled)
Purpose of this site: Share links on topics we talk about
AI - based recommendation engine
Classification by genre / artist
stumpy results -
OPTION A - GET MUSIC FROM YOUTUBE
!python3 -m pip install --force-reinstall https://github.com/yt-dlp/yt-dlp/archive/master.tar.gz
!yt-dlp 'https://www.youtube.com/watch?v=9eGTNqMIVpY'
OPTION B - GET MUSIC FROM A DATABASE
https://github.com/Yuan-ManX/ai-audio-datasets-list
https://dunya.compmusic.upf.edu/developers/ (suggested by NA)
ffmpeg can be used to get mp3 from mp4
STEP 2: LOAD IT and Do some analysis
Use Librosa
STEP 3: BUILD A MODEL ( tensorflow, pytorch, jax, AppleML)
LLMs to try to generating lyrics, melody, chords
Developers: Seth Forsgren, Hayk Martiros
https://huggingface.co/riffusion/riffusion-model-v1
Open AI
Code: https://github.com/openai/jukebox.
Paper: https://arxiv.org/pdf/2005.00341.pdf
https://openai.com/research/musenet
Meta
audiocraft
MusicGen - inference time slow for live demo/testing
https://audiocraft.metademolab.com/
MusicLM - https://google-research.github.io/seanet/musiclm/examples/
Dataset: https://www.kaggle.com/datasets/googleai/musiccaps
https://arxiv.org/pdf/2301.11325.pdf
https://magenta.tensorflow.org/
Audio w/ Python
https://www.youtube.com/watch?v=ROlkhVs15AM
Reconstructing sounds of different instruments
https://mapio.github.io/sinuous-violin/
https://www.youtube.com/watch?v=IdsrZYZ0TI0
https://www.youtube.com/watch?v=9Lk4gBBWMqw
https://www.youtube.com/watch?v=Q40qEg8Yq5c
https://www.youtube.com/watch?v=MhOdbtPhbLU
Python libraries:
Librosa
pip install librosa
Spleeter
pip install spleeter
https://pypi.org/project/spleeter/
https://colab.research.google.com/github/deezer/spleeter/blob/master/spleeter.ipynb
https://pypi.org/project/omnizart/
https://scicoding.com/pitchdetection/
Other Interesting Codes
OPen Problems
Real time jamming / Decrease inference time / Decrease model size
Metrics to sufficiently distinguish AI-generated music as unique (not too close to the training data)
Transcription that's not character level (not at the note level) that accurately describes a melody
Solved Problems 🤔
Transcription
Music Transcription with Transformers:
https://magenta.tensorflow.org/transcription-with-transformers - has examples