معرفی شرکت ها
dlf-nova-play-my-own-music-0.1.3
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشترتوضیحات
Switches to Spotify if music is played on DLF Nova radio stream.
| ویژگی | مقدار |
|---|---|
| سیستم عامل | - |
| نام فایل | dlf-nova-play-my-own-music-0.1.3 |
| نام | dlf-nova-play-my-own-music |
| نسخه کتابخانه | 0.1.3 |
| نگهدارنده | [] |
| ایمیل نگهدارنده | [] |
| نویسنده | Alexander Jahn |
| ایمیل نویسنده | - |
| آدرس صفحه اصلی | https://github.com/AlxndrJhn/DLF-Nova-Play-My-Own-Music |
| آدرس اینترنتی | https://pypi.org/project/dlf-nova-play-my-own-music/ |
| مجوز | MIT |
[](https://app.circleci.com/pipelines/github/AlxndrJhn/DLF-Nova-Play-My-Own-Music)
# DLF-Nova Play My Own Music
The [DLF nova](https://www.deutschlandfunknova.de/) [playlist](https://open.spotify.com/playlist/5qE59dOhR3JtRE8YThsjkO) is just a few hours long, leading to a lot of repetitions if you listen long enough. This is kind of annoying, because the news-bits are quite interesting.
So I programmed a script that detects music/news and switches to spotify during the music parts on the radio.
This project is work in progress, I want to make it easier to use.
# Requirements
- VLC https://www.videolan.org/vlc/
- spotify account https://www.spotify.com
- spotify client ID: https://developer.spotify.com/dashboard/applications
- python 3.7
# Get started
1. To use the Spotify API a `client id` and `client secret` are needed, it can be created [here](https://developer.spotify.com/dashboard/applications)
1. Save `SPOTIPY_CLIENT_ID` in your environment (example `1a2ef9787cc1638261545d6dadb2315`)
2. Save `SPOTIPY_CLIENT_SECRET` in your environment (example `2c12e5161ace0476c8f2abc70a924ac76`)
2. Find your spotify username and insert it in `spotify_username` in `online_prototype.py`
3. Install with `pip install DLF-Nova-Play-My-Own-Music`
4. `dlfnova -su my.spotifyusername` to start
After some setup messages it should generate logs like this
```
19:20:34: Class: music, prob.: 96%, filtered signal: 0%, AI performance: 3.3Hz
19:20:36: Class: music, prob.: 66%, filtered signal: 0%, AI performance: 3.5Hz
19:20:39: Class: news, prob.: 84%, filtered signal: 70%, AI performance: 3.3Hz
19:20:42: Class: news, prob.: 99%, filtered signal: 91%, AI performance: 3.3Hz switch to radio
[00000282eb2c49d0] prefetch stream error: unimplemented query (264) in control
19:20:44: Class: news, prob.: 100%, filtered signal: 97%, AI performance: 2.8Hz
19:20:47: Class: news, prob.: 100%, filtered signal: 99%, AI performance: 3.4Hz
19:20:49: Class: news, prob.: 100%, filtered signal: 100%, AI performance: 3.3Hz
```
# Technical details
I trained a simple deep learning model to classify an audio single as "music" or "news", using this classifications, I switch between my spotify device and the online radio stream.
## Dataset
The dataset consists of:
- 500MB of DLF nova podcasts from https://www.deutschlandfunknova.de/podcasts
- [the DLF nova spotify playlist](https://open.spotify.com/playlist/5qE59dOhR3JtRE8YThsjkO) using [spotdl](https://pypi.org/project/spotdl/)
- stream chunks
To split training (80%) and test (20%) datasets, the files are separated randomly before splitting into chunks.
The mp3 files are split into 10s chunks (no overlapping) at 44100Hz.
Each chunk is converted to the feature vector, making the dataset files relatively small.
## Input vector/features
Based on this [this medium article](https://medium.com/@mikesmales/sound-classification-using-deep-learning-8bc2aa1990b7) and [this article](https://opensource.com/article/19/9/audio-processing-machine-learning-python) I chose three features: `MFCC` (related to speech/music separation, from [librosa](https://pypi.org/project/librosa/)), `GFCC` (typical used for speaker recognition, from [spafe](https://pypi.org/project/spafe/)) and `onset_strength` (related to beat detection in music, from [librosa](https://pypi.org/project/librosa/)). It results in a 256 dimensional vector.
```python
# feature vector
mfccs = librosa.feature.mfcc(y=audio, sr=sample_rate, n_mfcc=20)
mfccs_scaled = np.mean(mfccs.T, axis=0)
try:
gfccs = gfcc(audio, num_ceps=20)
gfccs_scaled = np.mean(gfccs, axis=0)
except Exception:
gfccs_scaled = np.zeros(20)
hop_length = 2048
oenv = librosa.onset.onset_strength(y=audio, sr=sample_rate, hop_length=hop_length)
return np.hstack((mfccs_scaled, gfccs_scaled, oenv))
```
Where `audio` is always a 10 second audio chunk at 44100Hz sample rate.
## Deep learning model
I used the [Keras](https://pypi.org/project/Keras/) model from [this medium article](https://medium.com/@mikesmales/sound-classification-using-deep-learning-8bc2aa1990b7)
```python
model = Sequential()
model.add(Dense(256, input_shape=(input_size,)))
model.add(Activation("relu"))
model.add(Dropout(0.5))
model.add(Dense(256))
model.add(Activation("relu"))
model.add(Dropout(0.5))
model.add(Dense(num_labels))
model.add(Activation("softmax"))
model.compile(loss="categorical_crossentropy", metrics=["accuracy"], optimizer="adam")
```
where `input_size` is 256.
It trained for 100 epochs, default learning rate, batch size 256 and saved the weights with the lowest validation loss.
## Performance
It achieved 99.8% accuracy during training and 98% for the validation set.
## Switching
The script `online_prototype.py` registers through the spotify API and requests with OAUTH permission to see the devices and modify the player state. It downloads the DLF stream in 40kB chunks and outputs an classification every 2 to 3 seconds. This signal is smoothed and it triggers switching events. The radio is streamed via VLC.
# Known issues
- Some songs are classified as news sometimes, due to the simple model. Happens with rap especially. The news sometimes have a beat in the background as well.
- `[00000282eb2c49d0] prefetch stream error: ...` logs, they come from VLC
# TODO
1. Train better model for fewer switching errors
2. Fading the sound during the switch event
نیازمندی
| مقدار | نام |
|---|---|
| >=2.3.1,<3.0.0 | Keras |
| >=7.1.2,<8.0.0 | click |
| >=1.18.4,<2.0.0 | numpy |
| >=1.0.3,<2.0.0 | pandas |
| >=0.24.0,<0.25.0 | pydub |
| >=3.0.9113,<4.0.0 | python-vlc |
| >=0.0,<0.1 | sklearn |
| >=0.1.2,<0.2.0 | spafe |
| >=2.12.0,<3.0.0 | spotipy |
زبان مورد نیاز
| مقدار | نام |
|---|---|
| >=3.7,<4.0 | Python |
نحوه نصب
نصب پکیج whl dlf-nova-play-my-own-music-0.1.3:
pip install dlf-nova-play-my-own-music-0.1.3.whl
نصب پکیج tar.gz dlf-nova-play-my-own-music-0.1.3:
pip install dlf-nova-play-my-own-music-0.1.3.tar.gz