معرفی شرکت ها
aac-datasets-0.3.2
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشترتوضیحات
Audio Captioning datasets for Pytorch.
| ویژگی | مقدار |
|---|---|
| سیستم عامل | - |
| نام فایل | aac-datasets-0.3.2 |
| نام | aac-datasets |
| نسخه کتابخانه | 0.3.2 |
| نگهدارنده | [] |
| ایمیل نگهدارنده | [] |
| نویسنده | Etienne Labbé (Labbeti) |
| ایمیل نویسنده | - |
| آدرس صفحه اصلی | https://pypi.org/project/aac-datasets/ |
| آدرس اینترنتی | https://pypi.org/project/aac-datasets/ |
| مجوز | MIT |
<!-- # -*- coding: utf-8 -*- -->
<div align="center">
# Audio Captioning datasets for PyTorch
<a href="https://www.python.org/"><img alt="Python" src="https://img.shields.io/badge/-Python 3.8+-blue?style=for-the-badge&logo=python&logoColor=white"></a>
<a href="https://pytorch.org/get-started/locally/"><img alt="PyTorch" src="https://img.shields.io/badge/-PyTorch 1.10.1+-ee4c2c?style=for-the-badge&logo=pytorch&logoColor=white"></a>
<a href="https://black.readthedocs.io/en/stable/"><img alt="Code style: black" src="https://img.shields.io/badge/code%20style-black-black.svg?style=for-the-badge&labelColor=gray"></a>
<a href="https://github.com/Labbeti/aac-datasets/actions"><img alt="Build" src="https://img.shields.io/github/actions/workflow/status/Labbeti/aac-datasets/python-package-pip.yaml?branch=main&style=for-the-badge&logo=github"></a>
Audio Captioning unofficial datasets source code for **AudioCaps** [[1]](#audiocaps), **Clotho** [[2]](#clotho), and **MACS** [[3]](#macs), designed for PyTorch.
</div>
## Installation
```bash
pip install aac-datasets
```
## Examples
### Create Clotho dataset
```python
from aac_datasets import Clotho
dataset = Clotho(root=".", download=True)
item = dataset[0]
audio, captions = item["audio"], item["captions"]
# audio: Tensor of shape (n_channels=1, audio_max_size)
# captions: list of str
```
### Build PyTorch dataloader with Clotho
```python
from torch.utils.data.dataloader import DataLoader
from aac_datasets import Clotho
from aac_datasets.utils import BasicCollate
dataset = Clotho(root=".", download=True)
dataloader = DataLoader(dataset, batch_size=4, collate_fn=BasicCollate())
for batch in dataloader:
# batch["audio"]: list of 4 tensors of shape (n_channels, audio_size)
# batch["captions"]: list of 4 lists of str
...
```
## Datasets stats
Here is the statistics for each dataset :
| | AudioCaps | Clotho | MACS |
|:---:|:---:|:---:|:---:|
| Subset(s) | train, val, test | dev, val, eval, test, analysis | full |
| Sample rate | 32000 | 44100 | 48000 |
| Estimated size | 43GB | 27GB | 13GB |
| Audio source | AudioSet (youtube) | Freesound | TAU Urban Acoustic Scenes 2019 |
Here is the **train** subset statistics for each dataset :
| | AudioCaps/train | Clotho/dev | MACS/full |
|:---:|:---:|:---:|:---:|
| Nb audios | 49838 | 3840 | 3930 |
| Total audio duration | 136.6h<sup>1</sup> | 24.0h | 10.9h |
| Audio duration range | 0.5-10s | 15-30s | 10s |
| Nb captions per audio | 1 | 5 | 2-5 |
| Nb captions | 49838 | 19195 | 17275 |
| Total nb words<sup>2</sup> | 402482 | 217362 | 160006 |
| Sentence size<sup>2</sup> | 2-52 | 8-20 | 5-40 |
<sup>1</sup> This duration is estimated on the total duration of 46230/49838 files of 126.7h.
<sup>2</sup> The sentences are cleaned (lowercase+remove punctuation) and tokenized using the spacy tokenizer to count the words.
## Requirements
### Python packages
The requirements are automatically installed when using pip on this repository.
```
torch >= 1.10.1
torchaudio >= 0.10.1
py7zr >= 0.17.2
pyyaml >= 6.0
tqdm >= 4.64.0
```
### External requirements (AudioCaps only)
The external requirements needed to download **AudioCaps** are **ffmpeg** and **youtube-dl**.
These two programs can be download on Ubuntu using `sudo apt install ffmpeg youtube-dl`.
You can also override their paths for AudioCaps:
```python
from aac_datasets import AudioCaps
AudioCaps.FFMPEG_PATH = "/my/path/to/ffmpeg"
AudioCaps.YOUTUBE_DL_PATH = "/my/path/to/youtube_dl"
dataset = AudioCaps(root=".", download=True)
```
## Download datasets
To download a dataset, you can use `download=True` argument in dataset construction.
However, if you want to download datasets separately, you can also use the following command :
```bash
aac-datasets-download --root "." clotho --subsets "dev"
```
Or use the corresponding function in the code :
```python
from aac_datasets.download import download_clotho
download_clotho(root=".", subsets=["dev"])
```
## References
#### AudioCaps
[1] C. D. Kim, B. Kim, H. Lee, and G. Kim, “Audiocaps: Generating captions for audios in the wild,” in NAACL-HLT, 2019. Available: https://aclanthology.org/N19-1011/
#### Clotho
[2] K. Drossos, S. Lipping, and T. Virtanen, “Clotho: An Audio Captioning Dataset,” arXiv:1910.09387 [cs, eess], Oct. 2019, Available: http://arxiv.org/abs/1910.09387
#### MACS
[3] F. Font, A. Mesaros, D. P. W. Ellis, E. Fonseca, M. Fuentes, and B. Elizalde, Proceedings of the 6th Workshop on Detection and Classication of Acoustic Scenes and Events (DCASE 2021). Barcelona, Spain: Music Technology Group - Universitat Pompeu Fabra, Nov. 2021. Available: https://doi.org/10.5281/zenodo.5770113
## Cite the aac-datasets package
If you use this software, please consider cite it as below :
```
@software{
Labbe_aac-datasets_2022,
author = {Labbé, Etienne},
license = {MIT},
month = {01},
title = {{aac-datasets}},
url = {https://github.com/Labbeti/aac-datasets/},
version = {0.3.2},
year = {2023}
}
```
## Contact
Maintainer:
- Etienne Labbé "Labbeti": labbeti.pub@gmail.com
زبان مورد نیاز
| مقدار | نام |
|---|---|
| >=3.7 | Python |
نحوه نصب
نصب پکیج whl aac-datasets-0.3.2:
pip install aac-datasets-0.3.2.whl
نصب پکیج tar.gz aac-datasets-0.3.2:
pip install aac-datasets-0.3.2.tar.gz