معرفی شرکت ها
asyncpg-lostream-0.1.2b1
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشترتوضیحات
CRUD on PostgreSQL large objects using async drivers and asyncio. Data are read and written in chunks.
| ویژگی | مقدار |
|---|---|
| سیستم عامل | - |
| نام فایل | asyncpg-lostream-0.1.2b1 |
| نام | asyncpg-lostream |
| نسخه کتابخانه | 0.1.2b1 |
| نگهدارنده | ['HAP'] |
| ایمیل نگهدارنده | ['hproctor@redhat.com'] |
| نویسنده | Red Hat, Inc. |
| ایمیل نویسنده | info@ansible.com |
| آدرس صفحه اصلی | https://github.com/Red-HAP/asyncpg-lostream |
| آدرس اینترنتی | https://pypi.org/project/asyncpg-lostream/ |
| مجوز | Apache-2.0 |
# asyncpg-lostream
CRUD on PostgreSQL large objects using async drivers and asyncio. It is tested against SQLAlchemy.
## Purpose
Synchronous drivers such as `psycopg2` support large objects via a file-like interface utilizing libpg. Unfortunately, async drivers such as `asyncpg` do not support large objects at all (at this time). This module is designed to provide an interface for PostgreSQL large objects that is compatible with asyncio and async database drivers. This interface is achieved by calling the supporting PostgreSQL stored functions that are an interface to the large object store.
This interface is designed to operate on data by reading and writing in chunks so as to stream the data to and from the large object store.
This codebase is not tied or affiliated with asyncpg. It does utilize SQLAlchemy's AsyncConnection class in its typing.
## PostgreSQL Large Objects
A large object is a special store in PostgreSQL that operates similarly to a file. The large object itself is the record. The database data type is `bytea` (`bytes` in Python). The interface operates as a read and write to the allocated large object via read and write functions. (There are more, but they are out of scope for this project.) The data type of the large object id is `oid`. The tables used by PostgreSQL are `pg_largeobject` and `pg_largeobject_metadata`. The `pg_largeobject` table holds the data itself. The `pg_largeobject_metadata` has a link to the owner oid. These two tables are linked by the `oid` reference.
When assiciating the large object to a table record, add an `oid` type column to hold the allocated large object `oid` value from a created large object.
See the PostgreSQL documentation [here](https://www.postgresql.org/docs/current/largeobjects.html).
## Utilization
### Explicit Create
```python
from asyncpg_lostream.lostream import PGLargeObject
# It is the responsibility of the caller to resolve how an
# AsyncEngine is created and how an AsyncConnection is created.
# Create a large object
lob_oid = await PGLargeObject.create_large_object(db)
# Open a large object for read and write
pgl = PGLargeObject(async_connection, lob_oid, mode="rw")
with open("my_data.txt", "r") as data:
for buff in data.read(pgl.chunk_size):
await pgl.write(buff.encode)
pgl.close()
```
### Context Manager Create
```python
from asyncpg_lostream.lostream import PGLargeObject
# It is the responsibility of the caller to resolve how an
# AsyncEngine is created and how an AsyncConnection is created.
with open("my_data.txt", "r") as data:
async with PGLargeObject(async_connection, 0, "w") as pgl:
for buff in data.read(pgl.chunk_size):
await pgl.write(buff.encode())
```
### Context manager read
```python
from asyncpg_lostream.lostream import PGLargeObject
# It is the responsibility of the caller to resolve how an
# AsyncEngine is created and how an AsyncConnection is created.
async with PGLargeObject(async_connection, existing_lob_oid, "r") as pgl:
async for buff in pgl:
print(buff.decode())
```
## Development
### Environment
1. Create a virtual environment
```bash
python -m venv /path/to/venv
```
2. Activate the virtual environment
```bash
source /path/to/venv/bin/activate
```
3. Ensure pip is up to date
```bash
pip install --upgrade pip
```
4. Install packages from `requirements.txt`
```bash
pip install -r requirements.txt
```
5. Install `pre-config`
```bash
pre-config install
```
### Development
`make`, `docker-compose` and `docker` are required for development.
To list the make targets, use `make help`
To start a local PostgreSQL 13 container: `make start_db`
To shutdown the local PostgreSQL 13 container: `make stop_db`
After making changes, create your unit tests in the `asyncpg-lostream/tests` directory.
Test your changes with the command `make test`
## Packaging
If you intend to make a releaase, change the version in the `setup.cfg` file. This value will be copied to the module's `__version__` file.
Build the package using `make build`. This will run the tests and then build the artifacts. These will be put into the `dist/` directory.
For instructions on upload to PyPI, see the [Packaging Python Projects Dcoumentation](https://packaging.python.org/en/latest/tutorials/packaging-projects/#uploading-the-distribution-archives)
نیازمندی
| مقدار | نام |
|---|---|
| >=1.4 | sqlalchemy[asyncio] |
| - | asyncpg |
زبان مورد نیاز
| مقدار | نام |
|---|---|
| >=3.9 | Python |
نحوه نصب
نصب پکیج whl asyncpg-lostream-0.1.2b1:
pip install asyncpg-lostream-0.1.2b1.whl
نصب پکیج tar.gz asyncpg-lostream-0.1.2b1:
pip install asyncpg-lostream-0.1.2b1.tar.gz