معرفی شرکت ها
dictgest-0.4.0
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشتر
تبلیغات ما
مشتریان به طور فزاینده ای آنلاین هستند. تبلیغات می تواند به آنها کمک کند تا کسب و کار شما را پیدا کنند.
مشاهده بیشترتوضیحات
Advanced dictionary ingestion into python objects
| ویژگی | مقدار |
|---|---|
| سیستم عامل | - |
| نام فایل | dictgest-0.4.0 |
| نام | dictgest |
| نسخه کتابخانه | 0.4.0 |
| نگهدارنده | [] |
| ایمیل نگهدارنده | [] |
| نویسنده | Bogdan Sandoi |
| ایمیل نویسنده | bogdan.sandoi@gmail.com |
| آدرس صفحه اصلی | https://github.com/bmsan/DictGest |
| آدرس اینترنتی | https://pypi.org/project/dictgest/ |
| مجوز | - |
# DictGest - Python Dictionary Ingestion
[](https://sonarcloud.io/summary/new_code?id=bmsan_DictGest)
[](https://sonarcloud.io/summary/new_code?id=bmsan_DictGest)
[](https://sonarcloud.io/summary/new_code?id=bmsan_DictGest)
[](https://codecov.io/gh/bmsan/dictgest)
[](https://github.com/bmsan/dictgest/actions?queryworkflow%3ACI+event%3Apush+branch%3Amain)
[](https://readthedocs.org/projects/dictgest)
[](https://discord.gg/yBb99rxBUZ)
- [DictGest - Python Dictionary Ingestion](#dictgest---python-dictionary-ingestion)
- [Description](#description)
- [Examples](#examples)
- [Example 1: Trivial Example - Handling Extra parameters](#example-1-trivial-example---handling-extra-parameters)
- [Example 2: Data mapping renaming & rerouting](#example-2-data-mapping-renaming--rerouting)
- [Example 3: Data type enforcing](#example-3-data-type-enforcing)
- [Example 4: Custom Data extraction/conversion for a specific field](#example-4-custom-data-extractionconversion-for-a-specific-field)
- [Example 5: Custom Data conversion for a specific type](#example-5-custom-data-conversion-for-a-specific-type)
- [Example 6: Populating the same structure from multiple different dict formats (multiple APIs)](#example-6-populating-the-same-structure-from-multiple-different-dict-formats-multiple-apis)
- [Example 8: Populating from a 2D Table](#example-8-populating-from-a-2d-table)
- [Transposing data](#transposing-data)
- [Mapping one table row to target type](#mapping-one-table-row-to-target-type)
- [Installing](#installing)
- [Contributing](#contributing)
- [Support](#support)
- [License](#license)
- [Acknowledgements](#acknowledgements)
# Description
When interacting with external REST APIs or with external configuration files we usually do not have control
over the received data structure/format.
`DictGest` makes ingesting dictionary data into python objects(dataclasss objects included) easy when the dictionary data doesn't match 1 to 1 with the Python class:
- The dictionary might have extra fields that are of no interest
- The keys names in the dictionary do not match the class attribute names
- The structure of nested dictionaries does not match the class structure
- The data types in the dictionary do not match data types of the target class
# Examples
## Example 1: Trivial Example - Handling Extra parameters
The first most basic and trivial example is ingesting a dictionary that has extra data not of interest
```python
from dictgest import from_dict
```
```python
car = from_dict(Car, dict_data)
```
## Example 2: Data mapping renaming & rerouting
The keys names in the source dictionary might not match the destionation class attribute names.
Also the source dictionary might have a nested structure different than our desired structure.
```python
from typing import Annotated
from dataclasses import dataclass
from dictgest import from_dict, Path
```
```python
article = from_dict(Article, news_api_data)
meta = from_dict(ArticleMeta, news_api_data)
stats = from_dict(ArticleStats, news_api_data)
```
The full working example can be found in the [examples folder](https://github.com/bmsan/DictGest/blob/main/examples/news_example.py)
There can be cases where Annotating the type hints of the target class is not desired by the user or when mapping to multiple APIs might be required.
For these cases look at examples 6 & 7 for an alternate solution.
## Example 3: Data type enforcing
Sometimes the data coming from external sources might have different datatypes than what we desire. `dictgen` can do type conversion for you.
```py
from dataclasses import dataclass
from dictgest import from_dict, typecast
@typecast # Makes the class type convertable when encountered as typing hint
@dataclass # The dataclass is just an example, it could have an normal class
class Measurment:
temp: float
humidity: float
class Sensor:
def __init__(
self, name: str, location: str, uptime: float, readings: list[Measurment]
):
...
```
The conversions shown above were enabled by setting the `@typecast` decorator for the targetted classes.
The full working example can be found in the [examples folder](https://github.com/bmsan/DictGest/blob/main/examples/typeconvert_example.py)
## Example 4: Custom Data extraction/conversion for a specific field
Sometimes we might want to apply custom transforms to some fields when extracting the data from the dictionary.
In this example we want to read the total number of votes, but in the dictionary source we only have two partial values: the positive and negative number of votes.
We apply a custom transform to get our desired data, using the `extractor` argument of `dictgest.Path`
```py
from typing import Annotated
from dictgest import Path, from_dict
def extract_votes(data):
# creating a new value from two individual fields and converting them
return int(data["positive"]) + int(data["negative"])
class Votes:
def __init__(
self,
title,
total_votes: Annotated[int, Path("details/votes", extractor=extract_votes)],
):
...
article_data = {
"title": "Python 4.0 will...",
"details": {"votes": {"positive": "245", "negative": "30"}},
}
votes = from_dict(Votes, article_data)
```
The full working example can be found in the [examples folder](https://github.com/bmsan/DictGest/blob/main/examples/extract_example.py)
## Example 5: Custom Data conversion for a specific type
In some cases we might want to employ a custom conversion for a certain datatype.
```py
from dataclasses import dataclass
from dictgest import default_convertor, from_dict
# Get any already registered bool convertor
default_bool_conv = default_convertor.get_convertor(bool)
# create a custom converter
def custom_bool_conv(val):
if val == "oups":
return False
# Let the other cases be treated as before
return default_bool_conv(val)
# register the custom converter for bool
default_convertor.register(bool, custom_bool_conv)
@dataclass
class Result:
finished: bool
notified: bool
result = from_dict(Result, {"finished": True, "notified": "oups"})
print(result)
```
## Example 6: Populating the same structure from multiple different dict formats (multiple APIs)
There are cases where you might read information from multiple heterogenous APIs and you might want to convert them all to the same structure.
Previously we have annotated fields( using typing.Annotation hint ) with Path eg: ` name: Annotated[str, Path('article')] `. This works well for a single conversion mapping.
For this current scenario we are going to decouple the class from the Routing.
Previously single mapping scenario:
```py
@dataclass
class Article:
author: str
title: Annotated[str, Path("headline")]
content: Annotated[str, Path("details/content")]
```
But now we have 2 API news sources
```py
data_from_api1 = {
"author": "H.O. Ward"
"headline" : "Top 10 Python extensions",
"other_fields" : ...,
"details": {
"content": "Here are the top 10...",
"other_fields": ...
}
}
data_from_api2 = {
"author": "G.O. Gu"
"news_title" : "Vscode gets a new facelift",
"other_fields" : ...,
"full_article": "Yesterday a new version ...",
}
}
```
We are going to use `dictgest.Route` to define multiple standalone routes.
Our previous example becomes:
```py
@dataclass
class Article:
author: str
title: str # Path annotations are decoupled
content: str
# Routing equivalent to previous example
article_api1 = Route(title="headline", content="details/content")
# New Routing for a new dict structure
article_api2 = Route(title="news_title", content="full_article")
article1 = from_dict(Article, data_from_api1, routing=article_api1)
article2 = from_dict(Article, data_from_api2, routing=article_api2)
```
The full working example can be found in the [examples folder](https://github.com/bmsan/DictGest/blob/main/examples/news_multi_example.py)
## Example 8: Populating from a 2D Table
Sometimes when querying databases/external APIs the reponse might be in a form of a 2D Table (a list of lists)
```py
header = ["humidity", "temperatures", "timestamps"]
table_data = [
[0.4, 7.4, "1Dec2022"],
...
[0.6, 5.4, "21Dec2022"],
]
```
And our desired target structure could look like this:
```py
@dataclass
class SenzorData:
timestamps: list[datetime.datetime]
temperatures: list[float]
humidity: list[float]
```
In this example we would like each data column to be treated as a field of the target type.
To ingest our data into our target type we can use `table_to_item` following:
```py
import dictgest as dg
result = dg.table_to_item(SenzorData, table_data, header)
```
### Transposing data
The operation can be also be performed row wise by using the `transpose = True` flag.
So given
```py
header = ["humidity", "temperatures", "timestamps"]
table_data_transposed = [
# rows are switched with columns
[0.4, ..., 0.6],
[5.4, ..., 7.4]
["1Dec2022", ..., "21Dec2022"],
]
result = dg.table_to_item(SenzorData, table_data_transposed, header, transpose=True)
```
### Mapping one table row to target type
We might not want to convert the whole table into a specific data type but map each row/column to a specific datatype.
```py
#Unlike SenzorData defined previously SenzorDataPoint holds information only for a single specific time.
@dataclass
class SenzorDataPoint:
timestamp: datetime.datetime
temperature: float
humidity: float
```
For this `table_to_items` can be used
```
result = dg.table_to_item(SenzorDataPoint, table_data, header)
result = dg.table_to_item(SenzorDataPoint, table_data_transposed, header, transpose=True)
```
## Installing
```
pip install dictgest
```
## Contributing
First off, thanks for taking the time to contribute! Contributions are what makes the open-source community such an amazing place to learn, inspire, and create. Any contributions you make will benefit everybody else and are **greatly appreciated**.
## Support
Reach out to the maintainer at one of the following places:
- [Github issues](https://github.com/bmsan/DictGest/issues)
- [Discord](https://discord.gg/yBb99rxBUZ)
## License
This project is licensed under the **MIT license**. Feel free to edit and distribute this template as you like.
See [LICENSE](LICENSE) for more information.
## Acknowledgements
- Thanks [Dan Oneata](https://github.com/danoneata) for the discussions related to usecases and API.
نیازمندی
| مقدار | نام |
|---|---|
| >=2.8.2 | python-dateutil |
| >=45.2.0 | setuptools |
زبان مورد نیاز
| مقدار | نام |
|---|---|
| >=3.9 | Python |
نحوه نصب
نصب پکیج whl dictgest-0.4.0:
pip install dictgest-0.4.0.whl
نصب پکیج tar.gz dictgest-0.4.0:
pip install dictgest-0.4.0.tar.gz