Krystian Safjan's Blog

Data Scientist | Researcher | Team Leader

working at Ernst & Young and writing about Data Science and Visualization, on Machine Learning, Deep Learning and NLP. There are also some howto posts on tools and workflows.

PDF, ePUB, mobi format ebook, no DRM
50 questions and answers
Stories from real projects
92 multiple choice quiz questions
80 pages

2022-04-21 Share on: Twitter | Facebook | HackerNews | Reddit

Allow Arbitrary Types (Such as Pandas Dataframe) in Pydantic

Solution 1 - allow arbitrary types
Solution 2 - create a pythonic type hint for a pd.Dataframe
See also

Solution 1 - allow arbitrary types

import pandas as pd
from pydantic import BaseModel


class SubModelInput(BaseModel):
    a: pd.DataFrame
    b: pd.DataFrame

    class Config:
        arbitrary_types_allowed = True

Solution 2 - create a pythonic type hint for a pd.Dataframe

import pandas as pd
from pydantic import BaseModel

from typing import TypeVar

PandasDataFrame = TypeVar('pandas.core.frame.DataFrame')


class SubModelInput(BaseModel):
    a: PandasDataFrame
    b: PandasDataFrame

See also

Pandas DataFrame Validation with Pydantic

Hints from: python - Using Pandas Data Frame as a Type in Pydantic - Stack Overflow