unienv_data.integrations.pytorch¶
UniEnvAsPyTorchDataset
¶
UniEnvAsPyTorchDataset(batch: BatchBase[BatchT, PyTorchArrayType, PyTorchDeviceType, PyTorchDtypeType, PyTorchRNGType], include_metadata: bool = False)
Bases: Dataset
A PyTorch Dataset wrapper for UniEnvPy batches.
__getitems__ fetches a whole mini-batch with a single (already collated) batch access, so
PyTorch's default collation must be bypassed: pass collate_fn=UniEnvAsPyTorchDataset.collate_fn
(the identity) to the DataLoader. Note that collate_fn=None selects PyTorch's
default_collate, which cannot handle a pre-collated batch.
Example::
loader = DataLoader(dataset, batch_size=32, shuffle=True, collate_fn=dataset.collate_fn)
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
batch
|
BatchBase
|
The UniEnvPy batch to wrap. |
required |
include_metadata
|
bool
|
Whether items are |
False
|
PyTorchAsUniEnvDataset
¶
PyTorchAsUniEnvDataset(dataset: Dataset)
Bases: BatchBase[BatchT, PyTorchArrayType, PyTorchDeviceType, PyTorchDtypeType, PyTorchRNGType]
A UniEnvPy BatchBase wrapper for PyTorch Datasets.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
dataset
|
Dataset
|
The PyTorch Dataset to wrap. |
required |
get_flattened_at
¶
get_flattened_at(idx: Union[IndexableType, BArrayType]) -> BArrayType
Fetch samples as flattened backend arrays.
get_flattened_at_with_metadata
¶
get_flattened_at_with_metadata(idx: Union[IndexableType, BArrayType]) -> Tuple[BArrayType, Optional[Dict[str, Any]]]
Fetch flattened samples together with optional per-sample metadata.
set_flattened_at
¶
set_flattened_at(idx: Union[IndexableType, BArrayType], value: BArrayType) -> None
Overwrite existing samples using flattened data.
append_flattened
¶
append_flattened(value: BArrayType) -> None
Append one flattened sample to the batch.
extend_flattened
¶
extend_flattened(value: BArrayType) -> None
Append a batched block of flattened samples.
set_at
¶
set_at(idx: Union[IndexableType, BArrayType], value: BatchT) -> None
Overwrite existing samples using structured data.
remove_at
¶
remove_at(idx: Union[IndexableType, BArrayType]) -> None
Remove one or more samples from the batch.
extend_from
¶
extend_from(other: BatchBase[BatchT, BArrayType, BDeviceType, BDtypeType, BRNGType], chunk_size: int = 8, tqdm: bool = False) -> None
Copy data from another batch in bounded-size chunks.
get_slice
¶
get_slice(idx: Union[IndexableType, BArrayType]) -> BatchBase[BatchT, BArrayType, BDeviceType, BDtypeType, BRNGType]
Create a lazy view over a subset of indices.
get_column
¶
get_column(nested_keys: Sequence[str]) -> BatchBase[Any, BArrayType, BDeviceType, BDtypeType, BRNGType]
Create a lazy view over a nested field inside each sample.