How to create custom DataLoader for Ragbits evaluation#
Ragbits provides a base interface for data loading, ragbits.evaluate.loaders.base.DataLoader
, designed specifically for evaluation purposes. A ready-to-use implementation, ragbits.evaluate.loaders.hf.HFLoader
, is available for handling datasets in huggingface format.
To create a custom DataLoader for your specific needs, you need to implement the load
method in a class that inherits from the DataLoader
interface.
Please find the working example here.
Note: This interface is not to be confused with PyTorch's DataLoader
, as it serves a distinct purpose within the Ragbits evaluation framework.