記錄一個奇葩的huggingface數據加載問題

使用dataset = datasets.load_dataset("beyond/rlhf-reward-single-round-trans_chinese")下載數據集會報錯：

FileNotFoundError: [Errno 2] No such file or directory: 'C:/Users/Chenxm/.cache/huggingface/datasets/beyond___rlhf-reward-single-round-trans_chinese/default-56c83c4a1ab39cac/0.0.0/e58c486e4bad3c9cf8d969f920449d1103bbdf069a7150db2cf96c695aeca990.incomplete/rlhf-reward-single-round-trans_chinese-train-00000-00000-of-NNNNN.arrow'

打開該路徑確實啥都沒有。

只用設置個緩存參數就可以下載

dataset = datasets.load_dataset("beyond/rlhf-reward-single-round-trans_chinese", cache_dir="./dataset")