Subset (1)
default
Split (1)
The dataset generation failed because of a cast error
Error code: DatasetGenerationCastError
Exception: DatasetGenerationCastError
Message: An error occurred while generating the dataset
All the data files must have the same columns, but at some point there are 5 new columns ({'893000', '1000', '1', '100', '43076.026406089'}) and 5 missing columns ({'3', '42941.404279991', '200', '425594454', '892600'}).
This happened while the csv dataset builder was generating data using
hf://datasets/peernagy/lob_bench/GOOG/data_gen_4w0.1B/GOOG_2023-01-03_message_real_id_1018_gen_id_0.csv (at revision 3b550d78812984f85a4ea0be55c3bc691fa947cf)
Please either edit the data files to have matching columns, or separate them into different configurations (see docs at https://hf.co/docs/hub/datasets-manual-configuration#multiple-configurations)
Traceback: Traceback (most recent call last):
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/builder.py", line 1871, in _prepare_split_single
writer.write_table(table)
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/arrow_writer.py", line 643, in write_table
pa_table = table_cast(pa_table, self._schema)
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/table.py", line 2293, in table_cast
return cast_table_to_schema(table, schema)
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/table.py", line 2241, in cast_table_to_schema
raise CastError(
datasets.table.CastError: Couldn't cast
43076.026406089: double
1: int64
1000: int64
100: int64
893000: int64
-1: int64
-- schema metadata --
pandas: '{"index_columns": [{"kind": "range", "name": null, "start": 0, "' + 909
to
{'42941.404279991': Value(dtype='float64', id=None), '3': Value(dtype='int64', id=None), '425594454': Value(dtype='int64', id=None), '200': Value(dtype='int64', id=None), '892600': Value(dtype='int64', id=None), '-1': Value(dtype='int64', id=None)}
because column names don't match
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/src/services/worker/src/worker/job_runners/config/parquet_and_info.py", line 1433, in compute_config_parquet_and_info_response
parquet_operations = convert_to_parquet(builder)
File "/src/services/worker/src/worker/job_runners/config/parquet_and_info.py", line 1050, in convert_to_parquet
builder.download_and_prepare(
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/builder.py", line 925, in download_and_prepare
self._download_and_prepare(
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/builder.py", line 1001, in _download_and_prepare
self._prepare_split(split_generator, **prepare_split_kwargs)
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/builder.py", line 1742, in _prepare_split
for job_id, done, content in self._prepare_split_single(
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/builder.py", line 1873, in _prepare_split_single
raise DatasetGenerationCastError.from_cast_error(
datasets.exceptions.DatasetGenerationCastError: An error occurred while generating the dataset
All the data files must have the same columns, but at some point there are 5 new columns ({'893000', '1000', '1', '100', '43076.026406089'}) and 5 missing columns ({'3', '42941.404279991', '200', '425594454', '892600'}).
This happened while the csv dataset builder was generating data using
hf://datasets/peernagy/lob_bench/GOOG/data_gen_4w0.1B/GOOG_2023-01-03_message_real_id_1018_gen_id_0.csv (at revision 3b550d78812984f85a4ea0be55c3bc691fa947cf)
Please either edit the data files to have matching columns, or separate them into different configurations (see docs at https://hf.co/docs/hub/datasets-manual-configuration#multiple-configurations)Need help to make the dataset viewer work? Make sure to review how to configure the dataset viewer, and open a discussion for direct support.
42941.404279991 float64 | 3 int64 | 425594454 int64 | 200 int64 | 892600 int64 | -1 int64 |
|---|---|---|---|---|---|
42,941.433518 | 3 | 425,725,842 | 25 | 891,600 | 1 |
42,941.435422 | 1 | 1,000 | 25 | 892,400 | -1 |
42,941.438024 | 1 | 1,001 | 25 | 892,600 | -1 |
42,941.443931 | 3 | 425,667,046 | 100 | 891,900 | 1 |
42,941.443952 | 3 | 425,729,186 | 100 | 891,800 | 1 |
42,941.444255 | 1 | 1,002 | 25 | 891,800 | 1 |
42,941.44754 | 1 | 1,003 | 100 | 892,700 | -1 |
42,941.522534 | 3 | 1,002 | 25 | 891,800 | 1 |
42,941.539607 | 1 | 1,004 | 25 | 891,400 | 1 |
42,941.549636 | 3 | 1,003 | 100 | 892,700 | -1 |
42,941.54968 | 1 | 1,005 | 100 | 892,200 | -1 |
42,941.549692 | 1 | 1,006 | 50 | 893,000 | -1 |
42,941.549714 | 1 | 1,007 | 100 | 892,200 | -1 |
42,941.550484 | 1 | 1,008 | 25 | 891,900 | 1 |
42,941.55065 | 1 | 1,009 | 100 | 892,200 | -1 |
42,941.55968 | 3 | 425,729,206 | 200 | 892,600 | -1 |
42,941.562205 | 3 | 1,005 | 25 | 892,400 | -1 |
42,941.574209 | 3 | 1,006 | 25 | 892,400 | -1 |
42,941.576482 | 3 | 1,004 | 50 | 893,000 | -1 |
42,941.592937 | 3 | 1,008 | 25 | 891,000 | 1 |
42,941.604376 | 3 | 425,697,146 | 100 | 891,200 | 1 |
42,941.604459 | 1 | 1,010 | 100 | 891,300 | 1 |
42,941.62223 | 1 | 1,011 | 100 | 891,900 | 1 |
42,941.64453 | 1 | 1,012 | 100 | 892,100 | 1 |
42,941.648709 | 1 | 1,013 | 100 | 891,800 | 1 |
42,941.655633 | 3 | 425,734,374 | 100 | 892,000 | 1 |
42,941.66679 | 3 | 425,734,458 | 100 | 892,500 | -1 |
42,941.667038 | 3 | 1,002 | 200 | 892,200 | -1 |
42,941.670591 | 1 | 1,014 | 100 | 892,300 | -1 |
42,941.702914 | 4 | 1,015 | 50 | 892,200 | -1 |
42,941.707929 | 3 | 1,007 | 25 | 891,800 | 1 |
42,941.756837 | 3 | 425,733,922 | 1 | 892,200 | -1 |
42,941.762865 | 3 | 424,959,534 | 100 | 892,500 | -1 |
42,941.812593 | 3 | 425,735,602 | 100 | 892,100 | 1 |
42,941.824678 | 1 | 1,016 | 200 | 892,300 | -1 |
42,941.844339 | 3 | 425,730,354 | 100 | 892,100 | 1 |
42,941.85599 | 1 | 1,017 | 100 | 892,200 | -1 |
42,941.857868 | 1 | 1,018 | 200 | 892,100 | 1 |
42,941.858026 | 3 | 425,523,134 | 100 | 891,500 | 1 |
42,941.858789 | 3 | 425,739,570 | 100 | 891,700 | 1 |
42,941.860608 | 3 | 425,700,622 | 100 | 892,200 | -1 |
42,941.860657 | 3 | 425,734,990 | 200 | 892,300 | -1 |
42,941.86097 | 1 | 1,019 | 200 | 891,700 | 1 |
42,941.863939 | 3 | 425,733,226 | 100 | 892,500 | -1 |
42,941.864063 | 1 | 1,020 | 100 | 892,600 | -1 |
42,941.864713 | 1 | 1,021 | 100 | 892,100 | 1 |
42,941.864723 | 1 | 1,022 | 100 | 891,700 | 1 |
42,941.868024 | 1 | 1,023 | 100 | 891,900 | 1 |
42,941.904006 | 1 | 1,024 | 25 | 892,200 | -1 |
42,941.905635 | 3 | 425,676,830 | 100 | 891,900 | 1 |
42,941.9057 | 3 | 1,018 | 100 | 892,300 | -1 |
42,941.906295 | 3 | 1,010 | 100 | 891,300 | 1 |
42,941.918639 | 3 | 425,734,486 | 100 | 892,500 | -1 |
42,941.926051 | 3 | 425,734,414 | 100 | 892,500 | -1 |
42,941.933664 | 1 | 1,025 | 100 | 892,300 | -1 |
42,941.948095 | 3 | 1,024 | 25 | 892,400 | -1 |
42,941.949789 | 1 | 1,026 | 100 | 892,800 | -1 |
42,941.949932 | 3 | 425,728,922 | 25 | 892,500 | -1 |
42,941.94996 | 1 | 1,027 | 25 | 892,600 | -1 |
42,941.953679 | 3 | 1,027 | 25 | 892,800 | -1 |
42,941.953969 | 1 | 1,028 | 200 | 892,100 | 1 |
42,941.956996 | 3 | 425,755,750 | 100 | 891,900 | 1 |
42,941.957149 | 1 | 1,029 | 300 | 892,300 | -1 |
42,941.958599 | 3 | 425,734,366 | 100 | 892,300 | -1 |
42,941.958933 | 3 | 1,025 | 100 | 892,000 | 1 |
42,941.961421 | 3 | 425,753,042 | 100 | 892,500 | -1 |
42,941.961421 | 1 | 1,030 | 100 | 892,700 | -1 |
42,941.962639 | 3 | 1,029 | 25 | 892,300 | -1 |
42,941.964526 | 1 | 1,031 | 100 | 892,400 | -1 |
42,941.969614 | 1 | 1,032 | 44 | 892,200 | -1 |
42,941.970333 | 3 | 425,734,786 | 100 | 891,300 | 1 |
42,941.993323 | 1 | 1,033 | 100 | 892,500 | -1 |
42,941.999598 | 3 | 425,594,422 | 22 | 892,200 | -1 |
42,941.99967 | 1 | 1,034 | 50 | 893,000 | -1 |
42,941.999681 | 1 | 1,035 | 100 | 892,400 | -1 |
42,942.013652 | 1 | 1,036 | 100 | 893,000 | -1 |
42,942.018802 | 1 | 1,037 | 100 | 892,300 | -1 |
42,942.022712 | 1 | 1,038 | 100 | 892,500 | -1 |
42,942.023733 | 1 | 1,039 | 100 | 892,200 | -1 |
42,942.025428 | 1 | 1,040 | 1 | 892,700 | -1 |
42,942.030403 | 3 | 1,019 | 100 | 892,200 | -1 |
42,942.042422 | 3 | 1,040 | 50 | 893,000 | -1 |
42,942.042465 | 1 | 1,041 | 100 | 892,600 | -1 |
42,942.042546 | 3 | 425,734,194 | 1 | 892,300 | -1 |
42,942.045628 | 3 | 425,748,346 | 100 | 892,200 | -1 |
42,942.04686 | 3 | 1,032 | 100 | 892,200 | -1 |
42,942.047269 | 1 | 1,042 | 100 | 892,600 | -1 |
42,942.047898 | 1 | 1,043 | 100 | 892,200 | -1 |
42,942.048637 | 1 | 1,044 | 200 | 892,200 | -1 |
42,942.04924 | 1 | 1,045 | 100 | 892,200 | -1 |
42,942.050879 | 3 | 425,757,702 | 100 | 892,200 | -1 |
42,942.057365 | 3 | 425,768,762 | 200 | 892,300 | -1 |
42,942.062331 | 3 | 1,054 | 55 | 892,300 | -1 |
42,942.063466 | 1 | 1,046 | 100 | 892,300 | -1 |
42,942.064384 | 1 | 1,047 | 100 | 892,200 | -1 |
42,942.064868 | 1 | 1,048 | 200 | 892,300 | -1 |
42,942.065465 | 1 | 1,049 | 100 | 892,300 | -1 |
42,942.065528 | 3 | 1,045 | 200 | 892,300 | -1 |
42,942.066038 | 1 | 1,050 | 25 | 892,200 | -1 |
42,942.07089 | 1 | 1,051 | 100 | 892,100 | 1 |
End of preview.
README.md exists but content is empty.
- Downloads last month
- 114