Subset (1)
default
Split (3)
The dataset generation failed
Error code: DatasetGenerationError
Exception: ArrowInvalid
Message: Failed to parse string: '6154_3' as a scalar of type int64
Traceback: Traceback (most recent call last):
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/builder.py", line 1870, in _prepare_split_single
writer.write_table(table)
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/arrow_writer.py", line 622, in write_table
pa_table = table_cast(pa_table, self._schema)
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/table.py", line 2292, in table_cast
return cast_table_to_schema(table, schema)
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/table.py", line 2245, in cast_table_to_schema
arrays = [
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/table.py", line 2246, in <listcomp>
cast_array_to_feature(
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/table.py", line 1795, in wrapper
return pa.chunked_array([func(chunk, *args, **kwargs) for chunk in array.chunks])
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/table.py", line 1795, in <listcomp>
return pa.chunked_array([func(chunk, *args, **kwargs) for chunk in array.chunks])
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/table.py", line 2102, in cast_array_to_feature
return array_cast(
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/table.py", line 1797, in wrapper
return func(array, *args, **kwargs)
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/table.py", line 1949, in array_cast
return array.cast(pa_type)
File "pyarrow/array.pxi", line 996, in pyarrow.lib.Array.cast
File "/src/services/worker/.venv/lib/python3.9/site-packages/pyarrow/compute.py", line 404, in cast
return call_function("cast", [arr], options, memory_pool)
File "pyarrow/_compute.pyx", line 590, in pyarrow._compute.call_function
File "pyarrow/_compute.pyx", line 385, in pyarrow._compute.Function.call
File "pyarrow/error.pxi", line 154, in pyarrow.lib.pyarrow_internal_check_status
File "pyarrow/error.pxi", line 91, in pyarrow.lib.check_status
pyarrow.lib.ArrowInvalid: Failed to parse string: '6154_3' as a scalar of type int64
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/src/services/worker/src/worker/job_runners/config/parquet_and_info.py", line 1415, in compute_config_parquet_and_info_response
parquet_operations, partial, estimated_dataset_info = stream_convert_to_parquet(
File "/src/services/worker/src/worker/job_runners/config/parquet_and_info.py", line 991, in stream_convert_to_parquet
builder._prepare_split(
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/builder.py", line 1741, in _prepare_split
for job_id, done, content in self._prepare_split_single(
File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/builder.py", line 1897, in _prepare_split_single
raise DatasetGenerationError("An error occurred while generating the dataset") from e
datasets.exceptions.DatasetGenerationError: An error occurred while generating the datasetNeed help to make the dataset viewer work? Make sure to review how to configure the dataset viewer, and open a discussion for direct support.
img_file string | sample_id int64 | num_grd_phrases int64 | phrases sequence | mask_file string | img_size sequence | mask_ids sequence | boxes sequence | dialog sequence |
|---|---|---|---|---|---|---|---|---|
D-cube/d3_images/equestrian/002_3605899422.jpg | 0 | 0 | [] | dcube_masks/0.json | [ 600, 800 ] | [] | [] | [ [ "Is there anything that can be referred to as \"a horse running or jumping\" in the image? If yes, please localizae all the instances.", "No, I cannot see anything that meets this description." ], [ "Is there anything that can be referred to as \"a railings being crossed by horses\" in the image? ... |
D-cube/d3_images/equestrian/006_14295751692.jpg | 1 | 3 | [ "a equestrian rider's helmet", "a horse running or jumping", "a railings being crossed by horses" ] | dcube_masks/1.json | [ 533, 799 ] | [ "2", "1", "0" ] | [ [ [ 377, 59, 415, 108 ] ], [ [ 247, 118, 539, 532 ] ], [ [ 3, 218, 798, 532 ] ] ] | [ [ "Does a horseman without helmet present in the image? If yes, show me all the qualified instances in the image.", "No, I don't think \"a horseman without helmet\" is present in the image. " ], [ "Does a equestrian rider's helmet present in the image? If yes, show me all the qualified instances in ... |
D-cube/d3_images/equestrian/007_3605081697.jpg | 2 | 0 | [] | dcube_masks/2.json | [ 600, 800 ] | [] | [] | [ [ "Can you see a horse running or jumping in the image? If yes, please highlight all instances of it.", "No, I don't see anything like that in the image." ], [ "Can you see a railings being crossed by horses in the image? If yes, please highlight all instances of it.", "No, I don't see anything ... |
D-cube/d3_images/equestrian/008_3605079507.jpg | 3 | 0 | [] | dcube_masks/3.json | [ 600, 800 ] | [] | [] | [ [ "Is there a horse running or jumping in this image? If yes, highight all instances.", "No, I don't think that is in the image." ], [ "Is there a railings being crossed by horses in this image? If yes, highight all instances.", "No, I don't think that is in the image." ], [ "Is there a ... |
D-cube/d3_images/equestrian/009_3468912962.jpg | 4 | 1 | [ "a equestrian rider's helmet" ] | dcube_masks/4.json | [ 800, 531 ] | [ "3" ] | [ [ [ 143, 113, 213, 242 ] ] ] | [ [ "Does a railings being crossed by horses present in the image? If yes, show me all the qualified instances in the image.", "No, I don't think \"a railings being crossed by horses\" is present in the image. " ], [ "Does a horseman without helmet present in the image? If yes, show me all the qualifi... |
D-cube/d3_images/equestrian/011_3468099779.jpg | 5 | 1 | [ "a equestrian rider's helmet" ] | dcube_masks/5.json | [ 800, 531 ] | [ "4" ] | [ [ [ 143, 112, 213, 242 ] ] ] | [ [ "Can you see a horse running or jumping in the image? If yes, please highlight all instances of it.", "No, I don't see anything like that in the image." ], [ "Can you see a horseman without helmet in the image? If yes, please highlight all instances of it.", "No, I don't see anything like that... |
D-cube/d3_images/equestrian/012_3498964416.jpg | 6 | 1 | [ "a equestrian rider's helmet" ] | dcube_masks/6.json | [ 553, 799 ] | [ "5_6" ] | [ [ [ 458, 96, 493, 145 ], [ 231, 97, 279, 148 ] ] ] | [ [ "Is there a equestrian rider's helmet in this image? If yes, highight all instances.", "Yes, I have localized all instances of<GRD> a equestrian rider's helmet</GRD> that meet the description." ], [ "Is there a horseman without helmet in this image? If yes, highight all instances.", "No, I don... |
D-cube/d3_images/equestrian/015_3605078485.jpg | 7 | 0 | [] | dcube_masks/7.json | [ 600, 800 ] | [] | [] | [ [ "Is there a horseman without helmet in this image? If yes, highight all instances.", "No, I don't think that is in the image." ], [ "Is there a railings being crossed by horses in this image? If yes, highight all instances.", "No, I don't think that is in the image." ], [ "Is there a e... |
D-cube/d3_images/equestrian/016_2795766094.jpg | 8 | 2 | [ "a equestrian rider's helmet", "a horse running or jumping" ] | dcube_masks/8.json | [ 600, 800 ] | [ "7", "8" ] | [ [ [ 446, 71, 486, 97 ] ], [ [ 406, 130, 536, 528 ] ] ] | [ [ "Can you see a horseman without helmet in the image? If yes, please highlight all instances of it.", "No, I don't see anything like that in the image." ], [ "Can you see a railings being crossed by horses in the image? If yes, please highlight all instances of it.", "No, I don't see anything l... |
D-cube/d3_images/equestrian/017_2795766764.jpg | 9 | 2 | [ "a horse running or jumping", "a equestrian rider's helmet" ] | dcube_masks/9.json | [ 600, 800 ] | [ "10", "9" ] | [ [ [ 405, 130, 537, 528 ] ], [ [ 446, 71, 485, 96 ] ] ] | [ [ "Is there anything that can be referred to as \"a horse running or jumping\" in the image? If yes, please localizae all the instances.", "Yes,<GRD> a horse running or jumping</GRD> has been highlighted." ], [ "Is there anything that can be referred to as \"a equestrian rider's helmet\" in the imag... |
D-cube/d3_images/equestrian/018_14274576936.jpg | 10 | 2 | [ "a equestrian rider's helmet", "a horse running or jumping" ] | dcube_masks/10.json | [ 533, 799 ] | [ "11", "12" ] | [ [ [ 432, 99, 475, 147 ] ], [ [ 84, 175, 639, 502 ] ] ] | [ [ "Is there a horseman without helmet in this image? If yes, highight all instances.", "No, I don't think that is in the image." ], [ "Is there a equestrian rider's helmet in this image? If yes, highight all instances.", "Yes,<GRD> a equestrian rider's helmet</GRD> has been highlighted." ], ... |
D-cube/d3_images/equestrian/021_3622623789.jpg | 11 | 3 | [ "a horse running or jumping", "a equestrian rider's helmet", "a railings being crossed by horses" ] | dcube_masks/11.json | [ 538, 800 ] | [ "13", "14", "15" ] | [ [ [ 299, 137, 638, 383 ] ], [ [ 394, 94, 428, 127 ] ], [ [ 109, 236, 781, 536 ] ] ] | [ [ "Does a horse running or jumping present in the image? If yes, show me all the qualified instances in the image.", "Yes, I have localized all instances of<GRD> a horse running or jumping</GRD> that meet the description." ], [ "Does a equestrian rider's helmet present in the image? If yes, show me ... |
D-cube/d3_images/equestrian/024_2322207989.jpg | 12 | 1 | [ "a equestrian rider's helmet" ] | dcube_masks/12.json | [ 594, 800 ] | [ "16" ] | [ [ [ 355, 17, 413, 82 ] ] ] | [ [ "Is there a equestrian rider's helmet in this image? If yes, highight all instances.", "Yes,<GRD> a equestrian rider's helmet</GRD> has been highlighted." ], [ "Is there a horseman without helmet in this image? If yes, highight all instances.", "No, I don't think that is in the image." ], ... |
D-cube/d3_images/equestrian/025_1039421899.jpg | 13 | 1 | [ "a horseman without helmet" ] | dcube_masks/13.json | [ 598, 800 ] | [ "17_18" ] | [ [ [ 326, 93, 452, 351 ], [ 0, 135, 76, 348 ] ] ] | [ [ "Is there anything that can be referred to as \"a railings being crossed by horses\" in the image? If yes, please localizae all the instances.", "No, I cannot see anything that meets this description." ], [ "Is there anything that can be referred to as \"a horse running or jumping\" in the image? ... |
D-cube/d3_images/equestrian/026_14297149094.jpg | 14 | 1 | [ "a equestrian rider's helmet" ] | dcube_masks/14.json | [ 513, 800 ] | [ "19" ] | [ [ [ 309, 36, 360, 87 ] ] ] | [ [ "Does a horse running or jumping present in the image? If yes, show me all the qualified instances in the image.", "No, I don't think \"a horse running or jumping\" is present in the image. " ], [ "Does a equestrian rider's helmet present in the image? If yes, show me all the qualified instances i... |
D-cube/d3_images/equestrian/027_3468914224.jpg | 15 | 1 | [ "a equestrian rider's helmet" ] | dcube_masks/15.json | [ 531, 800 ] | [ "20_21" ] | [ [ [ 211, 72, 250, 114 ], [ 454, 157, 482, 204 ] ] ] | [ [ "Can you see a horseman without helmet in the image? If yes, please highlight all instances of it.", "No, I don't see anything like that in the image." ], [ "Can you see a horse running or jumping in the image? If yes, please highlight all instances of it.", "No, I don't see anything like that... |
D-cube/d3_images/equestrian/031_253838441.jpg | 16 | 1 | [ "a equestrian rider's helmet" ] | dcube_masks/16.json | [ 637, 1024 ] | [ "22" ] | [ [ [ 448, 15, 586, 143 ] ] ] | [ [ "Is there a equestrian rider's helmet in this image? If yes, highight all instances.", "Yes, here are all qualified instances of<GRD> a equestrian rider's helmet</GRD>." ], [ "Is there a horse running or jumping in this image? If yes, highight all instances.", "No, I don't think that is in the... |
D-cube/d3_images/equestrian/032_3713008849.jpg | 17 | 3 | [ "a equestrian rider's helmet", "a railings being crossed by horses", "a horse running or jumping" ] | dcube_masks/17.json | [ 533, 799 ] | [ "24", "25", "23" ] | [ [ [ 260, 70, 307, 114 ] ], [ [ 9, 182, 791, 532 ] ], [ [ 208, 114, 479, 465 ] ] ] | [ [ "Is there anything that can be referred to as \"a equestrian rider's helmet\" in the image? If yes, please localizae all the instances.", "Yes,<GRD> a equestrian rider's helmet</GRD> has been highlighted." ], [ "Is there anything that can be referred to as \"a railings being crossed by horses\" in... |
D-cube/d3_images/equestrian/037_19070868331.jpg | 18 | 1 | [ "a equestrian rider's helmet" ] | dcube_masks/18.json | [ 500, 500 ] | [ "26" ] |