[BUG] Cannot upload large CVAT annotation tasks: Request Entity Too Large

Hi,

When uploading to CVAT I am receiving a OSError: [Errno 24] Too many open files.

The scripts works fine with a couple of test images, but as soon as I move to a large dataset ~16,000 images it will crash with the above error.

Things I have tried:

• Tested with small dataset and confirmed working.
• Tested with 2 x different CVAT servers (inlcluding CVAT.org)
• Increased the ulimit -a on the ubuntu 18 machine to 1048576
• Attempted to use segments to upload.

Appreciate any suggestions or help.

Full trace:

100% |████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 16683/16683 [21.9s elapsed, 0s remaining, 972.2 samples/s]      
Name:        Dataset-10
Media type:  image
Num samples: 16683
Persistent:  True
Tags:        []
Sample fields:
    id:           fiftyone.core.fields.ObjectIdField
    filepath:     fiftyone.core.fields.StringField
    tags:         fiftyone.core.fields.ListField(fiftyone.core.fields.StringField)
    metadata:     fiftyone.core.fields.EmbeddedDocumentField(fiftyone.core.metadata.Metadata)
    ground_truth: fiftyone.core.fields.EmbeddedDocumentField(fiftyone.core.labels.Detections)
Uploading samples to CVAT...
Computing image metadata...
 100% |████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 16683/16683 [20.7s elapsed, 0s remaining, 963.0 samples/s]      
Uncaught exception
Traceback (most recent call last):
  File "/home/inviol/dev/AI_tools/data_management/fiftyone/fiftyone_yolo_dataset_to_CVAT.py", line 53, in <module>
    password="g_nekgrHj33JPCa"
  File "/home/inviol/dev/AI_tools/venv/lib/python3.6/site-packages/fiftyone/core/collections.py", line 6188, in annotate
  File "/home/inviol/dev/AI_tools/venv/lib/python3.6/site-packages/fiftyone/utils/annotations.py", line 212, in annotate
  File "/home/inviol/dev/AI_tools/venv/lib/python3.6/site-packages/fiftyone/utils/cvat.py", line 2657, in upload_annotations
  File "/home/inviol/dev/AI_tools/venv/lib/python3.6/site-packages/fiftyone/utils/cvat.py", line 3516, in upload_samples
  File "/home/inviol/dev/AI_tools/venv/lib/python3.6/site-packages/fiftyone/utils/cvat.py", line 3942, in _create_task_upload_data
  File "/home/inviol/dev/AI_tools/venv/lib/python3.6/site-packages/fiftyone/utils/cvat.py", line 3374, in upload_data
OSError: [Errno 24] Too many open files: '/home/inviol/inviol/new_model/new_data/Dataset-10-Vulcan-Device/19.10.2021 3969.jpg'

Script:

import fiftyone as fo

name = "Dataset-10"

fo.delete_dataset(name) #If you have a persistent DB you want to delete

dataset_dir = "/home/inviol/inviol/new_model/new_data"

dataset_type = fo.types.YOLOv4Dataset  

dataset = fo.Dataset.from_dir(
    dataset_dir=dataset_dir,
    dataset_type=dataset_type,
    name=name,
)

dataset = dataset=fo.load_dataset(name)
dataset.persistent = True
print(dataset)

view = dataset.view()

anno_key = "dataset_10_vulcan_12"

view.annotate(
    anno_key,
    label_field="ground_truth",
    attributes=False,
    launch_editor=False,
    #url="",
    #username="",
    #segment_size=100,
    #password="",
    #image_quality=100,
    username="",
    password=""
)
print(dataset.get_annotation_info(anno_key))