Add more than 5 datasets

[dbyaeger]

Hi, I uploaded a large dataset from my local machine and was forced to split the dataset up into seven folders because of download speeds. I now see that I can only mount 5 datasets at a time. Do you have any idea on a workaround to be able to combine datasets on Floydhub?

[redeipirati]

Hi @dbyaeger,

I now see that I can only mount 5 datasets at a time. Do you have any idea on a workaround to be able to combine datasets on Floydhub?

You can use the Modify Data feature to achieve this. Here's a possible workflow:

1. Run the Modify Data on the first data split
2. Once the Modify Data Workspace will be ready, attach the second data split
3. Merge the dataset (copy the mounted data in the /floyd/home folder)
4. Detach the mounted data split, and attach a new data split
5. Iterate on points 3-4 until you have merged all the data
6. Close the Workspace and you will find a new dataset version with the merged data

Hope that helps.

[dbyaeger]

Thank you @redeipirati!

[dbyaeger]

Hi redeipirati,

After I followed the workflow you outlined I closed the workspace and did not see a new version of the dataset with the merged data. Was there an additional step I was supposed to take?

[redeipirati]

Hi @dbyaeger,

Pretty strange... If you are still facing the same issue, can you please reach us at support@floydhub.com? In this way, it will be easier for us to track and help you with this.