We are submitting U-SQL jobs very frequently and we a see a list of jobs previously submitted in ADLA.
We see the total storage utilization of Data Lake store is increasing day by day. All of our jobs submitted only update one single output file and size is around 10 MB.
The current storage utilization of Data Lake store is 9.3 GB. We think it's due to the previous jobs resources are still saved in the Data Lake. Should we take care of this or we should do something here?
I think the job data expires after a couple of weeks, but if you are concerned and do not need the data for auditing or investigations, feel free to delete them.
Given that the store has no limit and the storage cost 4c/GB/month according to the current pricing website, it is not a big cost though.
You can go to /system/jobservice/jobs/usql/year/month/date.. Feel free to delete the folders that you don't need any more.