how we get Data Factory logging information.
do Microsoft done any documentation. i need complete information when i run pipeline
i.e
Start time , end time, pipeline job id, no of record inserted, deleted, update, error, etc
how we get Data Factory logging information.
do Microsoft done any documentation. i need complete information when i run pipeline
i.e
Start time , end time, pipeline job id, no of record inserted, deleted, update, error, etc
ADF doesn't currently write to the Azure Activity Logs, meaning you can't access details using the Azure Monitor.
Currently the best way I find to get this information is using PowerShell. For example:
Get-AzureRmDataFactoryActivityWindow `
-DataFactoryName $ADFName.DataFactoryName `
-ResourceGroupName $ResourceGroup `
| ? {$_.WindowStart -ge $Now} `
| SELECT ActivityName, ActivityType, WindowState, RunStart, InputDatasets, OutputDatasets `
| Sort-Object ActivityName
More info here: https://docs.microsoft.com/en-us/powershell/module/azurerm.datafactories/get-azurermdatafactoryactivitywindow?view=azurermps-4.0.0
Hope this helps