[Bug]: CI/CD Extension compilation failed when using TrustedNuget

[thatnavguy]

AL-Go version

8.3

Describe the issue

I am trying to use TrustedNuGetFeeds to fetch RunTime Package from third party.

"TrustedNuGetFeeds": [
{
"url": "https://nuget.pkg.github.com/Aptean-Food-Beverage-ERP/index.json",
"AuthTokenSecret": "APTEAN_NUGET_TOKEN"
}

The CI/CD managed to download the runtime packages, but failed when compiling my app.
what is the reason for the error? did I configure it wrong?

Error: Unexpected error when running action. Error Message: Extension compilation failed src/ATP/Query/ILEInventory.Query.al(17,38): error AL0345: The source of a Column or Filter must be a field defined on the table referenced by its parent DataItem src/ATP/codeunit/ATPMgt.Codeunit.al(38,35): error AL0185: Table 'ItemExpSetupPerSourceFDW' is missing src/ATP/codeunit/ATPMgt.Codeunit.al(73,31): error AL0185: Table 'InspectionStatusLineFDW' is missing src/ATP/Query/ILEExpiration.Query.al(12,38): error AL0345: The source of a Column or Filter must be a field defined on the table referenced by its parent DataItem, StackTrace: at Invoke-ScriptInBcContainer, C:\ProgramData\BcContainerHelper\6.1.11\BcContainerHelper\ContainerHandling\Invoke-ScriptInNavContainer.ps1: line 116 <- at , C:\ProgramData\BcContainerHelper\6.1.11\BcContainerHelper\AppHandling\Publish-NavContainerApp.ps1: line 394 <- at Publish-BcContainerApp, C:\ProgramData\BcContainerHelper\6.1.11\BcContainerHelper\AppHandling\Publish-NavContainerApp.ps1: line 154 <- at , C:\ProgramData\BcContainerHelper\6.1.11\BcContainerHelper\AppHandling\Run-AlPipeline.ps1: line 1192 <- at , C:\ProgramData\BcContainerHelper\6.1.11\BcContainerHelper\AppHandling\Run-AlPipeline.ps1: line 2565 <- at , C:\ProgramData\BcContainerHelper\6.1.11\BcContainerHelper\AppHandling\Run-AlPipeline.ps1: line 2531 <- at , C:\ProgramData\BcContainerHelper\6.1.11\BcContainerHelper\AppHandling\Run-AlPipeline.ps1: line 2515 <- at , C:\ProgramData\BcContainerHelper\6.1.11\BcContainerHelper\AppHandling\Run-AlPipeline.ps1: line 1285 <- at Run-AlPipeline, C:\ProgramData\BcContainerHelper\6.1.11\BcContainerHelper\AppHandling\Run-AlPipeline.ps1: line 1270 <- at , D:\a_actions\microsoft\AL-Go-Actions\v8.3\RunPipeline\RunPipeline.ps1: line 522 <- at , D:\a_temp\22d06d91-d3ee-4c79-a928-098df50be980.ps1: line 3 <- at , D:\a_actions\microsoft\AL-Go-Actions\v8.3\Invoke-AlGoAction.ps1: line 21 <- at , D:\a_temp\22d06d91-d3ee-4c79-a928-098df50be980.ps1: line 2 <- at , : line 1

My app is using fields from these third party apps:
{
"id": "8dc4ee16-bb08-4117-afb0-891c0ef74f25",
"name": "Aptean Expiration Management for Food and Beverage",
"publisher": "Aptean",
"version": "26.0.0.0"
},
{
"id": "2c87fcd8-c5ae-406f-bc35-a6d2b7fd7892",
"publisher": "Aptean",
"name": "Aptean Inspection Status for Food and Beverage",
"version": "26.0.0.0"
},
{
"id": "1a06f0da-5a4d-4a2f-bce2-c04530adac17",
"name": "Aptean Foundation Layer for Food and Beverage",
"publisher": "Aptean",
"version": "26.0.0.0"
}

Expected behavior

Successful CI/CD process.

Steps to reproduce

Run the CI/CD action.

Additional context (logs, screenshots, etc.)

job-logs.txt

[aholstrup1]

As far as I can tell it look like AL-Go ends up downloading the dependencies from the (public) AppSourceSymbols feed which doesn't have the runtime packages.

Could you try setting trustMicrosoftNuGetFeeds to false (https://aka.ms/algosettings#trustMicrosoftNuGetFeeds)? That should force AL-Go go fetch the dependencies from the feed you're defining.

[thatnavguy]

@aholstrup1 I set the trustMicrosoftNuGetFeeds to false, but now I got the error saying that the app cannot be found. I tried to change the Aptean version to zero, still have the issue. Any idea on how to do this?

Missing App dependencies

• 8dc4ee16-bb08-4117-afb0-891c0ef74f25
• 2c87fcd8-c5ae-406f-bc35-a6d2b7fd7892
• 1a06f0da-5a4d-4a2f-bce2-c04530adac17
  Looking for NuGet package 8dc4ee16-bb08-4117-afb0-891c0ef74f25 version 0.0.0.0 (LatestMatching match)
  Search NuGetFeed https://nuget.pkg.github.com/Aptean-Food-Beverage-ERP/index.json
  Search package using https://api.github.com/orgs/Aptean-Food-Beverage-ERP/packages?package_type=nuget&per_page=50&page=1
  50 packages found
  Search package using https://api.github.com/orgs/Aptean-Food-Beverage-ERP/packages?package_type=nuget&per_page=50&page=2
  50 packages found
  Search package using https://api.github.com/orgs/Aptean-Food-Beverage-ERP/packages?package_type=nuget&per_page=50&page=3
  50 packages found
  Search package using https://api.github.com/orgs/Aptean-Food-Beverage-ERP/packages?package_type=nuget&per_page=50&page=4
  50 packages found
  Search package using https://api.github.com/orgs/Aptean-Food-Beverage-ERP/packages?package_type=nuget&per_page=50&page=5
  50 packages found
  Search package using https://api.github.com/orgs/Aptean-Food-Beverage-ERP/packages?package_type=nuget&per_page=50&page=6
  20 packages found
  Total of 270 packages found
  0 matching packages found
  Warning: Failed to publish app 8dc4ee16-bb08-4117-afb0-891c0ef74f25 version 0.0.0.0 to container bc23313853682. Error was: No apps to publish.
  Looking for NuGet package 2c87fcd8-c5ae-406f-bc35-a6d2b7fd7892 version 0.0.0.0 (LatestMatching match)
  Search NuGetFeed https://nuget.pkg.github.com/Aptean-Food-Beverage-ERP/index.json
  Search available packages using cache GitHubPackages:orgs/Aptean-Food-Beverage-ERP
  270 packages found
  0 matching packages found
  Warning: Failed to publish app 2c87fcd8-c5ae-406f-bc35-a6d2b7fd7892 version 0.0.0.0 to container bc23313853682. Error was: No apps to publish.
  Looking for NuGet package 1a06f0da-5a4d-4a2f-bce2-c04530adac17 version 0.0.0.0 (LatestMatching match)
  Search NuGetFeed https://nuget.pkg.github.com/Aptean-Food-Beverage-ERP/index.json
  Search available packages using cache GitHubPackages:orgs/Aptean-Food-Beverage-ERP
  270 packages found
  0 matching packages found
  Warning: Failed to publish app 1a06f0da-5a4d-4a2f-bce2-c04530adac17 version 0.0.0.0 to container bc23313853682. Error was: No apps to publish.
  Installing app dependencies took 33 seconds
  Compiling apps

[aholstrup1]

@thatnavguy could you include the full log again? :)

From the log you shared here it seems that AL-Go does access the feed correctly, but it can't find the dependencies. Did you verify that they exist in the feed? E.g. the following packages should exist in the feed

Aptean.ApteanExpirationManagementforFoodandBeverage.8dc4ee16-bb08-4117-afb0-891c0ef74f25
and
Aptean.ApteanInspectionStatusforFoodandBeverage.2c87fcd8-c5ae-406f-bc35-a6d2b7fd7892

[thatnavguy]

@aholstrup1 here you go.

This is their feed. Only one exists for Expiration Management.

Five for Inspection Status.

job-logs2.txt

[aholstrup1]

I'm not sure this will work out of the box. AL-Go looks for NuGet packages that contain the app id, but since these packages don't contain the app id AL-Go doesn't find them.

Looking for NuGet package 8dc4ee16-bb08-4117-afb0-891c0ef74f25 version 0.0.0.0 (LatestMatching match)

For now, I think the only way of making this work is to create your own script override for InstallMissingDependencies which is where AL-Go looks for NuGet dependencies (https://github.com/microsoft/AL-Go/blob/main/Scenarios/settings.md#run-alpipeline-script-override). You just need to create a script called InstallMissingDependencies.ps1 and place it under your .AL-Go folder.

You can see the implementation AL-Go currently uses below. Right now, AL-Go searches for the app id but I believe this should also work if you search for the app name instead (line 432).

AL-Go/Actions/RunPipeline/RunPipeline.ps1

Lines 407 to 464 in 646025c

	"InstallMissingDependencies" = {
	Param([Hashtable]$parameters)
	foreach($missingDependency in $parameters.missingDependencies) {
	$appid = $missingDependency.Split(':')[0]
	$appName = $missingDependency.Split(':')[1]
	$version = $appName.SubString($appName.LastIndexOf('_')+1)
	$version = [System.Version]$version.SubString(0,$version.Length-4)
	# If dependency app is already installed, skip it
	# If dependency app is already published, synchronize and install it
	if ($parameters.ContainsKey('containerName')) {
	$appInfo = Get-BcContainerAppInfo -containerName $parameters.containerName -tenantSpecificProperties | Where-Object { $_.AppId -eq $appid }
	if ($appInfo) {
	# App already exists
	if (-not $appInfo.isInstalled) {
	Sync-BcContainerApp -containerName $parameters.containerName -tenant $parameters.tenant -appPublisher $appInfo.Publisher -appName $appInfo.Name -appVersion "$($appInfo.version)"
	Install-BcContainerApp -containerName $parameters.containerName -tenant $parameters.tenant -appPublisher $appInfo.Publisher -appName $appInfo.Name -appVersion "$($appInfo.version)"
	}
	continue
	}
	}
	$publishParams = @{
	"nuGetServerUrl" = $gitHubPackagesCredential.serverUrl
	"nuGetToken" = GetAccessToken -token $gitHubPackagesCredential.token -permissions @{"packages"="read";"contents"="read";"metadata"="read"} -repositories @()
	"packageName" = $appId
	"version" = $version
	"select" = $settings.nuGetFeedSelectMode
	}
	if ($parameters.ContainsKey('CopyInstalledAppsToFolder')) {
	$publishParams += @{
	"CopyInstalledAppsToFolder" = $parameters.CopyInstalledAppsToFolder
	}
	}
	if ($parameters.ContainsKey('containerName')) {
	try {
	Publish-BcNuGetPackageToContainer -containerName $parameters.containerName -tenant $parameters.tenant -skipVerification -appSymbolsFolder $parameters.appSymbolsFolder @publishParams
	} catch {
	OutputWarning -message "Failed to publish app $appid version $version to container $($parameters.containerName). Error was: $($_.Exception.Message)."
	}
	}
	else {
	if ($parameters.ContainsKey('installedApps') -and $parameters.ContainsKey('installedCountry')) {
	foreach($installedApp in $parameters.installedApps) {
	if ($installedApp.Id -eq $platformAppId) {
	$publishParams += @{
	"installedApps" = $parameters.installedApps
	"installedPlatform" = ([System.Version]$installedApp.Version)
	"installedCountry" = $parameters.installedCountry
	}
	break
	}
	}
	}
	Download-BcNuGetPackageToFolder -folder $parameters.appSymbolsFolder @publishParams | Out-Null
	}
	}
	}

[thatnavguy]

@aholstrup1 overriding the InstallMissingDependencies works. not ideal, but it is at least working. thanks