Test Form Processing AI Model

In another blog, we discussed, how to train and publish the Form processing AI Model. This blog will discuss how to consume that AI model in a real scenario.

For our demo, we will use SharePoint as a source to send the input.

• The first step is for a user to upload the document to SharePoint
• The next step is Power automate flow will be triggered.
• The next step is to Power automate send the data or file content to AI Model.
• The Next AI model returns the result/output.
• Finally, Power automate update the result in SharePoint List, So that we can verify the data

Step by Step to consume AI model through Power Automate

1. Create a Sharepoint list with the following fields. These are the objects/data elements that will be collected from the form.
   1. Passport Number – String
   2. Date of Birth – Date and Time (Date Only)
   3. Place of Birth – String
   4. Issue Date – Date and Time (Date Only)
   5. Expiry Date – Date and Time (Date Only)
      
2. Create automated cloud flow
   1. Go to https://make.powerapps.com
   2. Select the appropriate environment
   3. Create New Solution (If not exist already)
      • Note: The default environment has some restrictions
   4. Click New to create Cloud Flow
      
   5. Source: Sharepoint
   6. Trigger: When an item is created or modified 
       
   7. Enter the name for the flow
   8. Select your Sharepoint site and list
      
   9. Add another action to get SharePoint Attachments
      1. Select the same Site and list
      2. The id should from the Trigger step
          
   10. Add action to SharePoint File Content
       •  Select the same site
       • File Identifier should ‘Id’ from the “Get attachments” step
         
   11. Send the file content to AI Model
       • Select the AI model that we trained
       • Select form type (We can make this dynamically to identify the file type/extension)
         
   12. Update SharePoint list item with the results
       •  We collected below 5 fields from the Model results 
         
   13. Full view of the cloud flow
       
        
   14. Add a new list item in SharePoint
       1. Add an attachment (Test Passport)
       2. Save the list
       3. Flow should be triggered in any moment
          
   15. Verify the result in the SharePoint list
       

Demo – Train and Test Form Processing